Jul 13 20:16:49.212455 ip-10-0-136-103 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 20:16:49.212468 ip-10-0-136-103 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 20:16:49.212478 ip-10-0-136-103 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 20:16:49.212797 ip-10-0-136-103 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 20:16:59.223472 ip-10-0-136-103 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 20:16:59.223485 ip-10-0-136-103 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot be9100c0255446faaf79993af70aa509 -- Jul 13 20:18:53.045408 ip-10-0-136-103 systemd[1]: Starting Kubernetes Kubelet... Jul 13 20:18:53.541892 ip-10-0-136-103 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 20:18:53.541892 ip-10-0-136-103 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 20:18:53.541892 ip-10-0-136-103 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 20:18:53.541892 ip-10-0-136-103 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 20:18:53.541892 ip-10-0-136-103 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 20:18:53.542819 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.542603 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547827 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547842 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547845 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547848 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547852 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547855 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547858 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547860 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547863 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547867 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547871 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547873 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547878 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547881 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547883 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547886 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547890 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547893 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:18:53.641096 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547896 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547898 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547901 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547904 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547907 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547909 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547912 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547915 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547917 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547920 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547923 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547926 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547928 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547931 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547933 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547936 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547938 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547940 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547943 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547945 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:18:53.641770 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547948 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547950 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547953 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547955 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547958 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547960 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547962 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547965 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547968 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547970 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547973 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547975 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547978 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547980 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547983 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547985 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547988 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.547991 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548001 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548003 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:18:53.642323 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548006 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548009 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548011 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548014 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548016 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548019 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548023 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548027 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548031 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548034 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548037 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548040 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548043 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548046 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548049 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548053 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548067 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548069 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548072 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:18:53.642852 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548074 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548077 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548080 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548083 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548086 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548088 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548090 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548093 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548095 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548098 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548101 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548104 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548107 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548110 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548112 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548115 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548117 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548120 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548122 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548125 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:18:53.643449 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548127 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548130 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548892 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548899 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548902 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548905 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548907 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548910 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548912 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548915 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548918 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548922 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548926 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548929 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548932 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548936 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548939 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548942 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548945 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:18:53.644031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548947 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548950 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548952 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548955 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548958 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548960 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548963 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548965 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548968 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548970 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548973 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548976 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548979 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548981 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548985 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548988 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548990 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548993 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548995 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.548998 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:18:53.645465 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549001 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549003 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549006 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549008 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549011 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549013 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549015 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549018 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549023 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549026 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549028 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549031 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549034 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549037 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549039 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549042 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549044 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549047 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549049 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549052 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:18:53.646233 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549073 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549077 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549082 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549085 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549089 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549093 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549096 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549099 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549101 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549104 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549107 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549109 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549111 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549114 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549116 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549119 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549123 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549125 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549128 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549131 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:18:53.646987 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549135 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549138 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549148 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549150 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549153 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549155 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549158 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549161 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549163 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549166 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549168 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549171 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549173 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549176 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549180 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549184 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549187 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549191 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549195 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:18:53.647763 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549197 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549200 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549203 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549600 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549605 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549608 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549611 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549613 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549616 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549618 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549621 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549624 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549626 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549632 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549635 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549639 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549642 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549644 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549647 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:18:53.649091 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549650 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549653 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549655 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549658 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549661 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549664 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549666 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549668 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549671 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549673 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549676 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549679 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549681 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549684 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549686 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549689 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549691 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549693 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549696 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549698 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:18:53.649691 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549701 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549703 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549705 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549708 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549710 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549712 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549717 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549719 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549722 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549725 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549727 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549730 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549732 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549734 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549737 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549739 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549741 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549744 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549746 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549749 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:18:53.651539 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549751 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549753 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549757 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549760 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549762 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549765 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549767 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549770 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549772 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549775 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549777 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549779 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549782 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549784 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549786 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549789 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549792 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549795 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549801 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:18:53.652346 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549804 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549806 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549809 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549812 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549815 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549817 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549820 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549822 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549824 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549827 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549829 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549831 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549834 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549836 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549838 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549842 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549844 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549847 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549849 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549852 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:18:53.653578 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549854 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549857 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549859 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.549861 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549939 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549946 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549952 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549957 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549961 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549966 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549971 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549981 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549986 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549989 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549992 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549995 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.549999 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550002 2579 flags.go:64] FLAG: --cgroup-root="" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550005 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550007 2579 flags.go:64] FLAG: --client-ca-file="" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550010 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550013 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550017 2579 flags.go:64] FLAG: --cluster-domain="" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550020 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 20:18:53.654436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550023 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550026 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550029 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550035 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550038 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550041 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550044 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550047 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550050 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550053 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550072 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550077 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550082 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550085 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550088 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550090 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550093 2579 flags.go:64] FLAG: --enable-server="true" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550096 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550104 2579 flags.go:64] FLAG: --event-burst="100" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550108 2579 flags.go:64] FLAG: --event-qps="50" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550111 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550114 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550117 2579 flags.go:64] FLAG: --eviction-hard="" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550121 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 20:18:53.655587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550124 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550127 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550130 2579 flags.go:64] FLAG: --eviction-soft="" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550133 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550136 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550139 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550141 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550144 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550147 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550150 2579 flags.go:64] FLAG: --feature-gates="" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550153 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550158 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550161 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550164 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550167 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550170 2579 flags.go:64] FLAG: --help="false" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550172 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-136-103.ec2.internal" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550177 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550180 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550183 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550186 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550189 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550192 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 20:18:53.656789 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550195 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550197 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550200 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550203 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550207 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550210 2579 flags.go:64] FLAG: --kube-reserved="" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550213 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550216 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550228 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550231 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550234 2579 flags.go:64] FLAG: --lock-file="" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550237 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550240 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550243 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550248 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550251 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550254 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550256 2579 flags.go:64] FLAG: --logging-format="text" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550259 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550263 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550267 2579 flags.go:64] FLAG: --manifest-url="" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550269 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550273 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550277 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550281 2579 flags.go:64] FLAG: --max-pods="110" Jul 13 20:18:53.660114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550284 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 20:18:53.657593 ip-10-0-136-103 systemd[1]: Started Kubernetes Kubelet. Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550286 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550289 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550292 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550295 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550298 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550301 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550308 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550311 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550314 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550316 2579 flags.go:64] FLAG: --pod-cidr="" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550321 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550326 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550329 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550332 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550336 2579 flags.go:64] FLAG: --port="10250" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550339 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550341 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f9aee21a3612059a" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550345 2579 flags.go:64] FLAG: --qos-reserved="" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550349 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550352 2579 flags.go:64] FLAG: --register-node="true" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550355 2579 flags.go:64] FLAG: --register-with-taints="" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550358 2579 flags.go:64] FLAG: --registry-burst="10" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550361 2579 flags.go:64] FLAG: --registry-qps="5" Jul 13 20:18:53.661631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550364 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550366 2579 flags.go:64] FLAG: --reserved-memory="" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550374 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550377 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550382 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550385 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550387 2579 flags.go:64] FLAG: --runonce="false" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550390 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550393 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550396 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550399 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550401 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550404 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550407 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550410 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550413 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550416 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550419 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550422 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550426 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550429 2579 flags.go:64] FLAG: --system-cgroups="" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550432 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550437 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550440 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550443 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 20:18:53.663173 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550447 2579 flags.go:64] FLAG: --tls-min-version="" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550449 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550452 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550456 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550458 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550461 2579 flags.go:64] FLAG: --v="2" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550465 2579 flags.go:64] FLAG: --version="false" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550469 2579 flags.go:64] FLAG: --vmodule="" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550472 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.550476 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550619 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550624 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550626 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550629 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550632 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550634 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550637 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550639 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550642 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550645 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550647 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550650 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:18:53.663927 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550652 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550654 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550663 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550665 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550669 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550671 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550674 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550676 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550679 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550681 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550684 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550686 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550689 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550691 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550699 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550704 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550707 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550710 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550713 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:18:53.769661 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550715 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550718 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550722 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550724 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550727 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550729 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550732 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550734 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550737 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550739 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550742 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550744 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550746 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550749 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550752 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550755 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550759 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550763 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550765 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550768 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:18:53.770417 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550770 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550772 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550775 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550777 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550780 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550782 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550784 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550787 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550795 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550798 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550800 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550803 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550805 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550808 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550812 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550814 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550817 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550819 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550822 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550824 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:18:53.772401 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550827 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550829 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550832 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550834 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550837 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550839 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550842 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550844 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550847 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550851 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550854 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550857 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550860 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550863 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550866 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550869 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550871 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550874 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550876 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:18:53.773184 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550879 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550881 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550889 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550891 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550894 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550896 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550898 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550903 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.550905 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.551433 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.558466 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.558482 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.558501 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.558507 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558581 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:18:53.775154 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558586 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558590 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558592 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558595 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558598 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558600 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558603 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558606 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558608 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558611 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558613 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558616 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558619 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558621 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558624 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558626 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558629 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558631 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558634 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:18:53.775918 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558642 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558645 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558647 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558651 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558653 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558656 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558658 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558661 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558663 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558666 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558668 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558670 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558672 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558675 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558677 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558680 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558683 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558685 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558687 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558690 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:18:53.778441 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558692 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558694 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558697 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558699 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558702 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558706 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558708 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558711 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558713 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558716 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558718 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558721 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558724 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558733 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558736 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558741 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558744 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558747 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558749 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:18:53.779229 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558752 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558755 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558757 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558760 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558762 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558768 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558771 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558773 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558776 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558779 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558781 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558784 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558786 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558788 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558791 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558794 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558796 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558798 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558801 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558803 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:18:53.782834 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558805 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558808 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558810 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558813 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558815 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558819 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558822 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558830 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558835 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558837 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558840 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558842 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558845 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558847 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558850 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558852 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558855 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558857 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558859 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:18:53.783619 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.558862 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.558867 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559007 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559012 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559014 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559017 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559020 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559022 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559025 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559029 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559033 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559041 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559044 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559047 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 20:18:53.786419 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559050 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559067 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559071 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559074 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559077 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559080 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559082 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559095 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559100 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559103 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559106 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559109 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559111 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559114 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559116 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559119 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559122 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559124 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559126 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 20:18:53.787197 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559129 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559132 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559134 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559136 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559138 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559141 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559143 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559145 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559148 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559150 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559152 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559155 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559157 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559160 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559162 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559164 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559169 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559171 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559174 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559176 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 20:18:53.791104 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559180 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559189 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559192 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559194 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559197 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559200 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559202 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559204 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559207 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559209 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559211 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559214 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559216 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559218 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559221 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559223 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559226 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559228 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559231 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559233 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 20:18:53.791855 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559235 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559238 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559240 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559242 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559245 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559247 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559249 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559252 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559256 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559259 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559261 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559263 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559267 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559270 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559279 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559281 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559284 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559286 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559289 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559291 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 20:18:53.795712 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559294 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559296 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559298 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559301 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559303 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559306 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559308 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:53.559310 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.559315 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.559453 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.562171 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.563310 2579 server.go:1019] "Starting client certificate rotation" Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.563406 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 20:18:53.796501 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.563457 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 20:18:53.892734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.574467 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 20:18:53.892734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.576609 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 20:18:53.892734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.594445 2579 log.go:25] "Validated CRI v1 runtime API" Jul 13 20:18:53.892734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.596280 2579 log.go:25] "Validated CRI v1 image API" Jul 13 20:18:53.892734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.597077 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 20:18:53.892734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.608674 2579 fs.go:135] Filesystem UUIDs: map[4a8bf8bf-3fef-48f9-927a-c851bbcbc1b0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 aca110d9-bdc2-4032-9cb4-5eb39fcf3114:/dev/nvme0n1p4] Jul 13 20:18:53.892734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.608691 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 20:18:53.892734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.609998 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.613665 2579 manager.go:216] Machine: {Timestamp:2026-07-13 20:18:53.612321955 +0000 UTC m=+0.457945312 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3208483 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec225c722608ddfa99f44e30c2047768 SystemUUID:ec225c72-2608-ddfa-99f4-4e30c2047768 BootID:be9100c0-2554-46fa-af79-993af70aa509 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:96:9b:07:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:96:9b:07:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:79:04:e7:38:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.613764 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.613870 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.620452 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.620483 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.621136 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.621147 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.621155 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.621734 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.622745 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.626351 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.626476 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.626504 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.626514 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.626531 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.626544 2579 kubelet.go:398] "Adding apiserver pod source" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.626553 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 20:18:53.895422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.626976 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.626998 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:53.636279 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:53.636411 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.641294 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643046 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643091 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643242 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643265 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643276 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643284 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643296 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643304 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643685 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643692 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643698 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643704 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643712 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643719 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643978 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.643992 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.656601 2579 server.go:1268] "Started kubelet" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.656959 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.656989 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.657025 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.658752 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.659077 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.660482 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.667560 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4k2hp" Jul 13 20:18:53.896201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:53.675576 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4k2hp" Jul 13 20:18:54.292962 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.292930 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 20:18:54.293091 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.292997 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 20:18:54.293278 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.293256 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-103.ec2.internal\" not found" Jul 13 20:18:54.293876 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.293833 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 20:18:54.293977 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.293945 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 20:18:54.293977 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.293962 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 20:18:54.294174 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.294157 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 13 20:18:54.294174 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.294171 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 13 20:18:54.294319 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.294212 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 20:18:54.294372 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.294338 2579 factory.go:55] Registering systemd factory Jul 13 20:18:54.294372 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.294356 2579 factory.go:223] Registration of the systemd container factory successfully Jul 13 20:18:54.294602 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.294582 2579 factory.go:153] Registering CRI-O factory Jul 13 20:18:54.294602 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.294602 2579 factory.go:223] Registration of the crio container factory successfully Jul 13 20:18:54.294810 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.294708 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 20:18:54.294810 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.294779 2579 factory.go:103] Registering Raw factory Jul 13 20:18:54.294810 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.294800 2579 manager.go:1196] Started watching for new ooms in manager Jul 13 20:18:54.295419 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.295404 2579 manager.go:349] Starting recovery of all containers Jul 13 20:18:54.305200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.305176 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:18:54.307966 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.307944 2579 manager.go:354] Recovery completed Jul 13 20:18:54.312349 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.312329 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-103.ec2.internal\" not found" node="ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.313524 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.313511 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:18:54.315463 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.315447 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:18:54.315532 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.315479 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:18:54.315532 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.315491 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:18:54.316079 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.316060 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 20:18:54.316079 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.316077 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 20:18:54.316204 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.316109 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 13 20:18:54.316204 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.316064 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:18:54.316862 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.316847 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:18:54.316943 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.316880 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:18:54.316943 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.316895 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:18:54.318448 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.318434 2579 policy_none.go:49] "None policy: Start" Jul 13 20:18:54.318496 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.318452 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 20:18:54.318496 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.318462 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 20:18:54.320541 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.320529 2579 policy_none.go:47] "Start" Jul 13 20:18:54.353900 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.353751 2579 manager.go:337] "Starting Device Plugin manager" Jul 13 20:18:54.353986 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.353924 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 20:18:54.353986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.353938 2579 server.go:87] "Starting device plugin registration server" Jul 13 20:18:54.354244 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.354230 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 20:18:54.354310 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.354246 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 20:18:54.354466 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.354434 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 20:18:54.354555 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.354526 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 20:18:54.354555 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.354537 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 20:18:54.354957 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.354940 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 20:18:54.355020 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.354988 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-103.ec2.internal\" not found" Jul 13 20:18:54.437644 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.437587 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 20:18:54.439892 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.438819 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 20:18:54.439892 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.438865 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 20:18:54.439892 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.438894 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 20:18:54.439892 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.438934 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 20:18:54.441633 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.441614 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:18:54.454898 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.454886 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:18:54.455734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.455711 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:18:54.455815 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.455751 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:18:54.455815 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.455768 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:18:54.455815 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.455799 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.466277 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.466259 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.466336 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.466279 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-103.ec2.internal\": node \"ip-10-0-136-103.ec2.internal\" not found" Jul 13 20:18:54.494837 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.494815 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-103.ec2.internal\" not found" Jul 13 20:18:54.539536 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.539506 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal"] Jul 13 20:18:54.539613 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.539579 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:18:54.541108 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.541087 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:18:54.541200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.541116 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:18:54.541200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.541126 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:18:54.543479 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.543465 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:18:54.543842 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.543577 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.543842 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.543604 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:18:54.544241 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.544217 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:18:54.544328 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.544225 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:18:54.544328 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.544269 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:18:54.544328 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.544281 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:18:54.544328 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.544248 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:18:54.544328 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.544329 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:18:54.546576 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.546562 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.546627 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.546588 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 20:18:54.547765 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.547450 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientMemory" Jul 13 20:18:54.547765 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.547476 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 20:18:54.547765 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.547489 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeHasSufficientPID" Jul 13 20:18:54.556373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.556359 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:18:54.561710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.561698 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.562762 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.562749 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 20:18:54.562889 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.562870 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 20:18:54.562936 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.562914 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 20:18:54.562936 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.562917 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 20:18:54.563037 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.563011 2579 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a17dbaaec935e4f1c8f8480c152286dd-be68632ba4fe6d89.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.136.103:43756->100.58.27.185:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.563075 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.562942 2579 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a17dbaaec935e4f1c8f8480c152286dd-be68632ba4fe6d89.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-136-103.ec2.internal.18c1f2d7636e5e87\": read tcp 10.0.136.103:43756->100.58.27.185:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-136-103.ec2.internal.18c1f2d7636e5e87 default 5811 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-103.ec2.internal,UID:ip-10-0-136-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-103.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-103.ec2.internal,},FirstTimestamp:2026-07-13 20:18:54 +0000 UTC,LastTimestamp:2026-07-13 20:18:54.541130289 +0000 UTC m=+1.386753644,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-103.ec2.internal,}" Jul 13 20:18:54.565793 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.565779 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.591608 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.591589 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 20:18:54.593947 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.593934 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.596975 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.596957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f58909a182794d524674b73ff7f57684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal\" (UID: \"f58909a182794d524674b73ff7f57684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.597056 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.596980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ce1c96c462bac221c22632c6690050c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-103.ec2.internal\" (UID: \"9ce1c96c462bac221c22632c6690050c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.597056 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.596998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f58909a182794d524674b73ff7f57684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal\" (UID: \"f58909a182794d524674b73ff7f57684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.608948 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.608932 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 20:18:54.609025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.609012 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.621027 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.621003 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 20:18:54.621144 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.621048 2579 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-103.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.627286 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.627274 2579 apiserver.go:52] "Watching apiserver" Jul 13 20:18:54.634466 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.634447 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 20:18:54.636116 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.636098 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal","openshift-network-diagnostics/network-check-target-b757q","openshift-network-operator/iptables-alerter-g8kd2","openshift-ovn-kubernetes/ovnkube-node-6vz2w"] Jul 13 20:18:54.638735 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.638719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.641127 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.641105 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:18:54.641232 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.641184 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 20:18:54.641232 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.641180 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:18:54.641232 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.641205 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 20:18:54.641540 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.641524 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 20:18:54.641588 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.641535 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8xl26\"" Jul 13 20:18:54.643362 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.643345 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.645838 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.645675 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 20:18:54.646051 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.646035 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mpbn4\"" Jul 13 20:18:54.647536 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.646362 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.647536 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.647500 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 20:18:54.648022 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.647666 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 20:18:54.654124 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.654109 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 20:18:54.654255 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.654239 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 20:18:54.654255 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.654252 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 20:18:54.654409 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.654267 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 20:18:54.654409 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.654294 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kwp7q\"" Jul 13 20:18:54.654538 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.654521 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 20:18:54.654577 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.654569 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 20:18:54.680037 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.679998 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 20:13:53 +0000 UTC" deadline="2028-03-31 17:46:11.03213414 +0000 UTC" Jul 13 20:18:54.680120 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.680036 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15045h27m16.352101339s" Jul 13 20:18:54.694636 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.694594 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 20:18:54.697264 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-socket-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.697338 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697279 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-run-netns\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697338 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfwq6\" (UniqueName: \"kubernetes.io/projected/bc79ec05-9471-4524-93d6-c2ebf0a37e87-kube-api-access-rfwq6\") pod \"iptables-alerter-g8kd2\" (UID: \"bc79ec05-9471-4524-93d6-c2ebf0a37e87\") " pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.697431 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-systemd-units\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697431 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-slash\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697431 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-var-lib-openvswitch\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697431 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-registration-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.697585 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4g24\" (UniqueName: \"kubernetes.io/projected/37090a6d-df08-41c0-ac6e-070f33196246-kube-api-access-d4g24\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.697585 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f58909a182794d524674b73ff7f57684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal\" (UID: \"f58909a182794d524674b73ff7f57684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.697585 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/354b055a-f556-4dc1-9af0-073c9132ce64-env-overrides\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697585 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697558 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:18:54.697757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f58909a182794d524674b73ff7f57684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal\" (UID: \"f58909a182794d524674b73ff7f57684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.697757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697617 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f58909a182794d524674b73ff7f57684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal\" (UID: \"f58909a182794d524674b73ff7f57684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.697757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-kubelet\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-run-openvswitch\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697654 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f58909a182794d524674b73ff7f57684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal\" (UID: \"f58909a182794d524674b73ff7f57684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.697757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-cni-netd\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-kubelet-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697790 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-etc-selinux\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-run-systemd\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc79ec05-9471-4524-93d6-c2ebf0a37e87-iptables-alerter-script\") pod \"iptables-alerter-g8kd2\" (UID: \"bc79ec05-9471-4524-93d6-c2ebf0a37e87\") " pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-cni-bin\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/354b055a-f556-4dc1-9af0-073c9132ce64-ovn-node-metrics-cert\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-etc-openvswitch\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.697986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-run-ovn\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.697998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-device-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.698013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-sys-fs\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.698038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ce1c96c462bac221c22632c6690050c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-103.ec2.internal\" (UID: \"9ce1c96c462bac221c22632c6690050c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.698057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc79ec05-9471-4524-93d6-c2ebf0a37e87-host-slash\") pod \"iptables-alerter-g8kd2\" (UID: \"bc79ec05-9471-4524-93d6-c2ebf0a37e87\") " pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.698096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-node-log\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.698142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-log-socket\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.698143 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ce1c96c462bac221c22632c6690050c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-103.ec2.internal\" (UID: \"9ce1c96c462bac221c22632c6690050c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.698162 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/354b055a-f556-4dc1-9af0-073c9132ce64-ovnkube-config\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.698190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/354b055a-f556-4dc1-9af0-073c9132ce64-ovnkube-script-lib\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.698346 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.698211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8knc5\" (UniqueName: \"kubernetes.io/projected/354b055a-f556-4dc1-9af0-073c9132ce64-kube-api-access-8knc5\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.700778 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.700741 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:18:54.714632 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.714615 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-dp6f8"] Jul 13 20:18:54.717207 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.717193 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-l6bf9"] Jul 13 20:18:54.717336 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.717322 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.719542 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.719520 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 20:18:54.719683 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.719669 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ncvtf\"" Jul 13 20:18:54.719728 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.719707 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 20:18:54.719728 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.719717 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.719797 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.719776 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 20:18:54.720276 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.720261 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 20:18:54.721444 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.721427 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 20:18:54.721603 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.721587 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 20:18:54.721675 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.721661 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 20:18:54.721917 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.721904 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jnv4n\"" Jul 13 20:18:54.738400 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.738385 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-fgd98"] Jul 13 20:18:54.740776 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.740761 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-l5s88"] Jul 13 20:18:54.740877 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.740864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:54.740942 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.740926 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:18:54.743259 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.743246 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:18:54.746914 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.746895 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 20:18:54.747011 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.746934 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 20:18:54.747512 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.747497 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t6pwq\"" Jul 13 20:18:54.798913 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.798881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/354b055a-f556-4dc1-9af0-073c9132ce64-env-overrides\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799028 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.798919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:18:54.799028 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.798946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-kubelet\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799028 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.798998 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-kubelet\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799033 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-run-openvswitch\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-cni-netd\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-etc-selinux\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.799200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-cni-binary-copy\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.799200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799147 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-run-openvswitch\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:54.799200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799164 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-cni-netd\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d-konnectivity-ca\") pod \"konnectivity-agent-l5s88\" (UID: \"4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d\") " pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-etc-selinux\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc79ec05-9471-4524-93d6-c2ebf0a37e87-iptables-alerter-script\") pod \"iptables-alerter-g8kd2\" (UID: \"bc79ec05-9471-4524-93d6-c2ebf0a37e87\") " pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799287 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-cni-bin\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799355 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-cni-bin\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/354b055a-f556-4dc1-9af0-073c9132ce64-ovn-node-metrics-cert\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-etc-openvswitch\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-run-ovn\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c21f4720-1194-47ad-9668-8be83c1a675d-serviceca\") pod \"node-ca-l6bf9\" (UID: \"c21f4720-1194-47ad-9668-8be83c1a675d\") " pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799453 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc79ec05-9471-4524-93d6-c2ebf0a37e87-host-slash\") pod \"iptables-alerter-g8kd2\" (UID: \"bc79ec05-9471-4524-93d6-c2ebf0a37e87\") " pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799462 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-etc-openvswitch\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-node-log\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-log-socket\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.799508 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-node-log\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8knc5\" (UniqueName: \"kubernetes.io/projected/354b055a-f556-4dc1-9af0-073c9132ce64-kube-api-access-8knc5\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799549 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc79ec05-9471-4524-93d6-c2ebf0a37e87-host-slash\") pod \"iptables-alerter-g8kd2\" (UID: \"bc79ec05-9471-4524-93d6-c2ebf0a37e87\") " pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799561 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-run-ovn\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-hostroot\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799580 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-log-socket\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c21f4720-1194-47ad-9668-8be83c1a675d-host\") pod \"node-ca-l6bf9\" (UID: \"c21f4720-1194-47ad-9668-8be83c1a675d\") " pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d-agent-certs\") pod \"konnectivity-agent-l5s88\" (UID: \"4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d\") " pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-run-netns\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfwq6\" (UniqueName: \"kubernetes.io/projected/bc79ec05-9471-4524-93d6-c2ebf0a37e87-kube-api-access-rfwq6\") pod \"iptables-alerter-g8kd2\" (UID: \"bc79ec05-9471-4524-93d6-c2ebf0a37e87\") " pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799879 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-run-netns\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-systemd-units\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g24\" (UniqueName: \"kubernetes.io/projected/37090a6d-df08-41c0-ac6e-070f33196246-kube-api-access-d4g24\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.799948 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-cnibin\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-etc-kubernetes\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800027 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-systemd-units\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-run-k8s-cni-cncf-io\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800134 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zglpt\" (UniqueName: \"kubernetes.io/projected/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-kube-api-access-zglpt\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfkfw\" (UniqueName: \"kubernetes.io/projected/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-kube-api-access-wfkfw\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800184 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-kubelet-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-cni-dir\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-os-release\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-var-lib-cni-multus\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-conf-dir\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-run-systemd\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800303 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gmxj\" (UniqueName: \"kubernetes.io/projected/c21f4720-1194-47ad-9668-8be83c1a675d-kube-api-access-9gmxj\") pod \"node-ca-l6bf9\" (UID: \"c21f4720-1194-47ad-9668-8be83c1a675d\") " pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800316 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-kubelet-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800336 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-device-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-sys-fs\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-run-netns\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-var-lib-cni-bin\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-sys-fs\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.800927 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800548 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-run-systemd\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800570 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800582 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/354b055a-f556-4dc1-9af0-073c9132ce64-env-overrides\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-var-lib-kubelet\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800637 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-device-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-daemon-config\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/354b055a-f556-4dc1-9af0-073c9132ce64-ovnkube-config\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/354b055a-f556-4dc1-9af0-073c9132ce64-ovnkube-script-lib\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-socket-dir-parent\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-socket-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-system-cni-dir\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-run-multus-certs\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-slash\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-var-lib-openvswitch\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-registration-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800868 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-host-slash\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/354b055a-f556-4dc1-9af0-073c9132ce64-var-lib-openvswitch\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.801676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.800939 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-registration-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.802191 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.801008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37090a6d-df08-41c0-ac6e-070f33196246-socket-dir\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.802191 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.801270 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/354b055a-f556-4dc1-9af0-073c9132ce64-ovnkube-config\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.802191 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.801502 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc79ec05-9471-4524-93d6-c2ebf0a37e87-iptables-alerter-script\") pod \"iptables-alerter-g8kd2\" (UID: \"bc79ec05-9471-4524-93d6-c2ebf0a37e87\") " pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.802191 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.801728 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/354b055a-f556-4dc1-9af0-073c9132ce64-ovnkube-script-lib\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.803879 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.803863 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/354b055a-f556-4dc1-9af0-073c9132ce64-ovn-node-metrics-cert\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.813526 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.813505 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:18:54.813526 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.813523 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:18:54.813632 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.813532 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9nrg for pod openshift-network-diagnostics/network-check-target-b757q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:18:54.813632 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.813594 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg podName:369082c4-9db4-4aa2-9327-6f87a74fb81b nodeName:}" failed. No retries permitted until 2026-07-13 20:18:55.313578337 +0000 UTC m=+2.159201678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z9nrg" (UniqueName: "kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg") pod "network-check-target-b757q" (UID: "369082c4-9db4-4aa2-9327-6f87a74fb81b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:18:54.815756 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.815737 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-c5lt8"] Jul 13 20:18:54.818931 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.818911 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfwq6\" (UniqueName: \"kubernetes.io/projected/bc79ec05-9471-4524-93d6-c2ebf0a37e87-kube-api-access-rfwq6\") pod \"iptables-alerter-g8kd2\" (UID: \"bc79ec05-9471-4524-93d6-c2ebf0a37e87\") " pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.819755 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.819741 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:54.822178 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.822126 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xtrqn\"" Jul 13 20:18:54.822324 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.822305 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 20:18:54.822557 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.822532 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8knc5\" (UniqueName: \"kubernetes.io/projected/354b055a-f556-4dc1-9af0-073c9132ce64-kube-api-access-8knc5\") pod \"ovnkube-node-6vz2w\" (UID: \"354b055a-f556-4dc1-9af0-073c9132ce64\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:54.822638 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.822620 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 20:18:54.822834 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.822816 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4g24\" (UniqueName: \"kubernetes.io/projected/37090a6d-df08-41c0-ac6e-070f33196246-kube-api-access-d4g24\") pod \"aws-ebs-csi-driver-node-txmhp\" (UID: \"37090a6d-df08-41c0-ac6e-070f33196246\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.823258 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.823242 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-86tqx"] Jul 13 20:18:54.825910 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.825894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.827919 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.827904 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 20:18:54.828004 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.827997 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 20:18:54.828344 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.828331 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7npsl\"" Jul 13 20:18:54.848673 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.848656 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-f7hzx"] Jul 13 20:18:54.851447 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.851431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:54.854609 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.854589 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 20:18:54.854609 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.854602 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 20:18:54.854721 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.854647 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dhntx\"" Jul 13 20:18:54.864523 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.864510 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.874388 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.874371 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qzqfs"] Jul 13 20:18:54.874631 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.874616 2579 predicate.go:218] "Predicate failed on Pod" pod="kube-system/global-pull-secret-syncer-qzqfs" err="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jul 13 20:18:54.874696 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.874632 2579 allocation_manager.go:702] "Pod admission denied" podUID="14b26508-cc22-4bd4-98a4-420e57f61b7a" pod="kube-system/global-pull-secret-syncer-qzqfs" reason="NodeAffinity" message="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jul 13 20:18:54.896153 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.896130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" Jul 13 20:18:54.901119 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-run-netns\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901226 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-var-lib-cni-bin\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901226 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901159 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-run-netns\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901226 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901201 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-var-lib-cni-bin\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901226 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-var-lib-kubelet\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901226 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-var-lib-kubelet\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-daemon-config\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-sys\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-socket-dir-parent\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-sysctl-conf\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-dbus\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-system-cni-dir\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-run-multus-certs\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-socket-dir-parent\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-systemd\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-run\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901527 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-system-cni-dir\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-tuned\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901559 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-run-multus-certs\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901569 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-os-release\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-cni-binary-copy\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901639 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpbn\" (UniqueName: \"kubernetes.io/projected/a54b0936-585f-4e53-8676-22a998094566-kube-api-access-2hpbn\") pod \"node-resolver-c5lt8\" (UID: \"a54b0936-585f-4e53-8676-22a998094566\") " pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-cni-binary-copy\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d-konnectivity-ca\") pod \"konnectivity-agent-l5s88\" (UID: \"4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d\") " pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-modprobe-d\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-sysctl-d\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-cnibin\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901832 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-daemon-config\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a54b0936-585f-4e53-8676-22a998094566-hosts-file\") pod \"node-resolver-c5lt8\" (UID: \"a54b0936-585f-4e53-8676-22a998094566\") " pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:54.901899 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.901889 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:54.901962 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs podName:4e9a31a5-740a-49f7-a36a-e0fc8cc83df2 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:55.40194165 +0000 UTC m=+2.247565015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs") pod "network-metrics-daemon-fgd98" (UID: "4e9a31a5-740a-49f7-a36a-e0fc8cc83df2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.901992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhtcr\" (UniqueName: \"kubernetes.io/projected/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-kube-api-access-zhtcr\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c21f4720-1194-47ad-9668-8be83c1a675d-serviceca\") pod \"node-ca-l6bf9\" (UID: \"c21f4720-1194-47ad-9668-8be83c1a675d\") " pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-lib-modules\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-var-lib-kubelet\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-hostroot\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c21f4720-1194-47ad-9668-8be83c1a675d-host\") pod \"node-ca-l6bf9\" (UID: \"c21f4720-1194-47ad-9668-8be83c1a675d\") " pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d-agent-certs\") pod \"konnectivity-agent-l5s88\" (UID: \"4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d\") " pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902143 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-hostroot\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-system-cni-dir\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902184 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-cni-binary-copy\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2605218-19c6-4790-a5b6-86c9bc29e572-tmp\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c21f4720-1194-47ad-9668-8be83c1a675d-host\") pod \"node-ca-l6bf9\" (UID: \"c21f4720-1194-47ad-9668-8be83c1a675d\") " pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-kubelet-config\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902263 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-cnibin\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-etc-kubernetes\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.902806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902338 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-cnibin\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-run-k8s-cni-cncf-io\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zglpt\" (UniqueName: \"kubernetes.io/projected/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-kube-api-access-zglpt\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfkfw\" (UniqueName: \"kubernetes.io/projected/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-kube-api-access-wfkfw\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-host\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-etc-kubernetes\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zlhl\" (UniqueName: \"kubernetes.io/projected/c2605218-19c6-4790-a5b6-86c9bc29e572-kube-api-access-9zlhl\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902500 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d-konnectivity-ca\") pod \"konnectivity-agent-l5s88\" (UID: \"4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d\") " pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-run-k8s-cni-cncf-io\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c21f4720-1194-47ad-9668-8be83c1a675d-serviceca\") pod \"node-ca-l6bf9\" (UID: \"c21f4720-1194-47ad-9668-8be83c1a675d\") " pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-cni-dir\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-os-release\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-var-lib-cni-multus\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-conf-dir\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-kubernetes\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902736 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-cni-dir\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.903527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902737 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-multus-conf-dir\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.904063 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:54.904063 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902789 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54b0936-585f-4e53-8676-22a998094566-tmp-dir\") pod \"node-resolver-c5lt8\" (UID: \"a54b0936-585f-4e53-8676-22a998094566\") " pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:54.904063 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902789 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-os-release\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.904063 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gmxj\" (UniqueName: \"kubernetes.io/projected/c21f4720-1194-47ad-9668-8be83c1a675d-kube-api-access-9gmxj\") pod \"node-ca-l6bf9\" (UID: \"c21f4720-1194-47ad-9668-8be83c1a675d\") " pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.904063 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902856 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-host-var-lib-cni-multus\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.904063 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.902915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-sysconfig\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:54.904792 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.904763 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d-agent-certs\") pod \"konnectivity-agent-l5s88\" (UID: \"4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d\") " pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:18:54.912902 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.912883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gmxj\" (UniqueName: \"kubernetes.io/projected/c21f4720-1194-47ad-9668-8be83c1a675d-kube-api-access-9gmxj\") pod \"node-ca-l6bf9\" (UID: \"c21f4720-1194-47ad-9668-8be83c1a675d\") " pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:54.913264 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.913248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zglpt\" (UniqueName: \"kubernetes.io/projected/3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f-kube-api-access-zglpt\") pod \"multus-dp6f8\" (UID: \"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f\") " pod="openshift-multus/multus-dp6f8" Jul 13 20:18:54.914497 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.914476 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfkfw\" (UniqueName: \"kubernetes.io/projected/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-kube-api-access-wfkfw\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:54.945347 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.945271 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qzqfs" podStartSLOduration=-0.054740305 podStartE2EDuration="-54.740305ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:18:54.944805665 +0000 UTC m=+1.790429028" watchObservedRunningTime="2026-07-13 20:18:54.945259695 +0000 UTC m=+1.790883035" Jul 13 20:18:54.976711 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.976687 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" Jul 13 20:18:54.995043 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.995021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g8kd2" Jul 13 20:18:54.999856 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:54.999839 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:18:55.003878 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.003859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpbn\" (UniqueName: \"kubernetes.io/projected/a54b0936-585f-4e53-8676-22a998094566-kube-api-access-2hpbn\") pod \"node-resolver-c5lt8\" (UID: \"a54b0936-585f-4e53-8676-22a998094566\") " pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:55.003953 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.003908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-modprobe-d\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.003953 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.003934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-sysctl-d\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.003961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-cnibin\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.003986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a54b0936-585f-4e53-8676-22a998094566-hosts-file\") pod \"node-resolver-c5lt8\" (UID: \"a54b0936-585f-4e53-8676-22a998094566\") " pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-modprobe-d\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004054 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-cnibin\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhtcr\" (UniqueName: \"kubernetes.io/projected/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-kube-api-access-zhtcr\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004123 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-sysctl-d\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-lib-modules\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-var-lib-kubelet\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004146 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a54b0936-585f-4e53-8676-22a998094566-hosts-file\") pod \"node-resolver-c5lt8\" (UID: \"a54b0936-585f-4e53-8676-22a998094566\") " pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-system-cni-dir\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2605218-19c6-4790-a5b6-86c9bc29e572-tmp\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-system-cni-dir\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004250 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-var-lib-kubelet\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004261 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-lib-modules\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.004416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-kubelet-config\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-host\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlhl\" (UniqueName: \"kubernetes.io/projected/c2605218-19c6-4790-a5b6-86c9bc29e572-kube-api-access-9zlhl\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-kubernetes\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004395 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-kubelet-config\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004394 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54b0936-585f-4e53-8676-22a998094566-tmp-dir\") pod \"node-resolver-c5lt8\" (UID: \"a54b0936-585f-4e53-8676-22a998094566\") " pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-host\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-sysconfig\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004462 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-kubernetes\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-sys\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004539 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-sysconfig\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-sysctl-conf\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-dbus\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004584 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-sys\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.005318 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-systemd\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-run\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-tuned\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004628 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-systemd\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004673 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-dbus\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-os-release\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.004701 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004711 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-run\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-cni-binary-copy\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004659 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-sysctl-conf\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.004753 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret podName:14b26508-cc22-4bd4-98a4-420e57f61b7a nodeName:}" failed. No retries permitted until 2026-07-13 20:18:55.504736231 +0000 UTC m=+2.350359572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret") pod "global-pull-secret-syncer-qzqfs" (UID: "14b26508-cc22-4bd4-98a4-420e57f61b7a") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54b0936-585f-4e53-8676-22a998094566-tmp-dir\") pod \"node-resolver-c5lt8\" (UID: \"a54b0936-585f-4e53-8676-22a998094566\") " pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004812 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-os-release\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.004949 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.005269 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.006209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.005867 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-cni-binary-copy\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.006915 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.006603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2605218-19c6-4790-a5b6-86c9bc29e572-etc-tuned\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.007008 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.006991 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2605218-19c6-4790-a5b6-86c9bc29e572-tmp\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.013312 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.013285 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zlhl\" (UniqueName: \"kubernetes.io/projected/c2605218-19c6-4790-a5b6-86c9bc29e572-kube-api-access-9zlhl\") pod \"tuned-86tqx\" (UID: \"c2605218-19c6-4790-a5b6-86c9bc29e572\") " pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.013397 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.013325 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhtcr\" (UniqueName: \"kubernetes.io/projected/508218ce-1c54-42c4-ac46-0a2aaa2dfcd2-kube-api-access-zhtcr\") pod \"multus-additional-cni-plugins-f7hzx\" (UID: \"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2\") " pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.014398 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.014380 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpbn\" (UniqueName: \"kubernetes.io/projected/a54b0936-585f-4e53-8676-22a998094566-kube-api-access-2hpbn\") pod \"node-resolver-c5lt8\" (UID: \"a54b0936-585f-4e53-8676-22a998094566\") " pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:55.048413 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.048392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dp6f8" Jul 13 20:18:55.067480 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.067457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6bf9" Jul 13 20:18:55.073350 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.073335 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:18:55.147951 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.147927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5lt8" Jul 13 20:18:55.151776 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.151752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-86tqx" Jul 13 20:18:55.165581 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.165563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" Jul 13 20:18:55.294184 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.294159 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 20:18:55.308979 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.308953 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 20:18:55.345015 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.344990 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vw6b" Jul 13 20:18:55.352626 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.352600 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vw6b" Jul 13 20:18:55.407398 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.407354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:18:55.407557 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.407412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:55.407557 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.407517 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:18:55.407557 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.407541 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:18:55.407557 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.407546 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:18:55.407557 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.407555 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9nrg for pod openshift-network-diagnostics/network-check-target-b757q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:18:55.407812 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.407608 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg podName:369082c4-9db4-4aa2-9327-6f87a74fb81b nodeName:}" failed. No retries permitted until 2026-07-13 20:18:56.407594592 +0000 UTC m=+3.253217936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9nrg" (UniqueName: "kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg") pod "network-check-target-b757q" (UID: "369082c4-9db4-4aa2-9327-6f87a74fb81b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:18:55.407812 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.407625 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs podName:4e9a31a5-740a-49f7-a36a-e0fc8cc83df2 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:56.407618692 +0000 UTC m=+3.253242032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs") pod "network-metrics-daemon-fgd98" (UID: "4e9a31a5-740a-49f7-a36a-e0fc8cc83df2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:18:55.507841 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.507810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:55.508079 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.507927 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:18:55.508079 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:55.507985 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret podName:14b26508-cc22-4bd4-98a4-420e57f61b7a nodeName:}" failed. No retries permitted until 2026-07-13 20:18:56.507969326 +0000 UTC m=+3.353592667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret") pod "global-pull-secret-syncer-qzqfs" (UID: "14b26508-cc22-4bd4-98a4-420e57f61b7a") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:18:55.612923 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:55.612886 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37090a6d_df08_41c0_ac6e_070f33196246.slice/crio-94d79dcddef741347b3052c796c9bf9bb0df3dce8a9ad8f7d026e74bc2790c81 WatchSource:0}: Error finding container 94d79dcddef741347b3052c796c9bf9bb0df3dce8a9ad8f7d026e74bc2790c81: Status 404 returned error can't find the container with id 94d79dcddef741347b3052c796c9bf9bb0df3dce8a9ad8f7d026e74bc2790c81 Jul 13 20:18:55.614478 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:55.614453 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc79ec05_9471_4524_93d6_c2ebf0a37e87.slice/crio-3f5f1a84c644ffeea60883f671a43831acf42a742efe978520f73eb2b9d0fd4c WatchSource:0}: Error finding container 3f5f1a84c644ffeea60883f671a43831acf42a742efe978520f73eb2b9d0fd4c: Status 404 returned error can't find the container with id 3f5f1a84c644ffeea60883f671a43831acf42a742efe978520f73eb2b9d0fd4c Jul 13 20:18:55.614739 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:55.614717 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354b055a_f556_4dc1_9af0_073c9132ce64.slice/crio-40c98feb7fb627414c15bb76700d777550f33c54b3d8976cf944a5d608095104 WatchSource:0}: Error finding container 40c98feb7fb627414c15bb76700d777550f33c54b3d8976cf944a5d608095104: Status 404 returned error can't find the container with id 40c98feb7fb627414c15bb76700d777550f33c54b3d8976cf944a5d608095104 Jul 13 20:18:55.616102 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:55.616077 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58909a182794d524674b73ff7f57684.slice/crio-8d74031c6c93d3749cb96583347f41c7d72921e43f83789ae273906cc51331ac WatchSource:0}: Error finding container 8d74031c6c93d3749cb96583347f41c7d72921e43f83789ae273906cc51331ac: Status 404 returned error can't find the container with id 8d74031c6c93d3749cb96583347f41c7d72921e43f83789ae273906cc51331ac Jul 13 20:18:55.622821 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.622802 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 20:18:55.651368 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:55.651348 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccfa1f6_8e9b_4f05_9aec_e315c4acd31d.slice/crio-73a450939865e23d699c2a3bf5cbbc1f3aabfa3883a7c27d4aa2f845ca8ba296 WatchSource:0}: Error finding container 73a450939865e23d699c2a3bf5cbbc1f3aabfa3883a7c27d4aa2f845ca8ba296: Status 404 returned error can't find the container with id 73a450939865e23d699c2a3bf5cbbc1f3aabfa3883a7c27d4aa2f845ca8ba296 Jul 13 20:18:55.651972 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:55.651948 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce1c96c462bac221c22632c6690050c.slice/crio-85680c2052c7ef9c8f21bae83daa08f8a580e6f49ba84508461212e47256d1a2 WatchSource:0}: Error finding container 85680c2052c7ef9c8f21bae83daa08f8a580e6f49ba84508461212e47256d1a2: Status 404 returned error can't find the container with id 85680c2052c7ef9c8f21bae83daa08f8a580e6f49ba84508461212e47256d1a2 Jul 13 20:18:55.691726 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.691700 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:18:55.735249 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:55.735219 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2605218_19c6_4790_a5b6_86c9bc29e572.slice/crio-2d65552fc07eebe57871c24a063d6d157ea15d8f1676be40c0c259e55f6222fb WatchSource:0}: Error finding container 2d65552fc07eebe57871c24a063d6d157ea15d8f1676be40c0c259e55f6222fb: Status 404 returned error can't find the container with id 2d65552fc07eebe57871c24a063d6d157ea15d8f1676be40c0c259e55f6222fb Jul 13 20:18:55.767898 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:55.767871 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54b0936_585f_4e53_8676_22a998094566.slice/crio-311a6c6d6e24161478109e429e88d4201a0dcf59269aa69602e3dc4c0627ec25 WatchSource:0}: Error finding container 311a6c6d6e24161478109e429e88d4201a0dcf59269aa69602e3dc4c0627ec25: Status 404 returned error can't find the container with id 311a6c6d6e24161478109e429e88d4201a0dcf59269aa69602e3dc4c0627ec25 Jul 13 20:18:55.920711 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:55.920626 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:18:55.960045 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:55.960009 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21f4720_1194_47ad_9668_8be83c1a675d.slice/crio-558dbe146b213eed4ea12117cbe055459de9f1a6f5adebec68be7e62ea3516e2 WatchSource:0}: Error finding container 558dbe146b213eed4ea12117cbe055459de9f1a6f5adebec68be7e62ea3516e2: Status 404 returned error can't find the container with id 558dbe146b213eed4ea12117cbe055459de9f1a6f5adebec68be7e62ea3516e2 Jul 13 20:18:56.045192 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:56.045157 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2c18f2_0cfb_404e_8e5d_9b3e6b200f0f.slice/crio-9b0cfafa93afd3ab2a0f0d67833e1a17f2202445feccbc5b9d695cc8e8c74c70 WatchSource:0}: Error finding container 9b0cfafa93afd3ab2a0f0d67833e1a17f2202445feccbc5b9d695cc8e8c74c70: Status 404 returned error can't find the container with id 9b0cfafa93afd3ab2a0f0d67833e1a17f2202445feccbc5b9d695cc8e8c74c70 Jul 13 20:18:56.355533 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.355433 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 20:13:55 +0000 UTC" deadline="2028-04-10 09:43:46.32329853 +0000 UTC" Jul 13 20:18:56.355533 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.355480 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15277h24m49.96782345s" Jul 13 20:18:56.417587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.417489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:18:56.417587 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.417542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:56.417825 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.417669 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:18:56.417825 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.417733 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs podName:4e9a31a5-740a-49f7-a36a-e0fc8cc83df2 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:58.417714175 +0000 UTC m=+5.263337518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs") pod "network-metrics-daemon-fgd98" (UID: "4e9a31a5-740a-49f7-a36a-e0fc8cc83df2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:18:56.417825 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.417824 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:18:56.417998 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.417843 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:18:56.417998 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.417856 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9nrg for pod openshift-network-diagnostics/network-check-target-b757q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:18:56.417998 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.417896 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg podName:369082c4-9db4-4aa2-9327-6f87a74fb81b nodeName:}" failed. No retries permitted until 2026-07-13 20:18:58.417883225 +0000 UTC m=+5.263506585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9nrg" (UniqueName: "kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg") pod "network-check-target-b757q" (UID: "369082c4-9db4-4aa2-9327-6f87a74fb81b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:18:56.440303 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.440225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:18:56.440467 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.440355 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:18:56.440467 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.440405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:56.440586 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.440495 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:18:56.463466 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.463404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dp6f8" event={"ID":"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f","Type":"ContainerStarted","Data":"9b0cfafa93afd3ab2a0f0d67833e1a17f2202445feccbc5b9d695cc8e8c74c70"} Jul 13 20:18:56.473950 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.473908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l5s88" event={"ID":"4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d","Type":"ContainerStarted","Data":"73a450939865e23d699c2a3bf5cbbc1f3aabfa3883a7c27d4aa2f845ca8ba296"} Jul 13 20:18:56.479944 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.479869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" event={"ID":"f58909a182794d524674b73ff7f57684","Type":"ContainerStarted","Data":"8d74031c6c93d3749cb96583347f41c7d72921e43f83789ae273906cc51331ac"} Jul 13 20:18:56.495778 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.495727 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6bf9" event={"ID":"c21f4720-1194-47ad-9668-8be83c1a675d","Type":"ContainerStarted","Data":"558dbe146b213eed4ea12117cbe055459de9f1a6f5adebec68be7e62ea3516e2"} Jul 13 20:18:56.501188 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.500901 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5lt8" event={"ID":"a54b0936-585f-4e53-8676-22a998094566","Type":"ContainerStarted","Data":"311a6c6d6e24161478109e429e88d4201a0dcf59269aa69602e3dc4c0627ec25"} Jul 13 20:18:56.519095 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.518359 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-kubelet-config\") pod \"14b26508-cc22-4bd4-98a4-420e57f61b7a\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " Jul 13 20:18:56.519095 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.518405 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-dbus\") pod \"14b26508-cc22-4bd4-98a4-420e57f61b7a\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " Jul 13 20:18:56.519095 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.518632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:56.519095 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.518759 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:18:56.519095 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:56.518820 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret podName:14b26508-cc22-4bd4-98a4-420e57f61b7a nodeName:}" failed. No retries permitted until 2026-07-13 20:18:58.518800906 +0000 UTC m=+5.364424261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret") pod "global-pull-secret-syncer-qzqfs" (UID: "14b26508-cc22-4bd4-98a4-420e57f61b7a") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:18:56.519095 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.518866 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-kubelet-config" (OuterVolumeSpecName: "kubelet-config") pod "14b26508-cc22-4bd4-98a4-420e57f61b7a" (UID: "14b26508-cc22-4bd4-98a4-420e57f61b7a"). InnerVolumeSpecName "kubelet-config". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 13 20:18:56.519095 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.518924 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-dbus" (OuterVolumeSpecName: "dbus") pod "14b26508-cc22-4bd4-98a4-420e57f61b7a" (UID: "14b26508-cc22-4bd4-98a4-420e57f61b7a"). InnerVolumeSpecName "dbus". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jul 13 20:18:56.519995 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.519896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-86tqx" event={"ID":"c2605218-19c6-4790-a5b6-86c9bc29e572","Type":"ContainerStarted","Data":"2d65552fc07eebe57871c24a063d6d157ea15d8f1676be40c0c259e55f6222fb"} Jul 13 20:18:56.522406 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.522353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" event={"ID":"9ce1c96c462bac221c22632c6690050c","Type":"ContainerStarted","Data":"85680c2052c7ef9c8f21bae83daa08f8a580e6f49ba84508461212e47256d1a2"} Jul 13 20:18:56.525056 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.524975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g8kd2" event={"ID":"bc79ec05-9471-4524-93d6-c2ebf0a37e87","Type":"ContainerStarted","Data":"3f5f1a84c644ffeea60883f671a43831acf42a742efe978520f73eb2b9d0fd4c"} Jul 13 20:18:56.541373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.541346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerStarted","Data":"40c98feb7fb627414c15bb76700d777550f33c54b3d8976cf944a5d608095104"} Jul 13 20:18:56.551179 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.551133 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" event={"ID":"37090a6d-df08-41c0-ac6e-070f33196246","Type":"ContainerStarted","Data":"94d79dcddef741347b3052c796c9bf9bb0df3dce8a9ad8f7d026e74bc2790c81"} Jul 13 20:18:56.619884 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.619805 2579 reconciler_common.go:299] "Volume detached for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-kubelet-config\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:18:56.619884 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.619841 2579 reconciler_common.go:299] "Volume detached for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14b26508-cc22-4bd4-98a4-420e57f61b7a-dbus\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:18:56.752242 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:18:56.752207 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508218ce_1c54_42c4_ac46_0a2aaa2dfcd2.slice/crio-f3a71ff5dd93b11f7089b5672b2e7996f643151b834ad6a50af5438bdcfe5968 WatchSource:0}: Error finding container f3a71ff5dd93b11f7089b5672b2e7996f643151b834ad6a50af5438bdcfe5968: Status 404 returned error can't find the container with id f3a71ff5dd93b11f7089b5672b2e7996f643151b834ad6a50af5438bdcfe5968 Jul 13 20:18:56.809954 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:56.809922 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 20:18:57.356209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:57.356115 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 20:13:55 +0000 UTC" deadline="2028-03-03 11:10:05.387618562 +0000 UTC" Jul 13 20:18:57.356209 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:57.356155 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14366h51m8.031468285s" Jul 13 20:18:57.572959 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:57.572868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" event={"ID":"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2","Type":"ContainerStarted","Data":"f3a71ff5dd93b11f7089b5672b2e7996f643151b834ad6a50af5438bdcfe5968"} Jul 13 20:18:58.437445 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:58.437411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:58.437890 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:58.437508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:18:58.437890 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.437640 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:18:58.437890 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.437656 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:18:58.437890 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.437669 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9nrg for pod openshift-network-diagnostics/network-check-target-b757q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:18:58.437890 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.437722 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg podName:369082c4-9db4-4aa2-9327-6f87a74fb81b nodeName:}" failed. No retries permitted until 2026-07-13 20:19:02.437705151 +0000 UTC m=+9.283328492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9nrg" (UniqueName: "kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg") pod "network-check-target-b757q" (UID: "369082c4-9db4-4aa2-9327-6f87a74fb81b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:18:58.437890 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.437799 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:18:58.437890 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.437833 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs podName:4e9a31a5-740a-49f7-a36a-e0fc8cc83df2 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:02.437821858 +0000 UTC m=+9.283445220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs") pod "network-metrics-daemon-fgd98" (UID: "4e9a31a5-740a-49f7-a36a-e0fc8cc83df2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:18:58.441483 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:58.441267 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:18:58.441483 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.441371 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:18:58.441483 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:58.441425 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:18:58.441776 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.441514 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:18:58.538412 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:18:58.538162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:18:58.538412 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.538323 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:18:58.538412 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:18:58.538380 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret podName:14b26508-cc22-4bd4-98a4-420e57f61b7a nodeName:}" failed. No retries permitted until 2026-07-13 20:19:02.538361484 +0000 UTC m=+9.383984844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret") pod "global-pull-secret-syncer-qzqfs" (UID: "14b26508-cc22-4bd4-98a4-420e57f61b7a") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:00.440218 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:00.440163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:00.440717 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:00.440280 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:00.440832 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:00.440767 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:00.440906 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:00.440871 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:02.440580 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:02.440120 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:02.440580 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:02.440141 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:02.440580 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.440256 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:02.440580 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.440341 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:02.470739 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:02.470705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:02.470912 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:02.470753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:02.470912 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.470844 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:02.470912 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.470908 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs podName:4e9a31a5-740a-49f7-a36a-e0fc8cc83df2 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:10.470889205 +0000 UTC m=+17.316512564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs") pod "network-metrics-daemon-fgd98" (UID: "4e9a31a5-740a-49f7-a36a-e0fc8cc83df2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:02.471138 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.470846 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:02.471138 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.470954 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:02.471138 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.470974 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9nrg for pod openshift-network-diagnostics/network-check-target-b757q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:02.471138 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.471032 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg podName:369082c4-9db4-4aa2-9327-6f87a74fb81b nodeName:}" failed. No retries permitted until 2026-07-13 20:19:10.471020103 +0000 UTC m=+17.316643457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9nrg" (UniqueName: "kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg") pod "network-check-target-b757q" (UID: "369082c4-9db4-4aa2-9327-6f87a74fb81b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:02.571446 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:02.571411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret\") pod \"global-pull-secret-syncer-qzqfs\" (UID: \"14b26508-cc22-4bd4-98a4-420e57f61b7a\") " pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:19:02.571654 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.571580 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:02.571654 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:02.571628 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret podName:14b26508-cc22-4bd4-98a4-420e57f61b7a nodeName:}" failed. No retries permitted until 2026-07-13 20:19:10.571614531 +0000 UTC m=+17.417237871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret") pod "global-pull-secret-syncer-qzqfs" (UID: "14b26508-cc22-4bd4-98a4-420e57f61b7a") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:04.441552 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.440960 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:04.441552 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:04.441077 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:04.441552 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.441408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:04.441552 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:04.441501 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:04.462112 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.461640 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kube-system/global-pull-secret-syncer-qzqfs"] Jul 13 20:19:04.462112 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.461732 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:19:04.466310 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.466262 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kube-system/global-pull-secret-syncer-qzqfs"] Jul 13 20:19:04.467531 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:04.467472 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"14b26508-cc22-4bd4-98a4-420e57f61b7a\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-13T20:19:04Z\\\",\\\"observedGeneration\\\":2,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-13T20:19:04Z\\\",\\\"observedGeneration\\\":2,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-13T20:19:04Z\\\",\\\"observedGeneration\\\":2,\\\"reason\\\":\\\"PodFailed\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-13T20:19:04Z\\\",\\\"observedGeneration\\\":2,\\\"reason\\\":\\\"PodFailed\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-13T20:19:04Z\\\",\\\"observedGeneration\\\":2,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f9e719bb83e4c1c822400d7684dc72732516d3564628cdb86c3940e5db30fb54\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"global-pull-secret-syncer\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"kubelet-config\\\"},{\\\"mountPath\\\":\\\"/var/run/dbus\\\",\\\"name\\\":\\\"dbus\\\"},{\\\"mountPath\\\":\\\"/etc/original-pull-secret\\\",\\\"name\\\":\\\"original-pull-secret\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.136.103\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.136.103\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kube-system\"/\"global-pull-secret-syncer-qzqfs\": pods \"global-pull-secret-syncer-qzqfs\" not found" pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:19:04.468928 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:04.468897 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-qzqfs\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" podUID="14b26508-cc22-4bd4-98a4-420e57f61b7a" pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:19:04.495323 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.495302 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4b8vd"] Jul 13 20:19:04.498593 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.498283 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:04.498593 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:04.498348 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:04.500172 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:04.499983 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-qzqfs\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" podUID="14b26508-cc22-4bd4-98a4-420e57f61b7a" pod="kube-system/global-pull-secret-syncer-qzqfs" Jul 13 20:19:04.586314 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.586281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/843d1046-24bb-4afa-a9d6-04b55ff30163-kubelet-config\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:04.586482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.586332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/843d1046-24bb-4afa-a9d6-04b55ff30163-dbus\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:04.586482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.586382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:04.586482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.586418 2579 reconciler_common.go:299] "Volume detached for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b26508-cc22-4bd4-98a4-420e57f61b7a-original-pull-secret\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:19:04.686869 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.686815 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/843d1046-24bb-4afa-a9d6-04b55ff30163-dbus\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:04.687098 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.686876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:04.687098 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.686946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/843d1046-24bb-4afa-a9d6-04b55ff30163-kubelet-config\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:04.687098 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.687067 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/843d1046-24bb-4afa-a9d6-04b55ff30163-dbus\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:04.687098 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:04.687089 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:04.687327 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:04.687051 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/843d1046-24bb-4afa-a9d6-04b55ff30163-kubelet-config\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:04.687327 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:04.687170 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret podName:843d1046-24bb-4afa-a9d6-04b55ff30163 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:05.187147981 +0000 UTC m=+12.032771321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret") pod "global-pull-secret-syncer-4b8vd" (UID: "843d1046-24bb-4afa-a9d6-04b55ff30163") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:05.192037 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:05.192000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:05.192235 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:05.192174 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:05.192305 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:05.192260 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret podName:843d1046-24bb-4afa-a9d6-04b55ff30163 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:06.192237979 +0000 UTC m=+13.037861319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret") pod "global-pull-secret-syncer-4b8vd" (UID: "843d1046-24bb-4afa-a9d6-04b55ff30163") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:06.198370 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:06.198335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:06.198769 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:06.198459 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:06.198769 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:06.198516 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret podName:843d1046-24bb-4afa-a9d6-04b55ff30163 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:08.198502137 +0000 UTC m=+15.044125481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret") pod "global-pull-secret-syncer-4b8vd" (UID: "843d1046-24bb-4afa-a9d6-04b55ff30163") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:06.439641 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:06.439606 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:06.439809 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:06.439645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:06.439809 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:06.439646 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:06.439809 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:06.439725 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:06.439943 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:06.439859 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:06.439985 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:06.439957 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:08.212384 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:08.212355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:08.212856 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:08.212502 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:08.212856 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:08.212560 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret podName:843d1046-24bb-4afa-a9d6-04b55ff30163 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:12.212542467 +0000 UTC m=+19.058165826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret") pod "global-pull-secret-syncer-4b8vd" (UID: "843d1046-24bb-4afa-a9d6-04b55ff30163") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:08.440154 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:08.440117 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:08.440154 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:08.440158 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:08.440391 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:08.440125 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:08.440391 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:08.440254 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:08.440391 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:08.440329 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:08.440527 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:08.440415 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:10.439309 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:10.439276 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:10.439760 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:10.439276 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:10.439760 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:10.439393 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:10.439760 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:10.439418 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:10.439760 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:10.439501 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:10.439760 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:10.439599 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:10.530550 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:10.530519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:10.530726 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:10.530665 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:10.530726 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:10.530686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:10.530726 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:10.530724 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs podName:4e9a31a5-740a-49f7-a36a-e0fc8cc83df2 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:26.53070565 +0000 UTC m=+33.376329003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs") pod "network-metrics-daemon-fgd98" (UID: "4e9a31a5-740a-49f7-a36a-e0fc8cc83df2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:10.530925 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:10.530792 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:10.530925 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:10.530813 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:10.530925 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:10.530823 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9nrg for pod openshift-network-diagnostics/network-check-target-b757q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:10.530925 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:10.530866 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg podName:369082c4-9db4-4aa2-9327-6f87a74fb81b nodeName:}" failed. No retries permitted until 2026-07-13 20:19:26.530855578 +0000 UTC m=+33.376478929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9nrg" (UniqueName: "kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg") pod "network-check-target-b757q" (UID: "369082c4-9db4-4aa2-9327-6f87a74fb81b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:12.241245 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:12.241215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:12.241722 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:12.241360 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:12.241722 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:12.241430 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret podName:843d1046-24bb-4afa-a9d6-04b55ff30163 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:20.241410655 +0000 UTC m=+27.087034018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret") pod "global-pull-secret-syncer-4b8vd" (UID: "843d1046-24bb-4afa-a9d6-04b55ff30163") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:12.442551 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:12.442520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:12.442551 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:12.442544 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:12.442769 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:12.442520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:12.442769 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:12.442635 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:12.442769 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:12.442697 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:12.442888 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:12.442790 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:14.440703 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:14.440669 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:14.441152 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:14.440771 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:14.441152 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:14.440886 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:14.441152 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:14.440766 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:14.441152 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:14.440953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:14.441152 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:14.441019 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:16.440067 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.439838 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:16.440404 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.439838 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:16.440404 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:16.440166 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:16.440404 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:16.440279 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:16.440404 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.439903 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:16.440404 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:16.440359 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:16.614857 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.614763 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:19:16.615199 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.615181 2579 generic.go:356] "Generic (PLEG): container finished" podID="354b055a-f556-4dc1-9af0-073c9132ce64" containerID="28be7d5d963ef2ddc0136d58e444cdab419931db056d2c5d49bcb3f1d3826898" exitCode=1 Jul 13 20:19:16.615267 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.615251 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerStarted","Data":"939e30a95bb429e99922431b20a991e020a1d1662f566f4fb39e96db9afa4a28"} Jul 13 20:19:16.615330 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.615318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerStarted","Data":"7e1c1338f6f0b8d802e9c39e24f97a3c2322d54ef3946257cfdac5efc2f408cd"} Jul 13 20:19:16.615372 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.615366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerStarted","Data":"03c694c996908c32be556a6f0c6b073ee510283fdfb49b6c173564a0239d40c7"} Jul 13 20:19:16.615412 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.615397 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerStarted","Data":"deb755e4078357c8f2920bbacd35ece80a451555209ee1bc56e4d5318c59f255"} Jul 13 20:19:16.615459 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.615423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerDied","Data":"28be7d5d963ef2ddc0136d58e444cdab419931db056d2c5d49bcb3f1d3826898"} Jul 13 20:19:16.615503 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.615461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerStarted","Data":"075dcbe72e8780cd09ea3490404cff78b7d5277736fa6c414e5184dadad0cb83"} Jul 13 20:19:16.616574 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.616557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dp6f8" event={"ID":"3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f","Type":"ContainerStarted","Data":"bf16c20ffd14b334dfecb3155b8fb4bcb37dd75620fe66b457908582cd05b601"} Jul 13 20:19:16.618267 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.618233 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-86tqx" event={"ID":"c2605218-19c6-4790-a5b6-86c9bc29e572","Type":"ContainerStarted","Data":"878cf10f32ba430278bc8243642925de1412477bbbfb6dfc0efb922cf8369b3e"} Jul 13 20:19:16.624024 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.623962 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" event={"ID":"9ce1c96c462bac221c22632c6690050c","Type":"ContainerStarted","Data":"486165815a54df557867f0337add536af2817d327c0d20b1baea0fa4e6416100"} Jul 13 20:19:16.643570 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.642239 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dp6f8" podStartSLOduration=2.637860901 podStartE2EDuration="22.642223472s" totalImagesPullingTime="20.004362571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:16.641448375 +0000 UTC m=+23.487071729" watchObservedRunningTime="2026-07-13 20:19:16.642223472 +0000 UTC m=+23.487846835" Jul 13 20:19:16.689968 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.689924 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-86tqx" podStartSLOduration=1.832516636 podStartE2EDuration="21.689909556s" totalImagesPullingTime="19.85739292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:16.689772232 +0000 UTC m=+23.535395594" watchObservedRunningTime="2026-07-13 20:19:16.689909556 +0000 UTC m=+23.535532915" Jul 13 20:19:16.690226 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:16.690194 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-103.ec2.internal" podStartSLOduration=22.690187729 podStartE2EDuration="22.690187729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:16.663041041 +0000 UTC m=+23.508664429" watchObservedRunningTime="2026-07-13 20:19:16.690187729 +0000 UTC m=+23.535811083" Jul 13 20:19:17.627273 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.627242 2579 generic.go:356] "Generic (PLEG): container finished" podID="508218ce-1c54-42c4-ac46-0a2aaa2dfcd2" containerID="c5cb1b7996bdb89e097710d047c0aa83afe945dd8c5f31cc09cf8bccc044c1ca" exitCode=0 Jul 13 20:19:17.628187 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.627277 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" event={"ID":"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2","Type":"ContainerDied","Data":"c5cb1b7996bdb89e097710d047c0aa83afe945dd8c5f31cc09cf8bccc044c1ca"} Jul 13 20:19:17.628752 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.628721 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6bf9" event={"ID":"c21f4720-1194-47ad-9668-8be83c1a675d","Type":"ContainerStarted","Data":"12b45b54d4c5013dce031edf3b016ba91fa10833c8349dc3280fb7adcad878f5"} Jul 13 20:19:17.630095 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.630076 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5lt8" event={"ID":"a54b0936-585f-4e53-8676-22a998094566","Type":"ContainerStarted","Data":"120edcd18315dd152ddf7bf03a699e17fd35173e8a9ca40b66dac4ed0ba9755d"} Jul 13 20:19:17.631436 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.631415 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g8kd2" event={"ID":"bc79ec05-9471-4524-93d6-c2ebf0a37e87","Type":"ContainerStarted","Data":"14c6b43986638af30745aaa2afe30e195c6609783ac71ccbd24dfc6fa50e2657"} Jul 13 20:19:17.632771 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.632752 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" event={"ID":"37090a6d-df08-41c0-ac6e-070f33196246","Type":"ContainerStarted","Data":"042d95500386d90ff4f3217855eb7274b2b2d29ae8772a0993ff2f08283a29ca"} Jul 13 20:19:17.634100 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.634082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l5s88" event={"ID":"4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d","Type":"ContainerStarted","Data":"5957af23d6bbdc08076dec6b2e1c1df532a937d2b9b4126abe56a13c51a902c5"} Jul 13 20:19:17.635402 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.635384 2579 generic.go:356] "Generic (PLEG): container finished" podID="f58909a182794d524674b73ff7f57684" containerID="d30fc8992d062ba88a6404d8a3ad27481cf2e2091fa9bd27c6ccfed0fc45660e" exitCode=0 Jul 13 20:19:17.635495 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.635478 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" event={"ID":"f58909a182794d524674b73ff7f57684","Type":"ContainerDied","Data":"d30fc8992d062ba88a6404d8a3ad27481cf2e2091fa9bd27c6ccfed0fc45660e"} Jul 13 20:19:17.694238 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.694050 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l5s88" podStartSLOduration=3.754432227 podStartE2EDuration="23.694037198s" totalImagesPullingTime="19.939604971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:17.693938818 +0000 UTC m=+24.539562178" watchObservedRunningTime="2026-07-13 20:19:17.694037198 +0000 UTC m=+24.539660558" Jul 13 20:19:17.712647 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.712614 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c5lt8" podStartSLOduration=2.890006234 podStartE2EDuration="22.712600437s" totalImagesPullingTime="19.822594203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:17.712242212 +0000 UTC m=+24.557865567" watchObservedRunningTime="2026-07-13 20:19:17.712600437 +0000 UTC m=+24.558223796" Jul 13 20:19:17.753162 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.753128 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g8kd2" podStartSLOduration=3.784139376 podStartE2EDuration="23.753115251s" totalImagesPullingTime="19.968975875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:17.752875551 +0000 UTC m=+24.598498910" watchObservedRunningTime="2026-07-13 20:19:17.753115251 +0000 UTC m=+24.598738625" Jul 13 20:19:17.753682 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:17.753658 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l6bf9" podStartSLOduration=4.122883738 podStartE2EDuration="23.753648701s" totalImagesPullingTime="19.630764963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:17.727112567 +0000 UTC m=+24.572735925" watchObservedRunningTime="2026-07-13 20:19:17.753648701 +0000 UTC m=+24.599272060" Jul 13 20:19:18.439497 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:18.439471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:18.439497 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:18.439485 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:18.439932 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:18.439574 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:18.439932 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:18.439643 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:18.439932 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:18.439669 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:18.439932 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:18.439751 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:18.640490 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:18.640078 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" event={"ID":"f58909a182794d524674b73ff7f57684","Type":"ContainerStarted","Data":"16bfeea472f5855ff91d6f93462810532485040116a4ea8cc49cac3cb4a7da3a"} Jul 13 20:19:18.656697 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:18.656646 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-103.ec2.internal" podStartSLOduration=24.656626418 podStartE2EDuration="24.656626418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:18.656380428 +0000 UTC m=+25.502003792" watchObservedRunningTime="2026-07-13 20:19:18.656626418 +0000 UTC m=+25.502249782" Jul 13 20:19:19.123729 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:19.123704 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 20:19:19.365933 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:19.365804 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T20:19:19.123726329Z","UUID":"621167b3-88f9-4857-9320-8367a8fd0785","Handler":null,"Name":"","Endpoint":""} Jul 13 20:19:19.368621 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:19.368597 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 20:19:19.368734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:19.368639 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 20:19:19.645987 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:19.645920 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:19:19.646522 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:19.646353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerStarted","Data":"1cf0abdaf0f33be42d41f919f235afecfdb2681507049bd39950bb9c12633169"} Jul 13 20:19:19.648602 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:19.648542 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" event={"ID":"37090a6d-df08-41c0-ac6e-070f33196246","Type":"ContainerStarted","Data":"731cfae4d6cdfb84e885c0bcbb17b2c7acb2f26d4cdcfd43bfbb29d70b9dab65"} Jul 13 20:19:20.309080 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:20.309032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:20.309185 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:20.309167 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:20.309245 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:20.309233 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret podName:843d1046-24bb-4afa-a9d6-04b55ff30163 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:36.309214934 +0000 UTC m=+43.154838281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret") pod "global-pull-secret-syncer-4b8vd" (UID: "843d1046-24bb-4afa-a9d6-04b55ff30163") : object "kube-system"/"original-pull-secret" not registered Jul 13 20:19:20.439361 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:20.439329 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:20.439511 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:20.439338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:20.439511 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:20.439453 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:20.439511 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:20.439338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:20.439667 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:20.439520 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:20.439667 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:20.439594 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:20.652734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:20.652701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" event={"ID":"37090a6d-df08-41c0-ac6e-070f33196246","Type":"ContainerStarted","Data":"8d82ee7f5e0b59c188b2a645316e1a1e7896707beefcdf8eb5368a043307c98a"} Jul 13 20:19:22.439726 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.439548 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:22.440491 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.439548 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:22.440491 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:22.439819 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:22.440491 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.439560 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:22.440491 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:22.439887 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:22.440491 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:22.440009 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:22.487031 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.487011 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:19:22.487765 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.487746 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:19:22.502804 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.502768 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txmhp" podStartSLOduration=5.175148318 podStartE2EDuration="28.502756578s" totalImagesPullingTime="23.32760826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:20.679511994 +0000 UTC m=+27.525135348" watchObservedRunningTime="2026-07-13 20:19:22.502756578 +0000 UTC m=+29.348380005" Jul 13 20:19:22.659031 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.658948 2579 generic.go:356] "Generic (PLEG): container finished" podID="508218ce-1c54-42c4-ac46-0a2aaa2dfcd2" containerID="9a28d9f42cc881d26734d7ba70ca3b8e60700b4117966b0fdc0dd8a3373d9eb8" exitCode=0 Jul 13 20:19:22.659146 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.659039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" event={"ID":"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2","Type":"ContainerDied","Data":"9a28d9f42cc881d26734d7ba70ca3b8e60700b4117966b0fdc0dd8a3373d9eb8"} Jul 13 20:19:22.662484 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.662470 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:19:22.662828 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.662806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerStarted","Data":"9599a3dc1ff2d0e291991fe35fd9bbac038eff21b3e177e340497cf2fed94697"} Jul 13 20:19:22.663144 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.663084 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:19:22.663239 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.663155 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:19:22.663239 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.663177 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:19:22.663239 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.663228 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:19:22.663365 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.663267 2579 scope.go:117] "RemoveContainer" containerID="28be7d5d963ef2ddc0136d58e444cdab419931db056d2c5d49bcb3f1d3826898" Jul 13 20:19:22.664198 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.663742 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l5s88" Jul 13 20:19:22.678292 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.678273 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:19:22.678420 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:22.678408 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:19:23.668566 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:23.668352 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:19:23.669506 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:23.669478 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" event={"ID":"354b055a-f556-4dc1-9af0-073c9132ce64","Type":"ContainerStarted","Data":"fca155e074e85a6679e0fb2b7cfec62561818c0577519bd063e38442fac718b4"} Jul 13 20:19:24.097550 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:24.097500 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" podStartSLOduration=9.827427936 podStartE2EDuration="30.097483144s" totalImagesPullingTime="20.270055208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:23.703194587 +0000 UTC m=+30.548817949" watchObservedRunningTime="2026-07-13 20:19:24.097483144 +0000 UTC m=+30.943106503" Jul 13 20:19:24.098068 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:24.098041 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4b8vd"] Jul 13 20:19:24.098160 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:24.098149 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:24.098247 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:24.098232 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:24.102148 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:24.102123 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fgd98"] Jul 13 20:19:24.102282 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:24.102240 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:24.102371 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:24.102348 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:24.102648 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:24.102630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b757q"] Jul 13 20:19:24.102717 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:24.102709 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:24.102798 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:24.102782 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:24.672300 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:24.672271 2579 generic.go:356] "Generic (PLEG): container finished" podID="508218ce-1c54-42c4-ac46-0a2aaa2dfcd2" containerID="4b99896ee8e4ba23d55c59f192fd49611a1baefd2e29adf0f25bc8d50bf34c13" exitCode=0 Jul 13 20:19:24.672625 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:24.672353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" event={"ID":"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2","Type":"ContainerDied","Data":"4b99896ee8e4ba23d55c59f192fd49611a1baefd2e29adf0f25bc8d50bf34c13"} Jul 13 20:19:25.439460 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:25.439394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:25.439593 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:25.439394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:25.439593 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:25.439483 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:25.439593 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:25.439557 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:26.439802 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:26.439731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:26.440236 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:26.439862 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:26.553692 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:26.553668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:26.553796 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:26.553703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:26.553796 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:26.553785 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:26.553863 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:26.553801 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 20:19:26.553863 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:26.553817 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 20:19:26.553863 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:26.553826 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9nrg for pod openshift-network-diagnostics/network-check-target-b757q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:26.553863 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:26.553826 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs podName:4e9a31a5-740a-49f7-a36a-e0fc8cc83df2 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:58.553814602 +0000 UTC m=+65.399437940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs") pod "network-metrics-daemon-fgd98" (UID: "4e9a31a5-740a-49f7-a36a-e0fc8cc83df2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 20:19:26.553974 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:26.553868 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg podName:369082c4-9db4-4aa2-9327-6f87a74fb81b nodeName:}" failed. No retries permitted until 2026-07-13 20:19:58.553856402 +0000 UTC m=+65.399479741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9nrg" (UniqueName: "kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg") pod "network-check-target-b757q" (UID: "369082c4-9db4-4aa2-9327-6f87a74fb81b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 20:19:26.679407 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:26.679379 2579 generic.go:356] "Generic (PLEG): container finished" podID="508218ce-1c54-42c4-ac46-0a2aaa2dfcd2" containerID="a6ec61d760e84484295b7de7ba1da176d6efef30049091c16151504a0c80da9d" exitCode=0 Jul 13 20:19:26.679519 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:26.679412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" event={"ID":"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2","Type":"ContainerDied","Data":"a6ec61d760e84484295b7de7ba1da176d6efef30049091c16151504a0c80da9d"} Jul 13 20:19:27.439313 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:27.439273 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:27.439445 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:27.439419 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4b8vd" podUID="843d1046-24bb-4afa-a9d6-04b55ff30163" Jul 13 20:19:27.439524 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:27.439477 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:27.439591 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:27.439568 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b757q" podUID="369082c4-9db4-4aa2-9327-6f87a74fb81b" Jul 13 20:19:28.439453 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:28.439259 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:28.439930 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:28.439558 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgd98" podUID="4e9a31a5-740a-49f7-a36a-e0fc8cc83df2" Jul 13 20:19:28.975343 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:28.975316 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-103.ec2.internal" event="NodeReady" Jul 13 20:19:28.975518 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:28.975448 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 20:19:29.052007 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.051981 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c87cb8479-5vqw8"] Jul 13 20:19:29.055583 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.055554 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f"] Jul 13 20:19:29.056138 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.056016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.059400 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.059383 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn"] Jul 13 20:19:29.059523 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.059503 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:29.063212 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.063195 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp"] Jul 13 20:19:29.063412 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.063394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:29.064283 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.064106 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 20:19:29.064283 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.064175 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 20:19:29.064283 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.064113 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 20:19:29.064693 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.064681 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cj8kp\"" Jul 13 20:19:29.066837 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.066817 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7566899d6d-mtpt5"] Jul 13 20:19:29.066935 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.066899 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 13 20:19:29.067018 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.066940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.067309 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.067149 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-operator-config\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" Jul 13 20:19:29.067407 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.067328 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 13 20:19:29.067407 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.067339 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" Jul 13 20:19:29.067833 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.067694 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 13 20:19:29.067833 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.067703 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" Jul 13 20:19:29.067833 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.067731 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-operator-dockercfg-sgmb9\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sgmb9\"" type="*v1.Secret" Jul 13 20:19:29.067833 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.067741 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"config\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" Jul 13 20:19:29.067833 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.067806 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-operator-dockercfg-ww98c\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ww98c\"" type="*v1.Secret" Jul 13 20:19:29.068295 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.068267 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-103.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-136-103.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 13 20:19:29.069782 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.069766 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 13 20:19:29.070155 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.070032 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 13 20:19:29.070155 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.070134 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 20:19:29.070294 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.070216 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 20:19:29.070402 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.070384 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6srxk\"" Jul 13 20:19:29.070556 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.070540 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.074770 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.073757 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 13 20:19:29.074770 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.073927 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 20:19:29.075303 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.075130 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 13 20:19:29.075303 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.075220 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 20:19:29.076099 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.075502 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 13 20:19:29.076595 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.076576 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 13 20:19:29.076694 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.076606 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 20:19:29.076739 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.076704 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r4vm2\"" Jul 13 20:19:29.081707 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.081687 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp"] Jul 13 20:19:29.082476 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.082455 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7566899d6d-mtpt5"] Jul 13 20:19:29.089601 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.089581 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn"] Jul 13 20:19:29.095386 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.095343 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c87cb8479-5vqw8"] Jul 13 20:19:29.099820 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.099798 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xt9sl"] Jul 13 20:19:29.103210 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.103193 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.105829 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.105809 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 20:19:29.105922 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.105867 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26pr8\"" Jul 13 20:19:29.106312 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.106295 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 20:19:29.113167 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.112992 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-w9wm9"] Jul 13 20:19:29.116296 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.116276 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv"] Jul 13 20:19:29.116425 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.116406 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.118695 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.118668 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kcrl5\"" Jul 13 20:19:29.118784 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.118734 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 20:19:29.118839 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.118781 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 13 20:19:29.119000 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.118912 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 20:19:29.119194 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.119177 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 13 20:19:29.119829 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.119810 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb"] Jul 13 20:19:29.119905 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.119894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:29.123155 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.123127 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f"] Jul 13 20:19:29.123239 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.123205 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb" Jul 13 20:19:29.124571 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.124409 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sw84c\"" Jul 13 20:19:29.125119 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.124771 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 20:19:29.125119 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.124965 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 20:19:29.128246 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.127449 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 13 20:19:29.128246 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.127562 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 20:19:29.128246 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.127639 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-ds7x7"] Jul 13 20:19:29.128246 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.127774 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-btbns\"" Jul 13 20:19:29.131211 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.131192 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l6rc7"] Jul 13 20:19:29.131290 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.131268 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.132950 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.132930 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 13 20:19:29.134503 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.134481 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xt9sl"] Jul 13 20:19:29.134633 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.134617 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-kmxss"] Jul 13 20:19:29.134725 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.134574 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l6rc7" Jul 13 20:19:29.136300 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.136278 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 13 20:19:29.138136 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.138119 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c"] Jul 13 20:19:29.138326 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.138306 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:29.144668 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.141936 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 13 20:19:29.144668 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.142207 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 13 20:19:29.144668 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.142398 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 13 20:19:29.144668 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.142607 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 13 20:19:29.144668 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.142836 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 20:19:29.144668 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.143117 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lrxlf\"" Jul 13 20:19:29.145043 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.144959 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 20:19:29.145389 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.145180 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 20:19:29.145389 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.145231 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6zs7s\"" Jul 13 20:19:29.145566 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.145548 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 13 20:19:29.147163 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.147147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 13 20:19:29.147474 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.147458 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-w9wm9"] Jul 13 20:19:29.147599 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.147587 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb"] Jul 13 20:19:29.147959 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.147946 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c" Jul 13 20:19:29.150993 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.150972 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l6rc7"] Jul 13 20:19:29.151989 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.151889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 20:19:29.152143 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.152130 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-ds7x7"] Jul 13 20:19:29.152278 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.152204 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pmnlc\"" Jul 13 20:19:29.153654 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.153032 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-kmxss"] Jul 13 20:19:29.154225 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.154201 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 13 20:19:29.154968 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.154935 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4dctg\"" Jul 13 20:19:29.155571 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.155553 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 20:19:29.163973 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.163953 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv"] Jul 13 20:19:29.174079 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-default-certificate\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.174172 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15e4ff66-d35c-4539-babb-668bba8ddcfb-serving-cert\") pod \"service-ca-operator-7695fc6c8c-smt9f\" (UID: \"15e4ff66-d35c-4539-babb-668bba8ddcfb\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:29.174172 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.174276 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-trusted-ca\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.174276 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgckf\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-kube-api-access-dgckf\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.174374 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-installation-pull-secrets\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.174374 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/df15cdd6-58e8-434a-8f53-e711defd5ee1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.174374 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.174522 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-424fn\" (UniqueName: \"kubernetes.io/projected/df15cdd6-58e8-434a-8f53-e711defd5ee1-kube-api-access-424fn\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.174522 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.174522 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20250b6c-773c-46d9-b14c-9a80426b394c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:29.174522 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174486 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-certificates\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.174522 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-bound-sa-token\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.174757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15e4ff66-d35c-4539-babb-668bba8ddcfb-config\") pod \"service-ca-operator-7695fc6c8c-smt9f\" (UID: \"15e4ff66-d35c-4539-babb-668bba8ddcfb\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:29.174757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.174757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88cgw\" (UniqueName: \"kubernetes.io/projected/15e4ff66-d35c-4539-babb-668bba8ddcfb-kube-api-access-88cgw\") pod \"service-ca-operator-7695fc6c8c-smt9f\" (UID: \"15e4ff66-d35c-4539-babb-668bba8ddcfb\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:29.174757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-image-registry-private-configuration\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.174757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea75151b-f8c7-4f82-8290-620dd4f0c045-ca-trust-extracted\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.174757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-stats-auth\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.174757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6kg8\" (UniqueName: \"kubernetes.io/projected/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-kube-api-access-v6kg8\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.175140 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9js6\" (UniqueName: \"kubernetes.io/projected/20250b6c-773c-46d9-b14c-9a80426b394c-kube-api-access-m9js6\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:29.175140 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.174872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20250b6c-773c-46d9-b14c-9a80426b394c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:29.177586 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.177565 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c"] Jul 13 20:19:29.275730 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.275703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-trusted-ca\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.275896 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.275742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac2aa198-e44e-421a-b230-f1151d0a5845-serving-cert\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.275896 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.275762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f067a1c5-ef63-4180-90c6-bdde795c45ff-cert\") pod \"ingress-canary-l6rc7\" (UID: \"f067a1c5-ef63-4180-90c6-bdde795c45ff\") " pod="openshift-ingress-canary/ingress-canary-l6rc7" Jul 13 20:19:29.275896 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.275780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d427x\" (UniqueName: \"kubernetes.io/projected/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-kube-api-access-d427x\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.275896 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.275806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6qg2\" (UniqueName: \"kubernetes.io/projected/e357c558-9aee-46e5-8ce5-74272e1560ab-kube-api-access-c6qg2\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:29.275896 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.275847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-snapshots\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.275896 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.275881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn5lg\" (UniqueName: \"kubernetes.io/projected/f067a1c5-ef63-4180-90c6-bdde795c45ff-kube-api-access-sn5lg\") pod \"ingress-canary-l6rc7\" (UID: \"f067a1c5-ef63-4180-90c6-bdde795c45ff\") " pod="openshift-ingress-canary/ingress-canary-l6rc7" Jul 13 20:19:29.276247 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.275946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-certificates\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.276247 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4hbm\" (UniqueName: \"kubernetes.io/projected/ac2aa198-e44e-421a-b230-f1151d0a5845-kube-api-access-x4hbm\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.276247 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88cgw\" (UniqueName: \"kubernetes.io/projected/15e4ff66-d35c-4539-babb-668bba8ddcfb-kube-api-access-88cgw\") pod \"service-ca-operator-7695fc6c8c-smt9f\" (UID: \"15e4ff66-d35c-4539-babb-668bba8ddcfb\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:29.276247 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-image-registry-private-configuration\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.276247 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea75151b-f8c7-4f82-8290-620dd4f0c045-ca-trust-extracted\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.276247 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276196 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6kg8\" (UniqueName: \"kubernetes.io/projected/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-kube-api-access-v6kg8\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.276247 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.276247 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-default-certificate\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.276617 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15e4ff66-d35c-4539-babb-668bba8ddcfb-serving-cert\") pod \"service-ca-operator-7695fc6c8c-smt9f\" (UID: \"15e4ff66-d35c-4539-babb-668bba8ddcfb\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:29.276617 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.276617 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-tmp-dir\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.276617 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.276617 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.276452 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 20:19:29.276617 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.276466 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c87cb8479-5vqw8: secret "image-registry-tls" not found Jul 13 20:19:29.276617 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276487 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-certificates\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.276617 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.276515 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls podName:ea75151b-f8c7-4f82-8290-620dd4f0c045 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:29.776498857 +0000 UTC m=+36.622122209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls") pod "image-registry-7c87cb8479-5vqw8" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045") : secret "image-registry-tls" not found Jul 13 20:19:29.276617 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac2aa198-e44e-421a-b230-f1151d0a5845-config\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-installation-pull-secrets\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276641 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea75151b-f8c7-4f82-8290-620dd4f0c045-ca-trust-extracted\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/df15cdd6-58e8-434a-8f53-e711defd5ee1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20250b6c-773c-46d9-b14c-9a80426b394c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-tmp\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-trusted-ca\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276789 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac2aa198-e44e-421a-b230-f1151d0a5845-trusted-ca\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-config-volume\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.276853 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:29.776836715 +0000 UTC m=+36.622460080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : configmap references non-existent config key: service-ca.crt Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-424fn\" (UniqueName: \"kubernetes.io/projected/df15cdd6-58e8-434a-8f53-e711defd5ee1-kube-api-access-424fn\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-nginx-conf\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:29.277025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.276979 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms5g8\" (UniqueName: \"kubernetes.io/projected/5874dd0e-2396-4ccc-9927-a00a1a0152c9-kube-api-access-ms5g8\") pod \"volume-data-source-validator-78495597f6-s5rcb\" (UID: \"5874dd0e-2396-4ccc-9927-a00a1a0152c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-bound-sa-token\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15e4ff66-d35c-4539-babb-668bba8ddcfb-config\") pod \"service-ca-operator-7695fc6c8c-smt9f\" (UID: \"15e4ff66-d35c-4539-babb-668bba8ddcfb\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-serving-cert\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdfsm\" (UniqueName: \"kubernetes.io/projected/fbaa099e-ac4c-4c7b-bc7d-13fad446335a-kube-api-access-qdfsm\") pod \"network-check-source-869dcfcdcd-57k6c\" (UID: \"fbaa099e-ac4c-4c7b-bc7d-13fad446335a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.277223 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.277270 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:29.777256993 +0000 UTC m=+36.622880350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : secret "router-metrics-certs-default" not found Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbszv\" (UniqueName: \"kubernetes.io/projected/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-kube-api-access-vbszv\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-stats-auth\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277447 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/df15cdd6-58e8-434a-8f53-e711defd5ee1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20250b6c-773c-46d9-b14c-9a80426b394c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9js6\" (UniqueName: \"kubernetes.io/projected/20250b6c-773c-46d9-b14c-9a80426b394c-kube-api-access-m9js6\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:29.277710 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.277659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgckf\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-kube-api-access-dgckf\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.278408 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.277843 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:29.278408 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.277898 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls podName:df15cdd6-58e8-434a-8f53-e711defd5ee1 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:29.777883807 +0000 UTC m=+36.623507158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mb8gp" (UID: "df15cdd6-58e8-434a-8f53-e711defd5ee1") : secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:29.281242 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.281219 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-image-registry-private-configuration\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.281343 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.281288 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-default-certificate\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.281343 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.281314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-stats-auth\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.281747 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.281724 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-installation-pull-secrets\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.289534 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.289080 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6kg8\" (UniqueName: \"kubernetes.io/projected/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-kube-api-access-v6kg8\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.290025 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.290001 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-424fn\" (UniqueName: \"kubernetes.io/projected/df15cdd6-58e8-434a-8f53-e711defd5ee1-kube-api-access-424fn\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.290821 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.290801 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-bound-sa-token\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.291071 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.291038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgckf\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-kube-api-access-dgckf\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.378926 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.378887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4hbm\" (UniqueName: \"kubernetes.io/projected/ac2aa198-e44e-421a-b230-f1151d0a5845-kube-api-access-x4hbm\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.378926 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.378931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.379162 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.378968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.379162 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-tmp-dir\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.379162 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac2aa198-e44e-421a-b230-f1151d0a5845-config\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.379162 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.379162 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.379091 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 20:19:29.379162 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-tmp\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.379162 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac2aa198-e44e-421a-b230-f1151d0a5845-trusted-ca\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.379162 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.379168 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls podName:ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b nodeName:}" failed. No retries permitted until 2026-07-13 20:19:29.879148231 +0000 UTC m=+36.724771575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls") pod "dns-default-xt9sl" (UID: "ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b") : secret "dns-default-metrics-tls" not found Jul 13 20:19:29.379547 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-config-volume\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.379547 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:29.379547 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-nginx-conf\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:29.379547 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms5g8\" (UniqueName: \"kubernetes.io/projected/5874dd0e-2396-4ccc-9927-a00a1a0152c9-kube-api-access-ms5g8\") pod \"volume-data-source-validator-78495597f6-s5rcb\" (UID: \"5874dd0e-2396-4ccc-9927-a00a1a0152c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb" Jul 13 20:19:29.379547 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-serving-cert\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.379547 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdfsm\" (UniqueName: \"kubernetes.io/projected/fbaa099e-ac4c-4c7b-bc7d-13fad446335a-kube-api-access-qdfsm\") pod \"network-check-source-869dcfcdcd-57k6c\" (UID: \"fbaa099e-ac4c-4c7b-bc7d-13fad446335a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c" Jul 13 20:19:29.379547 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbszv\" (UniqueName: \"kubernetes.io/projected/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-kube-api-access-vbszv\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.379547 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379404 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-tmp-dir\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.379547 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac2aa198-e44e-421a-b230-f1151d0a5845-serving-cert\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379623 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f067a1c5-ef63-4180-90c6-bdde795c45ff-cert\") pod \"ingress-canary-l6rc7\" (UID: \"f067a1c5-ef63-4180-90c6-bdde795c45ff\") " pod="openshift-ingress-canary/ingress-canary-l6rc7" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d427x\" (UniqueName: \"kubernetes.io/projected/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-kube-api-access-d427x\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379668 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6qg2\" (UniqueName: \"kubernetes.io/projected/e357c558-9aee-46e5-8ce5-74272e1560ab-kube-api-access-c6qg2\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-snapshots\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn5lg\" (UniqueName: \"kubernetes.io/projected/f067a1c5-ef63-4180-90c6-bdde795c45ff-kube-api-access-sn5lg\") pod \"ingress-canary-l6rc7\" (UID: \"f067a1c5-ef63-4180-90c6-bdde795c45ff\") " pod="openshift-ingress-canary/ingress-canary-l6rc7" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac2aa198-e44e-421a-b230-f1151d0a5845-config\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.379919 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.379974 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.379944 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 20:19:29.380510 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.380018 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls podName:e357c558-9aee-46e5-8ce5-74272e1560ab nodeName:}" failed. No retries permitted until 2026-07-13 20:19:29.879995056 +0000 UTC m=+36.725618402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls") pod "cluster-samples-operator-65db858894-f4mrv" (UID: "e357c558-9aee-46e5-8ce5-74272e1560ab") : secret "samples-operator-tls" not found Jul 13 20:19:29.380510 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.380020 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac2aa198-e44e-421a-b230-f1151d0a5845-trusted-ca\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.380510 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.380244 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-tmp\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.380510 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.380293 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-config-volume\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.380510 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.380424 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 20:19:29.380510 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.380481 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert podName:2d60f1b4-4230-4b66-9e24-f10be9dd0b2e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:29.880465471 +0000 UTC m=+36.726088826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kmxss" (UID: "2d60f1b4-4230-4b66-9e24-f10be9dd0b2e") : secret "networking-console-plugin-cert" not found Jul 13 20:19:29.380788 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.380695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-nginx-conf\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:29.380882 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.380858 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-snapshots\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.382194 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.382175 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac2aa198-e44e-421a-b230-f1151d0a5845-serving-cert\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.382512 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.382497 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-serving-cert\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.382641 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.382618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f067a1c5-ef63-4180-90c6-bdde795c45ff-cert\") pod \"ingress-canary-l6rc7\" (UID: \"f067a1c5-ef63-4180-90c6-bdde795c45ff\") " pod="openshift-ingress-canary/ingress-canary-l6rc7" Jul 13 20:19:29.391692 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.391660 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn5lg\" (UniqueName: \"kubernetes.io/projected/f067a1c5-ef63-4180-90c6-bdde795c45ff-kube-api-access-sn5lg\") pod \"ingress-canary-l6rc7\" (UID: \"f067a1c5-ef63-4180-90c6-bdde795c45ff\") " pod="openshift-ingress-canary/ingress-canary-l6rc7" Jul 13 20:19:29.394392 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.394365 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d427x\" (UniqueName: \"kubernetes.io/projected/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-kube-api-access-d427x\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.394487 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.394402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4hbm\" (UniqueName: \"kubernetes.io/projected/ac2aa198-e44e-421a-b230-f1151d0a5845-kube-api-access-x4hbm\") pod \"console-operator-7866497494-ds7x7\" (UID: \"ac2aa198-e44e-421a-b230-f1151d0a5845\") " pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.394487 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.394442 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6qg2\" (UniqueName: \"kubernetes.io/projected/e357c558-9aee-46e5-8ce5-74272e1560ab-kube-api-access-c6qg2\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:29.394594 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.394560 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbszv\" (UniqueName: \"kubernetes.io/projected/3829d617-e9aa-4ba6-9d02-fe8e0c3932c5-kube-api-access-vbszv\") pod \"insights-operator-68d9dd94cf-w9wm9\" (UID: \"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5\") " pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.395484 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.395457 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms5g8\" (UniqueName: \"kubernetes.io/projected/5874dd0e-2396-4ccc-9927-a00a1a0152c9-kube-api-access-ms5g8\") pod \"volume-data-source-validator-78495597f6-s5rcb\" (UID: \"5874dd0e-2396-4ccc-9927-a00a1a0152c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb" Jul 13 20:19:29.396165 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.396133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdfsm\" (UniqueName: \"kubernetes.io/projected/fbaa099e-ac4c-4c7b-bc7d-13fad446335a-kube-api-access-qdfsm\") pod \"network-check-source-869dcfcdcd-57k6c\" (UID: \"fbaa099e-ac4c-4c7b-bc7d-13fad446335a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c" Jul 13 20:19:29.428622 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.428600 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" Jul 13 20:19:29.439597 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.439576 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:29.440052 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.439749 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:29.442268 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.442250 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 20:19:29.442410 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.442397 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhkt5\"" Jul 13 20:19:29.452970 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.452950 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb" Jul 13 20:19:29.458256 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.458240 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:29.463989 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.463972 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l6rc7" Jul 13 20:19:29.475004 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.474987 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c" Jul 13 20:19:29.784777 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.784745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:29.784777 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.784784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.785019 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.784837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:29.785019 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.784910 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 20:19:29.785019 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.784927 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c87cb8479-5vqw8: secret "image-registry-tls" not found Jul 13 20:19:29.785019 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.784937 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 20:19:29.785019 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.784985 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:30.784967861 +0000 UTC m=+37.630591213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : secret "router-metrics-certs-default" not found Jul 13 20:19:29.785019 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.785000 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls podName:ea75151b-f8c7-4f82-8290-620dd4f0c045 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:30.784992369 +0000 UTC m=+37.630615714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls") pod "image-registry-7c87cb8479-5vqw8" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045") : secret "image-registry-tls" not found Jul 13 20:19:29.785019 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.785014 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:30.785006516 +0000 UTC m=+37.630629865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : configmap references non-existent config key: service-ca.crt Jul 13 20:19:29.785323 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.785052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:29.785323 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.785168 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:29.785323 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.785230 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls podName:df15cdd6-58e8-434a-8f53-e711defd5ee1 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:30.785213859 +0000 UTC m=+37.630837200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mb8gp" (UID: "df15cdd6-58e8-434a-8f53-e711defd5ee1") : secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:29.886033 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.885998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:29.886194 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.886083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:29.886194 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.886156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:29.886194 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.886158 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 20:19:29.886194 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.886182 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 20:19:29.886375 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.886219 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert podName:2d60f1b4-4230-4b66-9e24-f10be9dd0b2e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:30.886202383 +0000 UTC m=+37.731825735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kmxss" (UID: "2d60f1b4-4230-4b66-9e24-f10be9dd0b2e") : secret "networking-console-plugin-cert" not found Jul 13 20:19:29.886375 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.886236 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls podName:ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b nodeName:}" failed. No retries permitted until 2026-07-13 20:19:30.886228161 +0000 UTC m=+37.731851500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls") pod "dns-default-xt9sl" (UID: "ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b") : secret "dns-default-metrics-tls" not found Jul 13 20:19:29.886375 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.886266 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 20:19:29.886375 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:29.886322 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls podName:e357c558-9aee-46e5-8ce5-74272e1560ab nodeName:}" failed. No retries permitted until 2026-07-13 20:19:30.886310987 +0000 UTC m=+37.731934326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls") pod "cluster-samples-operator-65db858894-f4mrv" (UID: "e357c558-9aee-46e5-8ce5-74272e1560ab") : secret "samples-operator-tls" not found Jul 13 20:19:29.904586 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.904564 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 13 20:19:29.909498 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.909473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15e4ff66-d35c-4539-babb-668bba8ddcfb-serving-cert\") pod \"service-ca-operator-7695fc6c8c-smt9f\" (UID: \"15e4ff66-d35c-4539-babb-668bba8ddcfb\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:29.926517 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:29.926501 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 13 20:19:30.044094 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.044021 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 13 20:19:30.047991 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.047970 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15e4ff66-d35c-4539-babb-668bba8ddcfb-config\") pod \"service-ca-operator-7695fc6c8c-smt9f\" (UID: \"15e4ff66-d35c-4539-babb-668bba8ddcfb\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:30.183050 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.183020 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 13 20:19:30.246353 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.246326 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 13 20:19:30.247774 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.247745 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 13 20:19:30.248257 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.248239 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20250b6c-773c-46d9-b14c-9a80426b394c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:30.251014 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.250991 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88cgw\" (UniqueName: \"kubernetes.io/projected/15e4ff66-d35c-4539-babb-668bba8ddcfb-kube-api-access-88cgw\") pod \"service-ca-operator-7695fc6c8c-smt9f\" (UID: \"15e4ff66-d35c-4539-babb-668bba8ddcfb\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:30.277106 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.277083 2579 secret.go:189] Couldn't get secret openshift-kube-storage-version-migrator-operator/serving-cert: failed to sync secret cache: timed out waiting for the condition Jul 13 20:19:30.277221 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.277152 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20250b6c-773c-46d9-b14c-9a80426b394c-serving-cert podName:20250b6c-773c-46d9-b14c-9a80426b394c nodeName:}" failed. No retries permitted until 2026-07-13 20:19:30.777138871 +0000 UTC m=+37.622762209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/20250b6c-773c-46d9-b14c-9a80426b394c-serving-cert") pod "kube-storage-version-migrator-operator-799cb7f958-pclwn" (UID: "20250b6c-773c-46d9-b14c-9a80426b394c") : failed to sync secret cache: timed out waiting for the condition Jul 13 20:19:30.346340 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.346273 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sgmb9\"" Jul 13 20:19:30.347771 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.347752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" Jul 13 20:19:30.439900 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.439874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:30.443293 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.443274 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 20:19:30.443404 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.443325 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dwnrg\"" Jul 13 20:19:30.467106 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.467087 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 13 20:19:30.470510 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.470488 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9js6\" (UniqueName: \"kubernetes.io/projected/20250b6c-773c-46d9-b14c-9a80426b394c-kube-api-access-m9js6\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:30.531472 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.531453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 13 20:19:30.671776 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.671555 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ww98c\"" Jul 13 20:19:30.798760 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.798467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:30.798760 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.798747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:30.798925 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.798848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:30.798925 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.798879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:30.798925 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.798905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20250b6c-773c-46d9-b14c-9a80426b394c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:30.800879 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.799673 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:30.800879 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.799744 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls podName:df15cdd6-58e8-434a-8f53-e711defd5ee1 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:32.799722593 +0000 UTC m=+39.645345950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mb8gp" (UID: "df15cdd6-58e8-434a-8f53-e711defd5ee1") : secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:30.800879 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.800213 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 20:19:30.800879 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.800270 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:32.800250992 +0000 UTC m=+39.645874346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : secret "router-metrics-certs-default" not found Jul 13 20:19:30.800879 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.800345 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 20:19:30.800879 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.800356 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c87cb8479-5vqw8: secret "image-registry-tls" not found Jul 13 20:19:30.800879 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.800389 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls podName:ea75151b-f8c7-4f82-8290-620dd4f0c045 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:32.800378365 +0000 UTC m=+39.646001704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls") pod "image-registry-7c87cb8479-5vqw8" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045") : secret "image-registry-tls" not found Jul 13 20:19:30.800879 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.800461 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:32.800447883 +0000 UTC m=+39.646071227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : configmap references non-existent config key: service-ca.crt Jul 13 20:19:30.809938 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.808529 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20250b6c-773c-46d9-b14c-9a80426b394c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pclwn\" (UID: \"20250b6c-773c-46d9-b14c-9a80426b394c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:30.886864 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.886820 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" Jul 13 20:19:30.900667 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.900305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:30.900667 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.900395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:30.900667 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.900463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:30.900667 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.900574 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 20:19:30.900667 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.900625 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls podName:ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b nodeName:}" failed. No retries permitted until 2026-07-13 20:19:32.90060741 +0000 UTC m=+39.746230768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls") pod "dns-default-xt9sl" (UID: "ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b") : secret "dns-default-metrics-tls" not found Jul 13 20:19:30.900937 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.900689 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 20:19:30.900937 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.900697 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 20:19:30.900937 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.900732 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert podName:2d60f1b4-4230-4b66-9e24-f10be9dd0b2e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:32.900719422 +0000 UTC m=+39.746342760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kmxss" (UID: "2d60f1b4-4230-4b66-9e24-f10be9dd0b2e") : secret "networking-console-plugin-cert" not found Jul 13 20:19:30.900937 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:30.900747 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls podName:e357c558-9aee-46e5-8ce5-74272e1560ab nodeName:}" failed. No retries permitted until 2026-07-13 20:19:32.900739501 +0000 UTC m=+39.746362839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls") pod "cluster-samples-operator-65db858894-f4mrv" (UID: "e357c558-9aee-46e5-8ce5-74272e1560ab") : secret "samples-operator-tls" not found Jul 13 20:19:30.908856 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.908794 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-w9wm9"] Jul 13 20:19:30.916520 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.915199 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-ds7x7"] Jul 13 20:19:30.916520 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.916430 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l6rc7"] Jul 13 20:19:30.918791 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:19:30.918770 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2aa198_e44e_421a_b230_f1151d0a5845.slice/crio-156516b9e45fe8fd95834716e0ea37524121f1e69d1ff65d538403279f39ff6d WatchSource:0}: Error finding container 156516b9e45fe8fd95834716e0ea37524121f1e69d1ff65d538403279f39ff6d: Status 404 returned error can't find the container with id 156516b9e45fe8fd95834716e0ea37524121f1e69d1ff65d538403279f39ff6d Jul 13 20:19:30.923378 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.923205 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f"] Jul 13 20:19:30.924029 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.924011 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb"] Jul 13 20:19:30.933429 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:30.933409 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c"] Jul 13 20:19:31.033926 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.033900 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn"] Jul 13 20:19:31.051944 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:19:31.051904 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbaa099e_ac4c_4c7b_bc7d_13fad446335a.slice/crio-b6cda42251331b1bf9c14d0c06a730df0054775e7a761ce812dbf9bc3014846b WatchSource:0}: Error finding container b6cda42251331b1bf9c14d0c06a730df0054775e7a761ce812dbf9bc3014846b: Status 404 returned error can't find the container with id b6cda42251331b1bf9c14d0c06a730df0054775e7a761ce812dbf9bc3014846b Jul 13 20:19:31.052370 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:19:31.052344 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e4ff66_d35c_4539_babb_668bba8ddcfb.slice/crio-4a2fc25f850d20239140e681112fccbb7606ad80b73a6c0e8e443fb10a706d4d WatchSource:0}: Error finding container 4a2fc25f850d20239140e681112fccbb7606ad80b73a6c0e8e443fb10a706d4d: Status 404 returned error can't find the container with id 4a2fc25f850d20239140e681112fccbb7606ad80b73a6c0e8e443fb10a706d4d Jul 13 20:19:31.052574 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:19:31.052555 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf067a1c5_ef63_4180_90c6_bdde795c45ff.slice/crio-c39d7058ce11bd9664dc129335c904980b538bfb44b8eee29a992760206c89a5 WatchSource:0}: Error finding container c39d7058ce11bd9664dc129335c904980b538bfb44b8eee29a992760206c89a5: Status 404 returned error can't find the container with id c39d7058ce11bd9664dc129335c904980b538bfb44b8eee29a992760206c89a5 Jul 13 20:19:31.053277 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:19:31.053234 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5874dd0e_2396_4ccc_9927_a00a1a0152c9.slice/crio-8bbcf4641b59969857656f96393d5b76d7ae919a2283e750f28f507ff9c28ca0 WatchSource:0}: Error finding container 8bbcf4641b59969857656f96393d5b76d7ae919a2283e750f28f507ff9c28ca0: Status 404 returned error can't find the container with id 8bbcf4641b59969857656f96393d5b76d7ae919a2283e750f28f507ff9c28ca0 Jul 13 20:19:31.053532 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:19:31.053473 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20250b6c_773c_46d9_b14c_9a80426b394c.slice/crio-888b0dfd703e4332eaead670b3f95ecc0f1d75441fac0621de6ddf4c82bb36f2 WatchSource:0}: Error finding container 888b0dfd703e4332eaead670b3f95ecc0f1d75441fac0621de6ddf4c82bb36f2: Status 404 returned error can't find the container with id 888b0dfd703e4332eaead670b3f95ecc0f1d75441fac0621de6ddf4c82bb36f2 Jul 13 20:19:31.696009 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.695893 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l6rc7" event={"ID":"f067a1c5-ef63-4180-90c6-bdde795c45ff","Type":"ContainerStarted","Data":"c39d7058ce11bd9664dc129335c904980b538bfb44b8eee29a992760206c89a5"} Jul 13 20:19:31.699753 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.699672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" event={"ID":"15e4ff66-d35c-4539-babb-668bba8ddcfb","Type":"ContainerStarted","Data":"4a2fc25f850d20239140e681112fccbb7606ad80b73a6c0e8e443fb10a706d4d"} Jul 13 20:19:31.702179 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.702156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ds7x7" event={"ID":"ac2aa198-e44e-421a-b230-f1151d0a5845","Type":"ContainerStarted","Data":"156516b9e45fe8fd95834716e0ea37524121f1e69d1ff65d538403279f39ff6d"} Jul 13 20:19:31.706795 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.706769 2579 generic.go:356] "Generic (PLEG): container finished" podID="508218ce-1c54-42c4-ac46-0a2aaa2dfcd2" containerID="3c8b3678e54a5a9f892dc9c0259fa0416bf020e5bc3cd537a1904137617b7278" exitCode=0 Jul 13 20:19:31.706898 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.706854 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" event={"ID":"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2","Type":"ContainerDied","Data":"3c8b3678e54a5a9f892dc9c0259fa0416bf020e5bc3cd537a1904137617b7278"} Jul 13 20:19:31.709585 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.709563 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb" event={"ID":"5874dd0e-2396-4ccc-9927-a00a1a0152c9","Type":"ContainerStarted","Data":"8bbcf4641b59969857656f96393d5b76d7ae919a2283e750f28f507ff9c28ca0"} Jul 13 20:19:31.715532 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.715445 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" event={"ID":"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5","Type":"ContainerStarted","Data":"d12fb1dd3a8d936793dac260753cdb6b52b40bfc63e84e4a220d5ca8736f2b3c"} Jul 13 20:19:31.723164 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.723098 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" event={"ID":"20250b6c-773c-46d9-b14c-9a80426b394c","Type":"ContainerStarted","Data":"888b0dfd703e4332eaead670b3f95ecc0f1d75441fac0621de6ddf4c82bb36f2"} Jul 13 20:19:31.726350 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:31.726303 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c" event={"ID":"fbaa099e-ac4c-4c7b-bc7d-13fad446335a","Type":"ContainerStarted","Data":"b6cda42251331b1bf9c14d0c06a730df0054775e7a761ce812dbf9bc3014846b"} Jul 13 20:19:32.740177 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:32.739330 2579 generic.go:356] "Generic (PLEG): container finished" podID="508218ce-1c54-42c4-ac46-0a2aaa2dfcd2" containerID="2ac081ec0a6bfa7ec436f0bf000564ea70e49748a5833fc5a11db8d04b008451" exitCode=0 Jul 13 20:19:32.740177 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:32.739451 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" event={"ID":"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2","Type":"ContainerDied","Data":"2ac081ec0a6bfa7ec436f0bf000564ea70e49748a5833fc5a11db8d04b008451"} Jul 13 20:19:32.825151 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:32.825113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:32.825461 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:32.825169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:32.825461 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:32.825236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:32.825461 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:32.825314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:32.825660 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.825493 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:32.825660 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.825555 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls podName:df15cdd6-58e8-434a-8f53-e711defd5ee1 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:36.825533961 +0000 UTC m=+43.671157319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mb8gp" (UID: "df15cdd6-58e8-434a-8f53-e711defd5ee1") : secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:32.826235 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.825927 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 20:19:32.826235 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.825952 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c87cb8479-5vqw8: secret "image-registry-tls" not found Jul 13 20:19:32.826235 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.825999 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls podName:ea75151b-f8c7-4f82-8290-620dd4f0c045 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:36.825982916 +0000 UTC m=+43.671606267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls") pod "image-registry-7c87cb8479-5vqw8" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045") : secret "image-registry-tls" not found Jul 13 20:19:32.826235 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.826091 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:36.826078243 +0000 UTC m=+43.671701597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : configmap references non-existent config key: service-ca.crt Jul 13 20:19:32.826235 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.826150 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 20:19:32.826235 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.826181 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:36.826171053 +0000 UTC m=+43.671794405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : secret "router-metrics-certs-default" not found Jul 13 20:19:32.926565 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:32.925977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:32.926565 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:32.926112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:32.926565 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:32.926205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:32.926565 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.926313 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 20:19:32.926565 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.926376 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls podName:ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b nodeName:}" failed. No retries permitted until 2026-07-13 20:19:36.926355852 +0000 UTC m=+43.771979213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls") pod "dns-default-xt9sl" (UID: "ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b") : secret "dns-default-metrics-tls" not found Jul 13 20:19:32.926887 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.926619 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 20:19:32.926887 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.926668 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls podName:e357c558-9aee-46e5-8ce5-74272e1560ab nodeName:}" failed. No retries permitted until 2026-07-13 20:19:36.926653562 +0000 UTC m=+43.772276917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls") pod "cluster-samples-operator-65db858894-f4mrv" (UID: "e357c558-9aee-46e5-8ce5-74272e1560ab") : secret "samples-operator-tls" not found Jul 13 20:19:32.927205 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.927124 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 20:19:32.927205 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:32.927175 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert podName:2d60f1b4-4230-4b66-9e24-f10be9dd0b2e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:36.92716017 +0000 UTC m=+43.772783523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kmxss" (UID: "2d60f1b4-4230-4b66-9e24-f10be9dd0b2e") : secret "networking-console-plugin-cert" not found Jul 13 20:19:33.747274 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:33.746863 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" event={"ID":"508218ce-1c54-42c4-ac46-0a2aaa2dfcd2","Type":"ContainerStarted","Data":"9282b098eac01a8a6d8cfe6580d725eccaa63bf7c4c1df52796f86207882de37"} Jul 13 20:19:33.748930 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:33.748897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb" event={"ID":"5874dd0e-2396-4ccc-9927-a00a1a0152c9","Type":"ContainerStarted","Data":"39095bf268561ccf8e115e9f722843eecb71fd7e225a108e8e4a2584f1617680"} Jul 13 20:19:33.775711 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:33.775643 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f7hzx" podStartSLOduration=9.135192086 podStartE2EDuration="38.775621059s" totalImagesPullingTime="29.640428973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:33.77312997 +0000 UTC m=+40.618753331" watchObservedRunningTime="2026-07-13 20:19:33.775621059 +0000 UTC m=+40.621244421" Jul 13 20:19:33.793108 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:33.793046 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5rcb" podStartSLOduration=15.21524842 podStartE2EDuration="16.79303457s" totalImagesPullingTime="1.57778615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:33.792531793 +0000 UTC m=+40.638155154" watchObservedRunningTime="2026-07-13 20:19:33.79303457 +0000 UTC m=+40.638657932" Jul 13 20:19:36.358478 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.358441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:36.362845 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.362813 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/843d1046-24bb-4afa-a9d6-04b55ff30163-original-pull-secret\") pod \"global-pull-secret-syncer-4b8vd\" (UID: \"843d1046-24bb-4afa-a9d6-04b55ff30163\") " pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:36.657115 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.657032 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4b8vd" Jul 13 20:19:36.863626 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.863520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:36.863626 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.863565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:36.863757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.863630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:36.863757 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.863650 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 20:19:36.863757 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.863658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:36.863757 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.863716 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:44.863696314 +0000 UTC m=+51.709319667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : secret "router-metrics-certs-default" not found Jul 13 20:19:36.863757 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.863745 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 20:19:36.863757 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.863758 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c87cb8479-5vqw8: secret "image-registry-tls" not found Jul 13 20:19:36.864078 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.863775 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:44.863763496 +0000 UTC m=+51.709386842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : configmap references non-existent config key: service-ca.crt Jul 13 20:19:36.864078 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.863795 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls podName:ea75151b-f8c7-4f82-8290-620dd4f0c045 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:44.863783123 +0000 UTC m=+51.709406467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls") pod "image-registry-7c87cb8479-5vqw8" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045") : secret "image-registry-tls" not found Jul 13 20:19:36.864078 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.863744 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:36.864078 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.863831 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls podName:df15cdd6-58e8-434a-8f53-e711defd5ee1 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:44.863822242 +0000 UTC m=+51.709445627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mb8gp" (UID: "df15cdd6-58e8-434a-8f53-e711defd5ee1") : secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:36.964465 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.964392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:36.964607 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.964474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:36.964607 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:36.964540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:36.964607 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.964589 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 20:19:36.964771 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.964626 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 20:19:36.964771 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.964648 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 20:19:36.964771 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.964662 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls podName:ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b nodeName:}" failed. No retries permitted until 2026-07-13 20:19:44.964640265 +0000 UTC m=+51.810263623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls") pod "dns-default-xt9sl" (UID: "ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b") : secret "dns-default-metrics-tls" not found Jul 13 20:19:36.964771 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.964692 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls podName:e357c558-9aee-46e5-8ce5-74272e1560ab nodeName:}" failed. No retries permitted until 2026-07-13 20:19:44.964676223 +0000 UTC m=+51.810299592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls") pod "cluster-samples-operator-65db858894-f4mrv" (UID: "e357c558-9aee-46e5-8ce5-74272e1560ab") : secret "samples-operator-tls" not found Jul 13 20:19:36.964771 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:36.964710 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert podName:2d60f1b4-4230-4b66-9e24-f10be9dd0b2e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:44.964701428 +0000 UTC m=+51.810324774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kmxss" (UID: "2d60f1b4-4230-4b66-9e24-f10be9dd0b2e") : secret "networking-console-plugin-cert" not found Jul 13 20:19:38.503819 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.503756 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4b8vd"] Jul 13 20:19:38.508796 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:19:38.508775 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843d1046_24bb_4afa_a9d6_04b55ff30163.slice/crio-c9160655edc21d7781d6c8cb6d019d6821d7982d82db6a17ff54df7df2e5583d WatchSource:0}: Error finding container c9160655edc21d7781d6c8cb6d019d6821d7982d82db6a17ff54df7df2e5583d: Status 404 returned error can't find the container with id c9160655edc21d7781d6c8cb6d019d6821d7982d82db6a17ff54df7df2e5583d Jul 13 20:19:38.771028 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.770989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" event={"ID":"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5","Type":"ContainerStarted","Data":"0f66b2bc5b1e909e9c6fe3202630ea625219d7e462f9a3f7f984f097e54f1667"} Jul 13 20:19:38.772874 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.772849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" event={"ID":"20250b6c-773c-46d9-b14c-9a80426b394c","Type":"ContainerStarted","Data":"8b40474dfeb7125178d655af9049db3ce810ca16682c74e364f6e3aa4f36cc4c"} Jul 13 20:19:38.774153 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.774131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4b8vd" event={"ID":"843d1046-24bb-4afa-a9d6-04b55ff30163","Type":"ContainerStarted","Data":"c9160655edc21d7781d6c8cb6d019d6821d7982d82db6a17ff54df7df2e5583d"} Jul 13 20:19:38.775516 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.775497 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c" event={"ID":"fbaa099e-ac4c-4c7b-bc7d-13fad446335a","Type":"ContainerStarted","Data":"1be2c727cb58679762b2db836a562a42781c69ebb5fb10a85cce29fc3e829db9"} Jul 13 20:19:38.777399 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.777378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l6rc7" event={"ID":"f067a1c5-ef63-4180-90c6-bdde795c45ff","Type":"ContainerStarted","Data":"e12f2589b56c63c5c319159a6a932be97af637b82eaadb036051fea4d989d145"} Jul 13 20:19:38.778703 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.778672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" event={"ID":"15e4ff66-d35c-4539-babb-668bba8ddcfb","Type":"ContainerStarted","Data":"f9a94361882a421113d9bccc18a4386a44935484fe8090e6a259eb91c143809e"} Jul 13 20:19:38.780520 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.780500 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/0.log" Jul 13 20:19:38.780632 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.780538 2579 generic.go:356] "Generic (PLEG): container finished" podID="ac2aa198-e44e-421a-b230-f1151d0a5845" containerID="ac66cb92607d3ffb4824a02adc78e57095793ca895438c09180aab56f332c4b8" exitCode=255 Jul 13 20:19:38.780632 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.780573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ds7x7" event={"ID":"ac2aa198-e44e-421a-b230-f1151d0a5845","Type":"ContainerDied","Data":"ac66cb92607d3ffb4824a02adc78e57095793ca895438c09180aab56f332c4b8"} Jul 13 20:19:38.780781 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.780764 2579 scope.go:117] "RemoveContainer" containerID="ac66cb92607d3ffb4824a02adc78e57095793ca895438c09180aab56f332c4b8" Jul 13 20:19:38.789601 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.789562 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" podStartSLOduration=14.36776769 podStartE2EDuration="21.789547908s" totalImagesPullingTime="7.421780218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:38.7892187 +0000 UTC m=+45.634842077" watchObservedRunningTime="2026-07-13 20:19:38.789547908 +0000 UTC m=+45.635171270" Jul 13 20:19:38.805955 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.805909 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" podStartSLOduration=14.482296197 podStartE2EDuration="21.805892352s" totalImagesPullingTime="7.323596155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:38.803844944 +0000 UTC m=+45.649468325" watchObservedRunningTime="2026-07-13 20:19:38.805892352 +0000 UTC m=+45.651515713" Jul 13 20:19:38.828416 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.828383 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-57k6c" podStartSLOduration=14.492030298 podStartE2EDuration="21.82836955s" totalImagesPullingTime="7.336339252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:38.827123847 +0000 UTC m=+45.672747235" watchObservedRunningTime="2026-07-13 20:19:38.82836955 +0000 UTC m=+45.673992954" Jul 13 20:19:38.870417 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.870347 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l6rc7" podStartSLOduration=2.546610421 podStartE2EDuration="9.870328398s" totalImagesPullingTime="7.323717977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:38.86857939 +0000 UTC m=+45.714202751" watchObservedRunningTime="2026-07-13 20:19:38.870328398 +0000 UTC m=+45.715951759" Jul 13 20:19:38.886124 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:38.886082 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" podStartSLOduration=14.56344131 podStartE2EDuration="21.886043672s" totalImagesPullingTime="7.322602362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:38.884472468 +0000 UTC m=+45.730095829" watchObservedRunningTime="2026-07-13 20:19:38.886043672 +0000 UTC m=+45.731667034" Jul 13 20:19:39.459097 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:39.459021 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:39.459097 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:39.459098 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:39.787485 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:39.787392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/1.log" Jul 13 20:19:39.788033 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:39.788010 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/0.log" Jul 13 20:19:39.788690 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:39.788179 2579 generic.go:356] "Generic (PLEG): container finished" podID="ac2aa198-e44e-421a-b230-f1151d0a5845" containerID="301f2291e3c542464df189f65145de467feeba66cc9e4145a5f065c13b0c5a6e" exitCode=255 Jul 13 20:19:39.788690 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:39.788417 2579 scope.go:117] "RemoveContainer" containerID="301f2291e3c542464df189f65145de467feeba66cc9e4145a5f065c13b0c5a6e" Jul 13 20:19:39.788690 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:39.788594 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-ds7x7_openshift-console-operator(ac2aa198-e44e-421a-b230-f1151d0a5845)\"" pod="openshift-console-operator/console-operator-7866497494-ds7x7" podUID="ac2aa198-e44e-421a-b230-f1151d0a5845" Jul 13 20:19:39.788690 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:39.788614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ds7x7" event={"ID":"ac2aa198-e44e-421a-b230-f1151d0a5845","Type":"ContainerDied","Data":"301f2291e3c542464df189f65145de467feeba66cc9e4145a5f065c13b0c5a6e"} Jul 13 20:19:39.799814 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:39.799737 2579 scope.go:117] "RemoveContainer" containerID="ac66cb92607d3ffb4824a02adc78e57095793ca895438c09180aab56f332c4b8" Jul 13 20:19:40.086505 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.086427 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h8l48"] Jul 13 20:19:40.116107 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.116079 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.125044 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.125019 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4rrll\"" Jul 13 20:19:40.126663 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.126014 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 20:19:40.128088 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.127981 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 20:19:40.133216 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.133152 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8l48"] Jul 13 20:19:40.193498 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.193469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7s7g\" (UniqueName: \"kubernetes.io/projected/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-api-access-d7s7g\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.193672 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.193533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-data-volume\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.193672 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.193611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-crio-socket\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.193840 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.193680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.193840 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.193722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.294878 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.294844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-crio-socket\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.295093 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.294932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.295093 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.294992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.295272 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.295094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7s7g\" (UniqueName: \"kubernetes.io/projected/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-api-access-d7s7g\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.295272 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:40.295106 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 20:19:40.295272 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.295132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-data-volume\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.295272 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:40.295149 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 20:19:40.295272 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:40.295177 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls podName:a9bcfb11-121a-4350-a1ed-c3fabc0e484e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:40.795158184 +0000 UTC m=+47.640781546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8l48" (UID: "a9bcfb11-121a-4350-a1ed-c3fabc0e484e") : secret "insights-runtime-extractor-tls" not found Jul 13 20:19:40.295272 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:40.295197 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm podName:a9bcfb11-121a-4350-a1ed-c3fabc0e484e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:40.795187379 +0000 UTC m=+47.640810731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8l48" (UID: "a9bcfb11-121a-4350-a1ed-c3fabc0e484e") : configmap "kube-rbac-proxy" not found Jul 13 20:19:40.295564 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.295092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-crio-socket\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.295564 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.295543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-data-volume\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.313586 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.313563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7s7g\" (UniqueName: \"kubernetes.io/projected/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-api-access-d7s7g\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.793184 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.793154 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/1.log" Jul 13 20:19:40.793594 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.793494 2579 scope.go:117] "RemoveContainer" containerID="301f2291e3c542464df189f65145de467feeba66cc9e4145a5f065c13b0c5a6e" Jul 13 20:19:40.793687 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:40.793665 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-ds7x7_openshift-console-operator(ac2aa198-e44e-421a-b230-f1151d0a5845)\"" pod="openshift-console-operator/console-operator-7866497494-ds7x7" podUID="ac2aa198-e44e-421a-b230-f1151d0a5845" Jul 13 20:19:40.799136 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.799112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.799275 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:40.799157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:40.799275 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:40.799229 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 20:19:40.799275 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:40.799253 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 20:19:40.799275 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:40.799278 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm podName:a9bcfb11-121a-4350-a1ed-c3fabc0e484e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:41.799260986 +0000 UTC m=+48.644884351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8l48" (UID: "a9bcfb11-121a-4350-a1ed-c3fabc0e484e") : configmap "kube-rbac-proxy" not found Jul 13 20:19:40.799472 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:40.799344 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls podName:a9bcfb11-121a-4350-a1ed-c3fabc0e484e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:41.799334114 +0000 UTC m=+48.644957461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8l48" (UID: "a9bcfb11-121a-4350-a1ed-c3fabc0e484e") : secret "insights-runtime-extractor-tls" not found Jul 13 20:19:41.796867 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:41.796843 2579 scope.go:117] "RemoveContainer" containerID="301f2291e3c542464df189f65145de467feeba66cc9e4145a5f065c13b0c5a6e" Jul 13 20:19:41.797224 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:41.796980 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-ds7x7_openshift-console-operator(ac2aa198-e44e-421a-b230-f1151d0a5845)\"" pod="openshift-console-operator/console-operator-7866497494-ds7x7" podUID="ac2aa198-e44e-421a-b230-f1151d0a5845" Jul 13 20:19:41.809541 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:41.809517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:41.809672 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:41.809554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:41.809723 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:41.809676 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 20:19:41.809723 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:41.809713 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm podName:a9bcfb11-121a-4350-a1ed-c3fabc0e484e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:43.809701196 +0000 UTC m=+50.655324535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8l48" (UID: "a9bcfb11-121a-4350-a1ed-c3fabc0e484e") : configmap "kube-rbac-proxy" not found Jul 13 20:19:41.809820 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:41.809675 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 20:19:41.809875 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:41.809839 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls podName:a9bcfb11-121a-4350-a1ed-c3fabc0e484e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:43.809817882 +0000 UTC m=+50.655441231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8l48" (UID: "a9bcfb11-121a-4350-a1ed-c3fabc0e484e") : secret "insights-runtime-extractor-tls" not found Jul 13 20:19:41.864407 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:41.864384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5lt8_a54b0936-585f-4e53-8676-22a998094566/dns-node-resolver/0.log" Jul 13 20:19:43.064957 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:43.064920 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6bf9_c21f4720-1194-47ad-9668-8be83c1a675d/node-ca/0.log" Jul 13 20:19:43.828485 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:43.827983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:43.828485 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:43.828040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:43.828485 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:43.828287 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 20:19:43.828485 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:43.828337 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm podName:a9bcfb11-121a-4350-a1ed-c3fabc0e484e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:47.828319876 +0000 UTC m=+54.673943238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8l48" (UID: "a9bcfb11-121a-4350-a1ed-c3fabc0e484e") : configmap "kube-rbac-proxy" not found Jul 13 20:19:43.828485 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:43.828415 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 20:19:43.828485 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:43.828450 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls podName:a9bcfb11-121a-4350-a1ed-c3fabc0e484e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:47.828439523 +0000 UTC m=+54.674062875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8l48" (UID: "a9bcfb11-121a-4350-a1ed-c3fabc0e484e") : secret "insights-runtime-extractor-tls" not found Jul 13 20:19:43.867877 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:43.867847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l6rc7_f067a1c5-ef63-4180-90c6-bdde795c45ff/serve-healthcheck-canary/0.log" Jul 13 20:19:44.809247 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:44.809215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4b8vd" event={"ID":"843d1046-24bb-4afa-a9d6-04b55ff30163","Type":"ContainerStarted","Data":"8988d83a58b5256d913e7dd1bab1490d12a2aac0b9fe9612ed66c5c4f2c0022f"} Jul 13 20:19:44.825041 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:44.824910 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4b8vd" podStartSLOduration=35.653177708 podStartE2EDuration="40.824893927s" totalImagesPullingTime="5.171716219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:44.824220015 +0000 UTC m=+51.669843375" watchObservedRunningTime="2026-07-13 20:19:44.824893927 +0000 UTC m=+51.670517286" Jul 13 20:19:44.936969 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:44.936941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:19:44.937126 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:44.936974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:44.937126 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:44.937013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:19:44.937126 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:44.937080 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 20:19:44.937126 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:44.937098 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c87cb8479-5vqw8: secret "image-registry-tls" not found Jul 13 20:19:44.937126 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:44.937103 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 20:19:44.937389 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:44.937132 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:00.937113886 +0000 UTC m=+67.782737227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : configmap references non-existent config key: service-ca.crt Jul 13 20:19:44.937389 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:44.937155 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls podName:ea75151b-f8c7-4f82-8290-620dd4f0c045 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:00.937145974 +0000 UTC m=+67.782769323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls") pod "image-registry-7c87cb8479-5vqw8" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045") : secret "image-registry-tls" not found Jul 13 20:19:44.937389 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:44.937233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:19:44.937389 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:44.937269 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs podName:6aa5ad3e-945a-47b3-be93-f0ee06ab0574 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:00.937256264 +0000 UTC m=+67.782879602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs") pod "router-default-7566899d6d-mtpt5" (UID: "6aa5ad3e-945a-47b3-be93-f0ee06ab0574") : secret "router-metrics-certs-default" not found Jul 13 20:19:44.937389 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:44.937314 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:44.937389 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:44.937358 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls podName:df15cdd6-58e8-434a-8f53-e711defd5ee1 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:00.937346745 +0000 UTC m=+67.782970099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mb8gp" (UID: "df15cdd6-58e8-434a-8f53-e711defd5ee1") : secret "cluster-monitoring-operator-tls" not found Jul 13 20:19:45.038347 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:45.038321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:19:45.038463 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:45.038381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:19:45.038463 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:45.038434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:19:45.038463 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:45.038440 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 20:19:45.038596 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:45.038468 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 20:19:45.038596 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:45.038491 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls podName:e357c558-9aee-46e5-8ce5-74272e1560ab nodeName:}" failed. No retries permitted until 2026-07-13 20:20:01.03847865 +0000 UTC m=+67.884101989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls") pod "cluster-samples-operator-65db858894-f4mrv" (UID: "e357c558-9aee-46e5-8ce5-74272e1560ab") : secret "samples-operator-tls" not found Jul 13 20:19:45.038596 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:45.038507 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 20:19:45.038596 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:45.038518 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert podName:2d60f1b4-4230-4b66-9e24-f10be9dd0b2e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:01.038503295 +0000 UTC m=+67.884126633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kmxss" (UID: "2d60f1b4-4230-4b66-9e24-f10be9dd0b2e") : secret "networking-console-plugin-cert" not found Jul 13 20:19:45.038596 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:45.038537 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls podName:ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b nodeName:}" failed. No retries permitted until 2026-07-13 20:20:01.038528392 +0000 UTC m=+67.884151730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls") pod "dns-default-xt9sl" (UID: "ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b") : secret "dns-default-metrics-tls" not found Jul 13 20:19:47.859456 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:47.859423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:47.859984 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:47.859467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:47.859984 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:47.859572 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 20:19:47.859984 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:47.859634 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls podName:a9bcfb11-121a-4350-a1ed-c3fabc0e484e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:55.859618688 +0000 UTC m=+62.705242028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8l48" (UID: "a9bcfb11-121a-4350-a1ed-c3fabc0e484e") : secret "insights-runtime-extractor-tls" not found Jul 13 20:19:47.860123 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:47.860007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:49.459049 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:49.459013 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:49.459453 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:49.459077 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:49.459453 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:49.459393 2579 scope.go:117] "RemoveContainer" containerID="301f2291e3c542464df189f65145de467feeba66cc9e4145a5f065c13b0c5a6e" Jul 13 20:19:49.830310 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:49.830284 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:19:49.830746 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:49.830722 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/1.log" Jul 13 20:19:49.830873 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:49.830767 2579 generic.go:356] "Generic (PLEG): container finished" podID="ac2aa198-e44e-421a-b230-f1151d0a5845" containerID="d62d54b9603d2e74261c883a22b6deba7c67b9a54d9a206bb8b583b60362b3ea" exitCode=255 Jul 13 20:19:49.830873 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:49.830826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ds7x7" event={"ID":"ac2aa198-e44e-421a-b230-f1151d0a5845","Type":"ContainerDied","Data":"d62d54b9603d2e74261c883a22b6deba7c67b9a54d9a206bb8b583b60362b3ea"} Jul 13 20:19:49.830960 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:49.830897 2579 scope.go:117] "RemoveContainer" containerID="301f2291e3c542464df189f65145de467feeba66cc9e4145a5f065c13b0c5a6e" Jul 13 20:19:49.831255 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:49.831237 2579 scope.go:117] "RemoveContainer" containerID="d62d54b9603d2e74261c883a22b6deba7c67b9a54d9a206bb8b583b60362b3ea" Jul 13 20:19:49.831421 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:49.831401 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-ds7x7_openshift-console-operator(ac2aa198-e44e-421a-b230-f1151d0a5845)\"" pod="openshift-console-operator/console-operator-7866497494-ds7x7" podUID="ac2aa198-e44e-421a-b230-f1151d0a5845" Jul 13 20:19:50.835328 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:50.835305 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:19:54.688043 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:54.688015 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vz2w" Jul 13 20:19:55.923359 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:55.923326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:55.925506 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:55.925486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9bcfb11-121a-4350-a1ed-c3fabc0e484e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8l48\" (UID: \"a9bcfb11-121a-4350-a1ed-c3fabc0e484e\") " pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:56.032592 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:56.032558 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4rrll\"" Jul 13 20:19:56.040356 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:56.040334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8l48" Jul 13 20:19:56.168893 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:56.168863 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8l48"] Jul 13 20:19:56.171870 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:19:56.171846 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9bcfb11_121a_4350_a1ed_c3fabc0e484e.slice/crio-c1370cd1d1a49d2a9c1e01c2945cf6ea1c1bb449c5fabf5a755fc1d600875903 WatchSource:0}: Error finding container c1370cd1d1a49d2a9c1e01c2945cf6ea1c1bb449c5fabf5a755fc1d600875903: Status 404 returned error can't find the container with id c1370cd1d1a49d2a9c1e01c2945cf6ea1c1bb449c5fabf5a755fc1d600875903 Jul 13 20:19:56.856619 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:56.856583 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8l48" event={"ID":"a9bcfb11-121a-4350-a1ed-c3fabc0e484e","Type":"ContainerStarted","Data":"c1370cd1d1a49d2a9c1e01c2945cf6ea1c1bb449c5fabf5a755fc1d600875903"} Jul 13 20:19:58.647610 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:58.647568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:58.648018 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:58.647679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:58.650290 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:58.650263 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 20:19:58.650586 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:58.650565 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9nrg\" (UniqueName: \"kubernetes.io/projected/369082c4-9db4-4aa2-9327-6f87a74fb81b-kube-api-access-z9nrg\") pod \"network-check-target-b757q\" (UID: \"369082c4-9db4-4aa2-9327-6f87a74fb81b\") " pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:58.660358 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:58.660335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9a31a5-740a-49f7-a36a-e0fc8cc83df2-metrics-certs\") pod \"network-metrics-daemon-fgd98\" (UID: \"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2\") " pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:58.854441 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:58.854410 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhkt5\"" Jul 13 20:19:58.861178 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:58.861150 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:19:58.952274 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:58.952204 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dwnrg\"" Jul 13 20:19:58.960079 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:58.960037 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgd98" Jul 13 20:19:59.459108 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:59.459072 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:59.459295 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:59.459129 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:19:59.459596 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:19:59.459496 2579 scope.go:117] "RemoveContainer" containerID="d62d54b9603d2e74261c883a22b6deba7c67b9a54d9a206bb8b583b60362b3ea" Jul 13 20:19:59.459706 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:19:59.459669 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-ds7x7_openshift-console-operator(ac2aa198-e44e-421a-b230-f1151d0a5845)\"" pod="openshift-console-operator/console-operator-7866497494-ds7x7" podUID="ac2aa198-e44e-421a-b230-f1151d0a5845" Jul 13 20:20:00.258403 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.258370 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fgd98"] Jul 13 20:20:00.473756 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:00.473686 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9a31a5_740a_49f7_a36a_e0fc8cc83df2.slice/crio-e1efe28fa79babac1eab9fa74b4b4ae19d4405ee95c605a4422ddf661b04bc11 WatchSource:0}: Error finding container e1efe28fa79babac1eab9fa74b4b4ae19d4405ee95c605a4422ddf661b04bc11: Status 404 returned error can't find the container with id e1efe28fa79babac1eab9fa74b4b4ae19d4405ee95c605a4422ddf661b04bc11 Jul 13 20:20:00.598021 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.597989 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b757q"] Jul 13 20:20:00.598204 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:00.598181 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369082c4_9db4_4aa2_9327_6f87a74fb81b.slice/crio-a0869e00b1cb3b31dbee7106a595ab0bc71d47d5e1c5426edcecbfa1ff53990d WatchSource:0}: Error finding container a0869e00b1cb3b31dbee7106a595ab0bc71d47d5e1c5426edcecbfa1ff53990d: Status 404 returned error can't find the container with id a0869e00b1cb3b31dbee7106a595ab0bc71d47d5e1c5426edcecbfa1ff53990d Jul 13 20:20:00.870595 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.870561 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fgd98" event={"ID":"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2","Type":"ContainerStarted","Data":"e1efe28fa79babac1eab9fa74b4b4ae19d4405ee95c605a4422ddf661b04bc11"} Jul 13 20:20:00.871880 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.871849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b757q" event={"ID":"369082c4-9db4-4aa2-9327-6f87a74fb81b","Type":"ContainerStarted","Data":"8ca375a0d1c7e066ecd16421280bf890e2483b43ff097066ef49951fc204f8ef"} Jul 13 20:20:00.872001 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.871899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b757q" event={"ID":"369082c4-9db4-4aa2-9327-6f87a74fb81b","Type":"ContainerStarted","Data":"a0869e00b1cb3b31dbee7106a595ab0bc71d47d5e1c5426edcecbfa1ff53990d"} Jul 13 20:20:00.872081 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.871991 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:20:00.873236 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.873212 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8l48" event={"ID":"a9bcfb11-121a-4350-a1ed-c3fabc0e484e","Type":"ContainerStarted","Data":"488903ced89002bf0ca770f5cdc4473db0847bde34e484da6ea104010da42c39"} Jul 13 20:20:00.890439 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.890399 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b757q" podStartSLOduration=66.890385733 podStartE2EDuration="1m6.890385733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:00.889411567 +0000 UTC m=+67.735034929" watchObservedRunningTime="2026-07-13 20:20:00.890385733 +0000 UTC m=+67.736009094" Jul 13 20:20:00.968231 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.968201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:20:00.968369 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.968264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:20:00.968369 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.968318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:20:00.968486 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.968400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:20:00.969037 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.969010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-service-ca-bundle\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:20:00.971083 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.971028 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"image-registry-7c87cb8479-5vqw8\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:20:00.971180 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.971095 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df15cdd6-58e8-434a-8f53-e711defd5ee1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mb8gp\" (UID: \"df15cdd6-58e8-434a-8f53-e711defd5ee1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:20:00.971180 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:00.971151 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa5ad3e-945a-47b3-be93-f0ee06ab0574-metrics-certs\") pod \"router-default-7566899d6d-mtpt5\" (UID: \"6aa5ad3e-945a-47b3-be93-f0ee06ab0574\") " pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:20:01.069394 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.069356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:20:01.069536 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.069433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:20:01.069536 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.069488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:20:01.072121 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.072094 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b-metrics-tls\") pod \"dns-default-xt9sl\" (UID: \"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b\") " pod="openshift-dns/dns-default-xt9sl" Jul 13 20:20:01.072237 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.072144 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d60f1b4-4230-4b66-9e24-f10be9dd0b2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kmxss\" (UID: \"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:20:01.072542 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.072523 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e357c558-9aee-46e5-8ce5-74272e1560ab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-f4mrv\" (UID: \"e357c558-9aee-46e5-8ce5-74272e1560ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:20:01.170442 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.170375 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cj8kp\"" Jul 13 20:20:01.178304 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.178274 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:20:01.197918 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.197891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6srxk\"" Jul 13 20:20:01.204361 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.204339 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r4vm2\"" Jul 13 20:20:01.205845 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.205818 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" Jul 13 20:20:01.212596 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.212579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:20:01.214594 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.214574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26pr8\"" Jul 13 20:20:01.223122 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.223106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xt9sl" Jul 13 20:20:01.237603 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.237586 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sw84c\"" Jul 13 20:20:01.246303 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.246282 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" Jul 13 20:20:01.272600 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.272571 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pmnlc\"" Jul 13 20:20:01.280445 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.280424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" Jul 13 20:20:01.756863 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.756835 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xt9sl"] Jul 13 20:20:01.766018 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:01.765993 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8c9f73_8d8a_4cc7_95ac_3a7ea1d5172b.slice/crio-1254fbeac8c38cfce862a69498db1e2d295a7ae066750c3962d52f21b9142168 WatchSource:0}: Error finding container 1254fbeac8c38cfce862a69498db1e2d295a7ae066750c3962d52f21b9142168: Status 404 returned error can't find the container with id 1254fbeac8c38cfce862a69498db1e2d295a7ae066750c3962d52f21b9142168 Jul 13 20:20:01.774335 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.774309 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c87cb8479-5vqw8"] Jul 13 20:20:01.776413 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.776393 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv"] Jul 13 20:20:01.779509 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.779488 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7566899d6d-mtpt5"] Jul 13 20:20:01.781209 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:01.781020 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea75151b_f8c7_4f82_8290_620dd4f0c045.slice/crio-b69f0ee85da6d30d0541988a6463c84a7cb98095e4b3b8b04fb47ddeff6f1217 WatchSource:0}: Error finding container b69f0ee85da6d30d0541988a6463c84a7cb98095e4b3b8b04fb47ddeff6f1217: Status 404 returned error can't find the container with id b69f0ee85da6d30d0541988a6463c84a7cb98095e4b3b8b04fb47ddeff6f1217 Jul 13 20:20:01.783632 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:01.783604 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa5ad3e_945a_47b3_be93_f0ee06ab0574.slice/crio-7e0e21a935758ed0701018c4b9285e50bf2e79ab6fcc418ba78b1a3c49649881 WatchSource:0}: Error finding container 7e0e21a935758ed0701018c4b9285e50bf2e79ab6fcc418ba78b1a3c49649881: Status 404 returned error can't find the container with id 7e0e21a935758ed0701018c4b9285e50bf2e79ab6fcc418ba78b1a3c49649881 Jul 13 20:20:01.877847 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.877822 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xt9sl" event={"ID":"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b","Type":"ContainerStarted","Data":"1254fbeac8c38cfce862a69498db1e2d295a7ae066750c3962d52f21b9142168"} Jul 13 20:20:01.879195 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.879167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" event={"ID":"e357c558-9aee-46e5-8ce5-74272e1560ab","Type":"ContainerStarted","Data":"d7b8e44762312e1b0f1d8620807e11545d4256926d37ea1a920d6cb428878475"} Jul 13 20:20:01.881083 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.880955 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8l48" event={"ID":"a9bcfb11-121a-4350-a1ed-c3fabc0e484e","Type":"ContainerStarted","Data":"633ae9df1a80d9f10ad4783f59fd72365a61384d36fff0445f05543d113ee34b"} Jul 13 20:20:01.882792 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.882769 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fgd98" event={"ID":"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2","Type":"ContainerStarted","Data":"7e278fea343097caa43926c8117de512307505944c1009b6aabe6ca31663ad03"} Jul 13 20:20:01.882873 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.882815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fgd98" event={"ID":"4e9a31a5-740a-49f7-a36a-e0fc8cc83df2","Type":"ContainerStarted","Data":"2508500e7c91fc8166b7967b8669666dbe4023606e740e502e028710bf995d02"} Jul 13 20:20:01.883815 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.883794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7566899d6d-mtpt5" event={"ID":"6aa5ad3e-945a-47b3-be93-f0ee06ab0574","Type":"ContainerStarted","Data":"7e0e21a935758ed0701018c4b9285e50bf2e79ab6fcc418ba78b1a3c49649881"} Jul 13 20:20:01.885199 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.885182 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" event={"ID":"ea75151b-f8c7-4f82-8290-620dd4f0c045","Type":"ContainerStarted","Data":"b69f0ee85da6d30d0541988a6463c84a7cb98095e4b3b8b04fb47ddeff6f1217"} Jul 13 20:20:01.907535 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.907489 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fgd98" podStartSLOduration=66.903180355 podStartE2EDuration="1m7.907472827s" totalImagesPullingTime="1.004292472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:01.906039569 +0000 UTC m=+68.751662957" watchObservedRunningTime="2026-07-13 20:20:01.907472827 +0000 UTC m=+68.753096187" Jul 13 20:20:01.983137 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.981105 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-kmxss"] Jul 13 20:20:01.985201 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:01.985177 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp"] Jul 13 20:20:01.987467 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:01.987443 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d60f1b4_4230_4b66_9e24_f10be9dd0b2e.slice/crio-982cb555e2a0248ea722f031a60aabd32d5b973aee773f6e7a6637e47ca67684 WatchSource:0}: Error finding container 982cb555e2a0248ea722f031a60aabd32d5b973aee773f6e7a6637e47ca67684: Status 404 returned error can't find the container with id 982cb555e2a0248ea722f031a60aabd32d5b973aee773f6e7a6637e47ca67684 Jul 13 20:20:01.988671 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:01.988648 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf15cdd6_58e8_434a_8f53_e711defd5ee1.slice/crio-6c582fc386a952a626b1a57760c666853697e1caea2dc3e161e01ad67b8773fc WatchSource:0}: Error finding container 6c582fc386a952a626b1a57760c666853697e1caea2dc3e161e01ad67b8773fc: Status 404 returned error can't find the container with id 6c582fc386a952a626b1a57760c666853697e1caea2dc3e161e01ad67b8773fc Jul 13 20:20:02.894155 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:02.894076 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" event={"ID":"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e","Type":"ContainerStarted","Data":"982cb555e2a0248ea722f031a60aabd32d5b973aee773f6e7a6637e47ca67684"} Jul 13 20:20:02.897127 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:02.897092 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7566899d6d-mtpt5" event={"ID":"6aa5ad3e-945a-47b3-be93-f0ee06ab0574","Type":"ContainerStarted","Data":"14691f86f42cca77a519dc5e8ba865abf2d71fa09afff5cace900483da3d5e0a"} Jul 13 20:20:02.899390 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:02.899363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" event={"ID":"ea75151b-f8c7-4f82-8290-620dd4f0c045","Type":"ContainerStarted","Data":"e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5"} Jul 13 20:20:02.899900 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:02.899841 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:20:02.901884 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:02.901843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" event={"ID":"df15cdd6-58e8-434a-8f53-e711defd5ee1","Type":"ContainerStarted","Data":"6c582fc386a952a626b1a57760c666853697e1caea2dc3e161e01ad67b8773fc"} Jul 13 20:20:02.919381 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:02.919324 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7566899d6d-mtpt5" podStartSLOduration=45.919303967 podStartE2EDuration="45.919303967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:02.91791307 +0000 UTC m=+69.763536431" watchObservedRunningTime="2026-07-13 20:20:02.919303967 +0000 UTC m=+69.764927328" Jul 13 20:20:02.943522 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:02.943396 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" podStartSLOduration=67.943375925 podStartE2EDuration="1m7.943375925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:18:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:02.942088694 +0000 UTC m=+69.787712057" watchObservedRunningTime="2026-07-13 20:20:02.943375925 +0000 UTC m=+69.788999287" Jul 13 20:20:03.213839 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:03.213755 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:20:03.217079 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:03.217043 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:20:03.906069 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:03.905986 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:20:03.907531 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:03.907494 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7566899d6d-mtpt5" Jul 13 20:20:07.924299 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.924213 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8l48" event={"ID":"a9bcfb11-121a-4350-a1ed-c3fabc0e484e","Type":"ContainerStarted","Data":"2e6ebeaa9cfb1758365c70c65918e134cdde883353e62356b306c09a2182920f"} Jul 13 20:20:07.925874 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.925847 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" event={"ID":"df15cdd6-58e8-434a-8f53-e711defd5ee1","Type":"ContainerStarted","Data":"560edf99285672b26832c62cfd34ce44dc905786c1e29ac9d6e7a85f15a69337"} Jul 13 20:20:07.927727 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.927699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xt9sl" event={"ID":"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b","Type":"ContainerStarted","Data":"22ad56f3bd94061d841e60d0b8331a4afbb9a276939b5e40bba9d64dbfc3e350"} Jul 13 20:20:07.927840 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.927747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xt9sl" event={"ID":"ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b","Type":"ContainerStarted","Data":"c90157d6eb9d05721b4a3f47d2094448ff484743d7b9411e1211e1b357976252"} Jul 13 20:20:07.927840 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.927775 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xt9sl" Jul 13 20:20:07.929437 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.929404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" event={"ID":"e357c558-9aee-46e5-8ce5-74272e1560ab","Type":"ContainerStarted","Data":"a08ae2a8d1110fca92987867a6d234ae5275c9b220d8739aaae6ff79897373a7"} Jul 13 20:20:07.929557 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.929455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" event={"ID":"e357c558-9aee-46e5-8ce5-74272e1560ab","Type":"ContainerStarted","Data":"76fc10fd6aba51773975997abc3aff591765ce5bd0ff34566697ba63961ec777"} Jul 13 20:20:07.930943 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.930923 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" event={"ID":"2d60f1b4-4230-4b66-9e24-f10be9dd0b2e","Type":"ContainerStarted","Data":"c17e139bd9e0b4225e1d4d7fce89b37e774e282d67f9f57622554ee95d2ff551"} Jul 13 20:20:07.944843 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.944802 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h8l48" podStartSLOduration=17.091519025 podStartE2EDuration="27.944783974s" totalImagesPullingTime="10.853264949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:07.943947913 +0000 UTC m=+74.789571287" watchObservedRunningTime="2026-07-13 20:20:07.944783974 +0000 UTC m=+74.790407336" Jul 13 20:20:07.959524 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.959463 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-kmxss" podStartSLOduration=42.729682881 podStartE2EDuration="47.959445755s" totalImagesPullingTime="5.229762874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:07.958692343 +0000 UTC m=+74.804315727" watchObservedRunningTime="2026-07-13 20:20:07.959445755 +0000 UTC m=+74.805069117" Jul 13 20:20:07.981539 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.981481 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xt9sl" podStartSLOduration=33.530358834 podStartE2EDuration="38.981465013s" totalImagesPullingTime="5.451106179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:07.97937061 +0000 UTC m=+74.824994008" watchObservedRunningTime="2026-07-13 20:20:07.981465013 +0000 UTC m=+74.827088376" Jul 13 20:20:07.996545 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:07.996500 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" podStartSLOduration=45.415863194 podStartE2EDuration="50.996485569s" totalImagesPullingTime="5.580622375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:07.996241938 +0000 UTC m=+74.841865323" watchObservedRunningTime="2026-07-13 20:20:07.996485569 +0000 UTC m=+74.842108929" Jul 13 20:20:08.014493 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:08.014440 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-f4mrv" podStartSLOduration=45.623931715 podStartE2EDuration="51.01441954s" totalImagesPullingTime="5.390487825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:08.013772569 +0000 UTC m=+74.859395930" watchObservedRunningTime="2026-07-13 20:20:08.01441954 +0000 UTC m=+74.860042904" Jul 13 20:20:12.439660 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:12.439627 2579 scope.go:117] "RemoveContainer" containerID="d62d54b9603d2e74261c883a22b6deba7c67b9a54d9a206bb8b583b60362b3ea" Jul 13 20:20:12.950543 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:12.950517 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:20:12.950708 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:12.950592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ds7x7" event={"ID":"ac2aa198-e44e-421a-b230-f1151d0a5845","Type":"ContainerStarted","Data":"04c88f34443a0ad615fadbc0148d481d7bcefefd25623c5a3d416d77329604d8"} Jul 13 20:20:12.950892 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:12.950872 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:20:12.976035 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:12.975981 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-ds7x7" podStartSLOduration=48.519047485 podStartE2EDuration="55.97596642s" totalImagesPullingTime="7.456918935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:12.975365339 +0000 UTC m=+79.820988699" watchObservedRunningTime="2026-07-13 20:20:12.97596642 +0000 UTC m=+79.821589780" Jul 13 20:20:13.210141 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.210043 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-ds7x7" Jul 13 20:20:13.487545 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.487509 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-6lrjk"] Jul 13 20:20:13.489495 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.489479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-6lrjk" Jul 13 20:20:13.492947 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.492924 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 20:20:13.493890 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.493861 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nqzxc\"" Jul 13 20:20:13.494014 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.493994 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 20:20:13.502612 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.502585 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-6lrjk"] Jul 13 20:20:13.573517 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.573483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcv9r\" (UniqueName: \"kubernetes.io/projected/1cec0934-fcfd-4c11-9705-d15fe19fc6dd-kube-api-access-kcv9r\") pod \"downloads-68c9cbb497-6lrjk\" (UID: \"1cec0934-fcfd-4c11-9705-d15fe19fc6dd\") " pod="openshift-console/downloads-68c9cbb497-6lrjk" Jul 13 20:20:13.674725 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.674685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcv9r\" (UniqueName: \"kubernetes.io/projected/1cec0934-fcfd-4c11-9705-d15fe19fc6dd-kube-api-access-kcv9r\") pod \"downloads-68c9cbb497-6lrjk\" (UID: \"1cec0934-fcfd-4c11-9705-d15fe19fc6dd\") " pod="openshift-console/downloads-68c9cbb497-6lrjk" Jul 13 20:20:13.688947 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.688923 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcv9r\" (UniqueName: \"kubernetes.io/projected/1cec0934-fcfd-4c11-9705-d15fe19fc6dd-kube-api-access-kcv9r\") pod \"downloads-68c9cbb497-6lrjk\" (UID: \"1cec0934-fcfd-4c11-9705-d15fe19fc6dd\") " pod="openshift-console/downloads-68c9cbb497-6lrjk" Jul 13 20:20:13.801364 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.801269 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-6lrjk" Jul 13 20:20:13.934845 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.934820 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-6lrjk"] Jul 13 20:20:13.936769 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:13.936742 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cec0934_fcfd_4c11_9705_d15fe19fc6dd.slice/crio-a889c8521d23a422d7e95c4494253c7677ad7f80f45f4621bf2e85f49caf5568 WatchSource:0}: Error finding container a889c8521d23a422d7e95c4494253c7677ad7f80f45f4621bf2e85f49caf5568: Status 404 returned error can't find the container with id a889c8521d23a422d7e95c4494253c7677ad7f80f45f4621bf2e85f49caf5568 Jul 13 20:20:13.956246 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:13.956217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-6lrjk" event={"ID":"1cec0934-fcfd-4c11-9705-d15fe19fc6dd","Type":"ContainerStarted","Data":"a889c8521d23a422d7e95c4494253c7677ad7f80f45f4621bf2e85f49caf5568"} Jul 13 20:20:17.863028 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.862882 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr"] Jul 13 20:20:17.896143 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.896108 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr"] Jul 13 20:20:17.896369 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.896194 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:17.897246 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.897223 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-csk48"] Jul 13 20:20:17.898696 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.898650 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 20:20:17.899240 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.899223 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zls4c\"" Jul 13 20:20:17.899337 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.899219 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 13 20:20:17.899659 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.899639 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 13 20:20:17.910038 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.910019 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:17.917439 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.917232 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 13 20:20:17.917439 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.917398 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 13 20:20:17.917998 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.917944 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 13 20:20:17.919348 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.919198 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sp59r\"" Jul 13 20:20:17.919867 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.919844 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-csk48"] Jul 13 20:20:17.935495 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.935460 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lpc6h"] Jul 13 20:20:17.950858 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.950833 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xt9sl" Jul 13 20:20:17.950980 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.950936 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:17.953980 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.953962 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9nxr9\"" Jul 13 20:20:17.957449 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.957214 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 20:20:17.957449 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.957335 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 20:20:17.957626 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:17.957531 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 20:20:18.009374 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsvrc\" (UniqueName: \"kubernetes.io/projected/1cce3fca-53fc-458d-970d-e0c8032a0dbe-kube-api-access-qsvrc\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.009544 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/799006dd-374b-4520-85c8-ed8c12010b6c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.009544 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cce3fca-53fc-458d-970d-e0c8032a0dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.009656 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009549 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/799006dd-374b-4520-85c8-ed8c12010b6c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.009656 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/799006dd-374b-4520-85c8-ed8c12010b6c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.009656 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldr2n\" (UniqueName: \"kubernetes.io/projected/799006dd-374b-4520-85c8-ed8c12010b6c-kube-api-access-ldr2n\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.009806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/799006dd-374b-4520-85c8-ed8c12010b6c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.009806 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799006dd-374b-4520-85c8-ed8c12010b6c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.009908 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cce3fca-53fc-458d-970d-e0c8032a0dbe-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.009908 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.009832 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cce3fca-53fc-458d-970d-e0c8032a0dbe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.111139 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7795fa4-64a1-480b-b223-b7ae3866ddf0-sys\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.111139 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7795fa4-64a1-480b-b223-b7ae3866ddf0-metrics-client-ca\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.111373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111162 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7795fa4-64a1-480b-b223-b7ae3866ddf0-root\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.111373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799006dd-374b-4520-85c8-ed8c12010b6c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.111373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cce3fca-53fc-458d-970d-e0c8032a0dbe-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.111373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cce3fca-53fc-458d-970d-e0c8032a0dbe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.111373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-wtmp\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.111373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-tls\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.111677 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsvrc\" (UniqueName: \"kubernetes.io/projected/1cce3fca-53fc-458d-970d-e0c8032a0dbe-kube-api-access-qsvrc\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.111677 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhnjg\" (UniqueName: \"kubernetes.io/projected/d7795fa4-64a1-480b-b223-b7ae3866ddf0-kube-api-access-dhnjg\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.111677 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.111677 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/799006dd-374b-4520-85c8-ed8c12010b6c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.111677 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.111677 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cce3fca-53fc-458d-970d-e0c8032a0dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.111677 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/799006dd-374b-4520-85c8-ed8c12010b6c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.111677 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/799006dd-374b-4520-85c8-ed8c12010b6c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.111677 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldr2n\" (UniqueName: \"kubernetes.io/projected/799006dd-374b-4520-85c8-ed8c12010b6c-kube-api-access-ldr2n\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.111984 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-textfile\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.111984 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/799006dd-374b-4520-85c8-ed8c12010b6c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.111984 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799006dd-374b-4520-85c8-ed8c12010b6c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.111984 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.111940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cce3fca-53fc-458d-970d-e0c8032a0dbe-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.112203 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.112161 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/799006dd-374b-4520-85c8-ed8c12010b6c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.112989 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.112925 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/799006dd-374b-4520-85c8-ed8c12010b6c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.115048 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.114985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cce3fca-53fc-458d-970d-e0c8032a0dbe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.115048 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.114992 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/799006dd-374b-4520-85c8-ed8c12010b6c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.115394 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.115377 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/799006dd-374b-4520-85c8-ed8c12010b6c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.115434 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.115408 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cce3fca-53fc-458d-970d-e0c8032a0dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.121433 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.121409 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldr2n\" (UniqueName: \"kubernetes.io/projected/799006dd-374b-4520-85c8-ed8c12010b6c-kube-api-access-ldr2n\") pod \"kube-state-metrics-785778ff74-csk48\" (UID: \"799006dd-374b-4520-85c8-ed8c12010b6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.121433 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.121420 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsvrc\" (UniqueName: \"kubernetes.io/projected/1cce3fca-53fc-458d-970d-e0c8032a0dbe-kube-api-access-qsvrc\") pod \"openshift-state-metrics-84bd68b896-4n2rr\" (UID: \"1cce3fca-53fc-458d-970d-e0c8032a0dbe\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.209147 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.209117 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" Jul 13 20:20:18.212945 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.212918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-textfile\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213078 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.212968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7795fa4-64a1-480b-b223-b7ae3866ddf0-sys\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213078 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7795fa4-64a1-480b-b223-b7ae3866ddf0-sys\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213206 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7795fa4-64a1-480b-b223-b7ae3866ddf0-metrics-client-ca\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213206 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7795fa4-64a1-480b-b223-b7ae3866ddf0-root\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213206 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-wtmp\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213445 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-tls\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213445 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhnjg\" (UniqueName: \"kubernetes.io/projected/d7795fa4-64a1-480b-b223-b7ae3866ddf0-kube-api-access-dhnjg\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213445 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213273 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7795fa4-64a1-480b-b223-b7ae3866ddf0-root\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213445 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213298 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-textfile\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213445 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213445 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213361 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-wtmp\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213445 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.213940 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.213917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.214044 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.214004 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7795fa4-64a1-480b-b223-b7ae3866ddf0-metrics-client-ca\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.216156 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.216137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.216257 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.216134 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7795fa4-64a1-480b-b223-b7ae3866ddf0-node-exporter-tls\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.220124 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.220098 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" Jul 13 20:20:18.221993 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.221975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhnjg\" (UniqueName: \"kubernetes.io/projected/d7795fa4-64a1-480b-b223-b7ae3866ddf0-kube-api-access-dhnjg\") pod \"node-exporter-lpc6h\" (UID: \"d7795fa4-64a1-480b-b223-b7ae3866ddf0\") " pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.261759 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.261415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpc6h" Jul 13 20:20:18.277455 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:18.276814 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7795fa4_64a1_480b_b223_b7ae3866ddf0.slice/crio-d5d6cc9e5761610d2f4c536a80fe06e0d3ae6ea66e6e9f1011f505141e53ab50 WatchSource:0}: Error finding container d5d6cc9e5761610d2f4c536a80fe06e0d3ae6ea66e6e9f1011f505141e53ab50: Status 404 returned error can't find the container with id d5d6cc9e5761610d2f4c536a80fe06e0d3ae6ea66e6e9f1011f505141e53ab50 Jul 13 20:20:18.366704 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.366637 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr"] Jul 13 20:20:18.370071 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:18.370027 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cce3fca_53fc_458d_970d_e0c8032a0dbe.slice/crio-023c1489792467c4b1c76d37f737dcbc981afad9a2699cd9e6aafb4896286372 WatchSource:0}: Error finding container 023c1489792467c4b1c76d37f737dcbc981afad9a2699cd9e6aafb4896286372: Status 404 returned error can't find the container with id 023c1489792467c4b1c76d37f737dcbc981afad9a2699cd9e6aafb4896286372 Jul 13 20:20:18.398963 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.398887 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-csk48"] Jul 13 20:20:18.403389 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:18.403358 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799006dd_374b_4520_85c8_ed8c12010b6c.slice/crio-e7a61381f7e5f2037a35d134fd99243a5538b9d197c09879094893cb704e7f27 WatchSource:0}: Error finding container e7a61381f7e5f2037a35d134fd99243a5538b9d197c09879094893cb704e7f27: Status 404 returned error can't find the container with id e7a61381f7e5f2037a35d134fd99243a5538b9d197c09879094893cb704e7f27 Jul 13 20:20:18.981122 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.981083 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpc6h" event={"ID":"d7795fa4-64a1-480b-b223-b7ae3866ddf0","Type":"ContainerStarted","Data":"d5d6cc9e5761610d2f4c536a80fe06e0d3ae6ea66e6e9f1011f505141e53ab50"} Jul 13 20:20:18.982641 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.982614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" event={"ID":"799006dd-374b-4520-85c8-ed8c12010b6c","Type":"ContainerStarted","Data":"e7a61381f7e5f2037a35d134fd99243a5538b9d197c09879094893cb704e7f27"} Jul 13 20:20:18.985027 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.984982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" event={"ID":"1cce3fca-53fc-458d-970d-e0c8032a0dbe","Type":"ContainerStarted","Data":"9bec0964d8d8f1e841d3c4f63d29863338c254aefbeeddb567ea0ccec4265dd0"} Jul 13 20:20:18.985183 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.985037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" event={"ID":"1cce3fca-53fc-458d-970d-e0c8032a0dbe","Type":"ContainerStarted","Data":"1791b4f567904bf73ef70c4b57980c17b67e94c021d515d1694d985a26252b04"} Jul 13 20:20:18.985183 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:18.985089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" event={"ID":"1cce3fca-53fc-458d-970d-e0c8032a0dbe","Type":"ContainerStarted","Data":"023c1489792467c4b1c76d37f737dcbc981afad9a2699cd9e6aafb4896286372"} Jul 13 20:20:19.992733 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:19.992558 2579 generic.go:356] "Generic (PLEG): container finished" podID="d7795fa4-64a1-480b-b223-b7ae3866ddf0" containerID="34deb5edc281bb55c513a9326a57846f0dac2d5e7297cd9d509430d8391d5b28" exitCode=0 Jul 13 20:20:19.992733 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:19.992674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpc6h" event={"ID":"d7795fa4-64a1-480b-b223-b7ae3866ddf0","Type":"ContainerDied","Data":"34deb5edc281bb55c513a9326a57846f0dac2d5e7297cd9d509430d8391d5b28"} Jul 13 20:20:20.999764 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:20.999730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpc6h" event={"ID":"d7795fa4-64a1-480b-b223-b7ae3866ddf0","Type":"ContainerStarted","Data":"5a65a1966bbdd548bc3d55fc487f58cee5dacd39e0d0335f244bb93b11178a19"} Jul 13 20:20:21.000248 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:20.999798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpc6h" event={"ID":"d7795fa4-64a1-480b-b223-b7ae3866ddf0","Type":"ContainerStarted","Data":"27b679ca7b2e41eb832216885f0964efc49e7f899f653e24089e8d6bf022ea1d"} Jul 13 20:20:21.002723 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:21.002693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" event={"ID":"799006dd-374b-4520-85c8-ed8c12010b6c","Type":"ContainerStarted","Data":"3676ac2f97ce11075f8251f58f85642522ce71f5704867fd5c3d4d70e60dff7e"} Jul 13 20:20:21.002857 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:21.002761 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" event={"ID":"799006dd-374b-4520-85c8-ed8c12010b6c","Type":"ContainerStarted","Data":"6583bd3b1850d5ec6eb1cccc6dc2330aad2b8f429339810f3f8ecce90fa85041"} Jul 13 20:20:21.002857 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:21.002809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" event={"ID":"799006dd-374b-4520-85c8-ed8c12010b6c","Type":"ContainerStarted","Data":"c9c7a8856dcd3f52e844e303c9d8270ffd3c4ef557e057ef0c18780a1d3f6577"} Jul 13 20:20:21.006224 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:21.006202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" event={"ID":"1cce3fca-53fc-458d-970d-e0c8032a0dbe","Type":"ContainerStarted","Data":"3dbc7d5b482cacfba955879496690dc74f51e1aa4f437ff51c6bfed4ae92b471"} Jul 13 20:20:21.026305 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:21.025516 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lpc6h" podStartSLOduration=3.007600482 podStartE2EDuration="4.025496353s" totalImagesPullingTime="937.015345ms" totalInitContainerRuntime="80.880526ms" isStatefulPod=true podCreationTimestamp="2026-07-13 20:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:21.023505713 +0000 UTC m=+87.869129075" watchObservedRunningTime="2026-07-13 20:20:21.025496353 +0000 UTC m=+87.871119715" Jul 13 20:20:21.047543 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:21.047492 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-csk48" podStartSLOduration=2.125501356 podStartE2EDuration="4.0474725s" totalImagesPullingTime="1.921971144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:21.045703138 +0000 UTC m=+87.891326525" watchObservedRunningTime="2026-07-13 20:20:21.0474725 +0000 UTC m=+87.893095861" Jul 13 20:20:24.916650 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:24.916618 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:20:25.193464 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.193352 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4n2rr" podStartSLOduration=6.378253443 podStartE2EDuration="8.19332957s" totalImagesPullingTime="1.815076127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:21.067865312 +0000 UTC m=+87.913488675" watchObservedRunningTime="2026-07-13 20:20:25.19332957 +0000 UTC m=+92.038952932" Jul 13 20:20:25.348807 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.348771 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-859b66569f-58chr"] Jul 13 20:20:25.353360 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.353337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.356261 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.356239 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 20:20:25.356382 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.356244 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 20:20:25.356382 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.356245 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 20:20:25.356953 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.356934 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gk5tl\"" Jul 13 20:20:25.357049 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.357004 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 20:20:25.357369 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.357353 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 20:20:25.365563 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.365544 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 20:20:25.369674 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.369628 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859b66569f-58chr"] Jul 13 20:20:25.483456 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.483409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-trusted-ca-bundle\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.483636 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.483464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b992t\" (UniqueName: \"kubernetes.io/projected/bff97783-3262-43cb-bc06-392b9e1a3a59-kube-api-access-b992t\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.483636 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.483502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-console-config\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.483636 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.483617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-serving-cert\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.483769 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.483685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-oauth-serving-cert\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.483769 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.483747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-oauth-config\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.483864 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.483770 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-service-ca\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.585051 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.585008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-oauth-config\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.585227 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.585085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-service-ca\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.585227 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.585117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-trusted-ca-bundle\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.585227 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.585138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b992t\" (UniqueName: \"kubernetes.io/projected/bff97783-3262-43cb-bc06-392b9e1a3a59-kube-api-access-b992t\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.585227 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.585181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-console-config\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.585417 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.585240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-serving-cert\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.585417 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.585285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-oauth-serving-cert\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.585989 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.585962 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-service-ca\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.586133 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.586091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-trusted-ca-bundle\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.586208 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.586142 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-console-config\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.586208 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.586179 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-oauth-serving-cert\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.587888 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.587865 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-oauth-config\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.588202 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.588180 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-serving-cert\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.594918 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.594876 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b992t\" (UniqueName: \"kubernetes.io/projected/bff97783-3262-43cb-bc06-392b9e1a3a59-kube-api-access-b992t\") pod \"console-859b66569f-58chr\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:25.665933 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:25.665884 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:26.600542 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:26.600507 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c87cb8479-5vqw8"] Jul 13 20:20:30.239576 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:30.239554 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859b66569f-58chr"] Jul 13 20:20:30.250203 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:20:30.250175 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff97783_3262_43cb_bc06_392b9e1a3a59.slice/crio-3efe66114191bb71353bbe4a7a96e912b6bf021e9c0bf7b441206ad5a6fe313c WatchSource:0}: Error finding container 3efe66114191bb71353bbe4a7a96e912b6bf021e9c0bf7b441206ad5a6fe313c: Status 404 returned error can't find the container with id 3efe66114191bb71353bbe4a7a96e912b6bf021e9c0bf7b441206ad5a6fe313c Jul 13 20:20:31.060890 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:31.060845 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859b66569f-58chr" event={"ID":"bff97783-3262-43cb-bc06-392b9e1a3a59","Type":"ContainerStarted","Data":"3efe66114191bb71353bbe4a7a96e912b6bf021e9c0bf7b441206ad5a6fe313c"} Jul 13 20:20:31.064029 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:31.063992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-6lrjk" event={"ID":"1cec0934-fcfd-4c11-9705-d15fe19fc6dd","Type":"ContainerStarted","Data":"20f2a45aea8ddfe9039c198baef4f8e88c50b4091279127df55013e704b486b8"} Jul 13 20:20:31.064517 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:31.064485 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-6lrjk" Jul 13 20:20:31.079542 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:31.079515 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-6lrjk" Jul 13 20:20:31.090561 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:31.089219 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-6lrjk" podStartSLOduration=1.816811506 podStartE2EDuration="18.089203502s" totalImagesPullingTime="16.272391996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:31.088875067 +0000 UTC m=+97.934498428" watchObservedRunningTime="2026-07-13 20:20:31.089203502 +0000 UTC m=+97.934826864" Jul 13 20:20:31.889715 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:31.889685 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b757q" Jul 13 20:20:34.081986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:34.081952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859b66569f-58chr" event={"ID":"bff97783-3262-43cb-bc06-392b9e1a3a59","Type":"ContainerStarted","Data":"1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48"} Jul 13 20:20:35.108660 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:35.108598 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-859b66569f-58chr" podStartSLOduration=6.422221268 podStartE2EDuration="10.108573925s" totalImagesPullingTime="3.686352657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:35.106500911 +0000 UTC m=+101.952124299" watchObservedRunningTime="2026-07-13 20:20:35.108573925 +0000 UTC m=+101.954197287" Jul 13 20:20:35.666558 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:35.666516 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:35.666781 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:35.666656 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:35.672107 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:35.672080 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:36.095347 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:36.095279 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-859b66569f-58chr" Jul 13 20:20:45.128541 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:45.128504 2579 generic.go:356] "Generic (PLEG): container finished" podID="20250b6c-773c-46d9-b14c-9a80426b394c" containerID="8b40474dfeb7125178d655af9049db3ce810ca16682c74e364f6e3aa4f36cc4c" exitCode=0 Jul 13 20:20:45.128930 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:45.128576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" event={"ID":"20250b6c-773c-46d9-b14c-9a80426b394c","Type":"ContainerDied","Data":"8b40474dfeb7125178d655af9049db3ce810ca16682c74e364f6e3aa4f36cc4c"} Jul 13 20:20:45.128974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:45.128929 2579 scope.go:117] "RemoveContainer" containerID="8b40474dfeb7125178d655af9049db3ce810ca16682c74e364f6e3aa4f36cc4c" Jul 13 20:20:46.134228 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:46.134197 2579 generic.go:356] "Generic (PLEG): container finished" podID="15e4ff66-d35c-4539-babb-668bba8ddcfb" containerID="f9a94361882a421113d9bccc18a4386a44935484fe8090e6a259eb91c143809e" exitCode=0 Jul 13 20:20:46.134657 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:46.134269 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" event={"ID":"15e4ff66-d35c-4539-babb-668bba8ddcfb","Type":"ContainerDied","Data":"f9a94361882a421113d9bccc18a4386a44935484fe8090e6a259eb91c143809e"} Jul 13 20:20:46.134728 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:46.134664 2579 scope.go:117] "RemoveContainer" containerID="f9a94361882a421113d9bccc18a4386a44935484fe8090e6a259eb91c143809e" Jul 13 20:20:46.136335 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:46.136315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pclwn" event={"ID":"20250b6c-773c-46d9-b14c-9a80426b394c","Type":"ContainerStarted","Data":"cd9bb40c588b0b493b0e60a0f9f14d2449ec2e11f35183958785235c8ce5c4b4"} Jul 13 20:20:47.142321 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:47.142289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-smt9f" event={"ID":"15e4ff66-d35c-4539-babb-668bba8ddcfb","Type":"ContainerStarted","Data":"3322a57980c0e9b56865a360bd2efd319707a9bc33db12381d549cce74d32a36"} Jul 13 20:20:47.876890 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:47.876858 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859b66569f-58chr"] Jul 13 20:20:51.624250 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:51.624200 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" podUID="ea75151b-f8c7-4f82-8290-620dd4f0c045" containerName="registry" containerID="cri-o://e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5" gracePeriod=30 Jul 13 20:20:51.919734 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:51.919710 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:20:52.031525 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.031500 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea75151b-f8c7-4f82-8290-620dd4f0c045-ca-trust-extracted\") pod \"ea75151b-f8c7-4f82-8290-620dd4f0c045\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " Jul 13 20:20:52.031667 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.031538 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") pod \"ea75151b-f8c7-4f82-8290-620dd4f0c045\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " Jul 13 20:20:52.031667 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.031569 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-trusted-ca\") pod \"ea75151b-f8c7-4f82-8290-620dd4f0c045\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " Jul 13 20:20:52.031785 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.031693 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgckf\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-kube-api-access-dgckf\") pod \"ea75151b-f8c7-4f82-8290-620dd4f0c045\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " Jul 13 20:20:52.031785 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.031762 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-certificates\") pod \"ea75151b-f8c7-4f82-8290-620dd4f0c045\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " Jul 13 20:20:52.031885 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.031795 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-bound-sa-token\") pod \"ea75151b-f8c7-4f82-8290-620dd4f0c045\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " Jul 13 20:20:52.031885 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.031832 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-installation-pull-secrets\") pod \"ea75151b-f8c7-4f82-8290-620dd4f0c045\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " Jul 13 20:20:52.031885 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.031878 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-image-registry-private-configuration\") pod \"ea75151b-f8c7-4f82-8290-620dd4f0c045\" (UID: \"ea75151b-f8c7-4f82-8290-620dd4f0c045\") " Jul 13 20:20:52.032019 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.031950 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ea75151b-f8c7-4f82-8290-620dd4f0c045" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:20:52.032160 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.032145 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-trusted-ca\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:20:52.032235 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.032204 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ea75151b-f8c7-4f82-8290-620dd4f0c045" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:20:52.034368 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.034313 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ea75151b-f8c7-4f82-8290-620dd4f0c045" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:20:52.034485 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.034320 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ea75151b-f8c7-4f82-8290-620dd4f0c045" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:20:52.034485 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.034405 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ea75151b-f8c7-4f82-8290-620dd4f0c045" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:20:52.034795 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.034754 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-kube-api-access-dgckf" (OuterVolumeSpecName: "kube-api-access-dgckf") pod "ea75151b-f8c7-4f82-8290-620dd4f0c045" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045"). InnerVolumeSpecName "kube-api-access-dgckf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:20:52.034965 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.034864 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ea75151b-f8c7-4f82-8290-620dd4f0c045" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:20:52.040451 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.040429 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea75151b-f8c7-4f82-8290-620dd4f0c045-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ea75151b-f8c7-4f82-8290-620dd4f0c045" (UID: "ea75151b-f8c7-4f82-8290-620dd4f0c045"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:20:52.133555 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.133482 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea75151b-f8c7-4f82-8290-620dd4f0c045-ca-trust-extracted\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:20:52.133555 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.133509 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-tls\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:20:52.133555 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.133521 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgckf\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-kube-api-access-dgckf\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:20:52.133555 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.133534 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea75151b-f8c7-4f82-8290-620dd4f0c045-registry-certificates\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:20:52.133555 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.133547 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea75151b-f8c7-4f82-8290-620dd4f0c045-bound-sa-token\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:20:52.133790 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.133559 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-installation-pull-secrets\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:20:52.133790 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.133573 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea75151b-f8c7-4f82-8290-620dd4f0c045-image-registry-private-configuration\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:20:52.163669 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.163641 2579 generic.go:356] "Generic (PLEG): container finished" podID="ea75151b-f8c7-4f82-8290-620dd4f0c045" containerID="e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5" exitCode=0 Jul 13 20:20:52.163760 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.163687 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" Jul 13 20:20:52.163760 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.163726 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" event={"ID":"ea75151b-f8c7-4f82-8290-620dd4f0c045","Type":"ContainerDied","Data":"e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5"} Jul 13 20:20:52.163841 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.163777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c87cb8479-5vqw8" event={"ID":"ea75151b-f8c7-4f82-8290-620dd4f0c045","Type":"ContainerDied","Data":"b69f0ee85da6d30d0541988a6463c84a7cb98095e4b3b8b04fb47ddeff6f1217"} Jul 13 20:20:52.163841 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.163797 2579 scope.go:117] "RemoveContainer" containerID="e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5" Jul 13 20:20:52.172296 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.172282 2579 scope.go:117] "RemoveContainer" containerID="e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5" Jul 13 20:20:52.172551 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:20:52.172528 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5\": container with ID starting with e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5 not found: ID does not exist" containerID="e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5" Jul 13 20:20:52.172601 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.172559 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5"} err="failed to get container status \"e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5\": rpc error: code = NotFound desc = could not find container \"e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5\": container with ID starting with e5cdba9037832609d9facc12b44e14a4a2001de77302a8368695409f2c145fd5 not found: ID does not exist" Jul 13 20:20:52.191487 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.191465 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c87cb8479-5vqw8"] Jul 13 20:20:52.201203 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.201182 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c87cb8479-5vqw8"] Jul 13 20:20:52.444850 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:20:52.444778 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea75151b-f8c7-4f82-8290-620dd4f0c045" path="/var/lib/kubelet/pods/ea75151b-f8c7-4f82-8290-620dd4f0c045/volumes" Jul 13 20:21:00.197379 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:00.197344 2579 generic.go:356] "Generic (PLEG): container finished" podID="3829d617-e9aa-4ba6-9d02-fe8e0c3932c5" containerID="0f66b2bc5b1e909e9c6fe3202630ea625219d7e462f9a3f7f984f097e54f1667" exitCode=0 Jul 13 20:21:00.197791 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:00.197420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" event={"ID":"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5","Type":"ContainerDied","Data":"0f66b2bc5b1e909e9c6fe3202630ea625219d7e462f9a3f7f984f097e54f1667"} Jul 13 20:21:00.197791 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:00.197741 2579 scope.go:117] "RemoveContainer" containerID="0f66b2bc5b1e909e9c6fe3202630ea625219d7e462f9a3f7f984f097e54f1667" Jul 13 20:21:01.202682 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:01.202645 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-w9wm9" event={"ID":"3829d617-e9aa-4ba6-9d02-fe8e0c3932c5","Type":"ContainerStarted","Data":"26783dd0d95ec1b9e34015d7df502bd5680c70cfee62cd61cb78735e476221b9"} Jul 13 20:21:12.899211 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:12.899172 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-859b66569f-58chr" podUID="bff97783-3262-43cb-bc06-392b9e1a3a59" containerName="console" containerID="cri-o://1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48" gracePeriod=15 Jul 13 20:21:13.211295 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.211265 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859b66569f-58chr" Jul 13 20:21:13.254135 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.254100 2579 generic.go:356] "Generic (PLEG): container finished" podID="bff97783-3262-43cb-bc06-392b9e1a3a59" containerID="1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48" exitCode=0 Jul 13 20:21:13.254311 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.254166 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859b66569f-58chr" Jul 13 20:21:13.254311 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.254197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859b66569f-58chr" event={"ID":"bff97783-3262-43cb-bc06-392b9e1a3a59","Type":"ContainerDied","Data":"1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48"} Jul 13 20:21:13.254311 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.254266 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859b66569f-58chr" event={"ID":"bff97783-3262-43cb-bc06-392b9e1a3a59","Type":"ContainerDied","Data":"3efe66114191bb71353bbe4a7a96e912b6bf021e9c0bf7b441206ad5a6fe313c"} Jul 13 20:21:13.254311 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.254294 2579 scope.go:117] "RemoveContainer" containerID="1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48" Jul 13 20:21:13.263873 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.263845 2579 scope.go:117] "RemoveContainer" containerID="1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48" Jul 13 20:21:13.264171 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:21:13.264143 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48\": container with ID starting with 1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48 not found: ID does not exist" containerID="1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48" Jul 13 20:21:13.264272 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.264181 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48"} err="failed to get container status \"1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48\": rpc error: code = NotFound desc = could not find container \"1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48\": container with ID starting with 1e6d6d258d4b1a4651b46874b1ea51677b37915779d86e7acbd80b35fb596a48 not found: ID does not exist" Jul 13 20:21:13.407252 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407224 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-oauth-serving-cert\") pod \"bff97783-3262-43cb-bc06-392b9e1a3a59\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " Jul 13 20:21:13.407408 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407265 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-console-config\") pod \"bff97783-3262-43cb-bc06-392b9e1a3a59\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " Jul 13 20:21:13.407408 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407294 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-serving-cert\") pod \"bff97783-3262-43cb-bc06-392b9e1a3a59\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " Jul 13 20:21:13.407408 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407330 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b992t\" (UniqueName: \"kubernetes.io/projected/bff97783-3262-43cb-bc06-392b9e1a3a59-kube-api-access-b992t\") pod \"bff97783-3262-43cb-bc06-392b9e1a3a59\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " Jul 13 20:21:13.407408 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407348 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-oauth-config\") pod \"bff97783-3262-43cb-bc06-392b9e1a3a59\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " Jul 13 20:21:13.407408 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407383 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-trusted-ca-bundle\") pod \"bff97783-3262-43cb-bc06-392b9e1a3a59\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " Jul 13 20:21:13.407584 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407417 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-service-ca\") pod \"bff97783-3262-43cb-bc06-392b9e1a3a59\" (UID: \"bff97783-3262-43cb-bc06-392b9e1a3a59\") " Jul 13 20:21:13.407764 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407714 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bff97783-3262-43cb-bc06-392b9e1a3a59" (UID: "bff97783-3262-43cb-bc06-392b9e1a3a59"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:21:13.408150 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407887 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bff97783-3262-43cb-bc06-392b9e1a3a59" (UID: "bff97783-3262-43cb-bc06-392b9e1a3a59"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:21:13.408150 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.407988 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-service-ca" (OuterVolumeSpecName: "service-ca") pod "bff97783-3262-43cb-bc06-392b9e1a3a59" (UID: "bff97783-3262-43cb-bc06-392b9e1a3a59"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:21:13.408150 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.408118 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-console-config" (OuterVolumeSpecName: "console-config") pod "bff97783-3262-43cb-bc06-392b9e1a3a59" (UID: "bff97783-3262-43cb-bc06-392b9e1a3a59"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:21:13.409528 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.409503 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bff97783-3262-43cb-bc06-392b9e1a3a59" (UID: "bff97783-3262-43cb-bc06-392b9e1a3a59"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:21:13.409684 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.409657 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bff97783-3262-43cb-bc06-392b9e1a3a59" (UID: "bff97783-3262-43cb-bc06-392b9e1a3a59"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:21:13.409724 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.409711 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bff97783-3262-43cb-bc06-392b9e1a3a59-kube-api-access-b992t" (OuterVolumeSpecName: "kube-api-access-b992t") pod "bff97783-3262-43cb-bc06-392b9e1a3a59" (UID: "bff97783-3262-43cb-bc06-392b9e1a3a59"). InnerVolumeSpecName "kube-api-access-b992t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:21:13.509024 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.508994 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-oauth-serving-cert\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:21:13.509024 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.509023 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-console-config\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:21:13.509214 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.509034 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-serving-cert\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:21:13.509214 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.509042 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b992t\" (UniqueName: \"kubernetes.io/projected/bff97783-3262-43cb-bc06-392b9e1a3a59-kube-api-access-b992t\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:21:13.509214 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.509067 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bff97783-3262-43cb-bc06-392b9e1a3a59-console-oauth-config\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:21:13.509214 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.509079 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-trusted-ca-bundle\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:21:13.509214 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.509089 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bff97783-3262-43cb-bc06-392b9e1a3a59-service-ca\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:21:13.575139 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.575113 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859b66569f-58chr"] Jul 13 20:21:13.579150 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:13.579124 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-859b66569f-58chr"] Jul 13 20:21:14.447128 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:14.447077 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bff97783-3262-43cb-bc06-392b9e1a3a59" path="/var/lib/kubelet/pods/bff97783-3262-43cb-bc06-392b9e1a3a59/volumes" Jul 13 20:21:38.355047 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:38.355019 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:21:38.355472 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:38.355069 2579 generic.go:356] "Generic (PLEG): container finished" podID="df15cdd6-58e8-434a-8f53-e711defd5ee1" containerID="560edf99285672b26832c62cfd34ce44dc905786c1e29ac9d6e7a85f15a69337" exitCode=2 Jul 13 20:21:38.355472 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:38.355148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" event={"ID":"df15cdd6-58e8-434a-8f53-e711defd5ee1","Type":"ContainerDied","Data":"560edf99285672b26832c62cfd34ce44dc905786c1e29ac9d6e7a85f15a69337"} Jul 13 20:21:38.355472 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:38.355463 2579 scope.go:117] "RemoveContainer" containerID="560edf99285672b26832c62cfd34ce44dc905786c1e29ac9d6e7a85f15a69337" Jul 13 20:21:39.360604 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:39.360578 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:21:39.361075 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:21:39.360671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mb8gp" event={"ID":"df15cdd6-58e8-434a-8f53-e711defd5ee1","Type":"ContainerStarted","Data":"85bb29ed8be5daf697b5ae7ce9dc16844adfb300e8bfcf05bd5da364d5773480"} Jul 13 20:22:13.422170 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.422119 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c4f484d48-k4rk6"] Jul 13 20:22:13.422595 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.422428 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea75151b-f8c7-4f82-8290-620dd4f0c045" containerName="registry" Jul 13 20:22:13.422595 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.422441 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea75151b-f8c7-4f82-8290-620dd4f0c045" containerName="registry" Jul 13 20:22:13.422595 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.422458 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bff97783-3262-43cb-bc06-392b9e1a3a59" containerName="console" Jul 13 20:22:13.422595 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.422464 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bff97783-3262-43cb-bc06-392b9e1a3a59" containerName="console" Jul 13 20:22:13.422595 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.422509 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea75151b-f8c7-4f82-8290-620dd4f0c045" containerName="registry" Jul 13 20:22:13.422595 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.422515 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bff97783-3262-43cb-bc06-392b9e1a3a59" containerName="console" Jul 13 20:22:13.425199 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.425178 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.427301 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.427278 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 20:22:13.427419 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.427304 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gk5tl\"" Jul 13 20:22:13.427483 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.427340 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 20:22:13.427715 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.427699 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 20:22:13.427901 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.427887 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 20:22:13.427999 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.427917 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 20:22:13.432960 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.432765 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 20:22:13.437706 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.437679 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4f484d48-k4rk6"] Jul 13 20:22:13.506919 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.506890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-serving-cert\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.507112 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.506950 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-service-ca\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.507112 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.506976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nw7r\" (UniqueName: \"kubernetes.io/projected/1d186aba-044f-45e3-92c2-1d7d736823a9-kube-api-access-6nw7r\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.507278 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.507145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-oauth-config\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.507278 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.507189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-console-config\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.507278 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.507228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-trusted-ca-bundle\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.507278 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.507270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-oauth-serving-cert\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608010 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.607985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-serving-cert\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608147 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.608025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-service-ca\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608147 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.608043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nw7r\" (UniqueName: \"kubernetes.io/projected/1d186aba-044f-45e3-92c2-1d7d736823a9-kube-api-access-6nw7r\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608147 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.608101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-oauth-config\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608147 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.608117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-console-config\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608147 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.608136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-trusted-ca-bundle\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608389 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.608156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-oauth-serving-cert\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608782 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.608761 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-oauth-serving-cert\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608888 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.608854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-service-ca\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.608888 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.608862 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-console-config\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.609110 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.609088 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-trusted-ca-bundle\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.610573 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.610542 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-serving-cert\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.610680 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.610586 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-oauth-config\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.616141 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.616116 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nw7r\" (UniqueName: \"kubernetes.io/projected/1d186aba-044f-45e3-92c2-1d7d736823a9-kube-api-access-6nw7r\") pod \"console-c4f484d48-k4rk6\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.735296 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.735274 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:13.862076 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:13.862036 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4f484d48-k4rk6"] Jul 13 20:22:13.864295 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:22:13.864267 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d186aba_044f_45e3_92c2_1d7d736823a9.slice/crio-db0cf3749a87b71a9a5041a0f331bb326f0bd704a47585a7d02e5ce3bd972740 WatchSource:0}: Error finding container db0cf3749a87b71a9a5041a0f331bb326f0bd704a47585a7d02e5ce3bd972740: Status 404 returned error can't find the container with id db0cf3749a87b71a9a5041a0f331bb326f0bd704a47585a7d02e5ce3bd972740 Jul 13 20:22:14.492533 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:14.492503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4f484d48-k4rk6" event={"ID":"1d186aba-044f-45e3-92c2-1d7d736823a9","Type":"ContainerStarted","Data":"527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83"} Jul 13 20:22:14.492875 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:14.492544 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4f484d48-k4rk6" event={"ID":"1d186aba-044f-45e3-92c2-1d7d736823a9","Type":"ContainerStarted","Data":"db0cf3749a87b71a9a5041a0f331bb326f0bd704a47585a7d02e5ce3bd972740"} Jul 13 20:22:14.512540 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:14.512497 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c4f484d48-k4rk6" podStartSLOduration=1.51248213 podStartE2EDuration="1.51248213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:22:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:22:14.511287222 +0000 UTC m=+201.356910583" watchObservedRunningTime="2026-07-13 20:22:14.51248213 +0000 UTC m=+201.358105490" Jul 13 20:22:23.735532 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:23.735499 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:23.735902 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:23.735551 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:23.739850 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:23.739826 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:22:24.532349 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:22:24.532310 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:23:35.362271 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.362242 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm"] Jul 13 20:23:35.364297 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.364277 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.366352 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.366321 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 20:23:35.366352 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.366325 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 20:23:35.366711 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.366692 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dbfbm\"" Jul 13 20:23:35.375524 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.375503 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm"] Jul 13 20:23:35.414530 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.414511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.414626 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.414567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.414626 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.414592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5pmb\" (UniqueName: \"kubernetes.io/projected/023a364d-8ed1-4120-8484-597977be2fb8-kube-api-access-t5pmb\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.515403 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.515380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.515479 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.515449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.515521 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.515502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5pmb\" (UniqueName: \"kubernetes.io/projected/023a364d-8ed1-4120-8484-597977be2fb8-kube-api-access-t5pmb\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.515779 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.515759 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.515814 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.515793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.524836 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.524812 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5pmb\" (UniqueName: \"kubernetes.io/projected/023a364d-8ed1-4120-8484-597977be2fb8-kube-api-access-t5pmb\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.673320 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.673253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:35.799665 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:35.799648 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm"] Jul 13 20:23:35.802840 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:23:35.802810 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023a364d_8ed1_4120_8484_597977be2fb8.slice/crio-0278e16b5c340a6a94b1e806e68611c941e3670d9dd9cc8c5ade5fcb4f0176da WatchSource:0}: Error finding container 0278e16b5c340a6a94b1e806e68611c941e3670d9dd9cc8c5ade5fcb4f0176da: Status 404 returned error can't find the container with id 0278e16b5c340a6a94b1e806e68611c941e3670d9dd9cc8c5ade5fcb4f0176da Jul 13 20:23:36.799662 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:36.799625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" event={"ID":"023a364d-8ed1-4120-8484-597977be2fb8","Type":"ContainerStarted","Data":"0278e16b5c340a6a94b1e806e68611c941e3670d9dd9cc8c5ade5fcb4f0176da"} Jul 13 20:23:44.834204 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:44.834171 2579 generic.go:356] "Generic (PLEG): container finished" podID="023a364d-8ed1-4120-8484-597977be2fb8" containerID="ae1380a8979f7d02bcaeb07c79aad5c272581ae57e491bf548235937862b6346" exitCode=0 Jul 13 20:23:44.834591 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:44.834227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" event={"ID":"023a364d-8ed1-4120-8484-597977be2fb8","Type":"ContainerDied","Data":"ae1380a8979f7d02bcaeb07c79aad5c272581ae57e491bf548235937862b6346"} Jul 13 20:23:46.845118 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:46.845089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" event={"ID":"023a364d-8ed1-4120-8484-597977be2fb8","Type":"ContainerStarted","Data":"ecebbc06c2baee14ba55e1d21ab97cda99d8abc0dac41a88333b58407d07f2c4"} Jul 13 20:23:47.850361 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:47.850327 2579 generic.go:356] "Generic (PLEG): container finished" podID="023a364d-8ed1-4120-8484-597977be2fb8" containerID="ecebbc06c2baee14ba55e1d21ab97cda99d8abc0dac41a88333b58407d07f2c4" exitCode=0 Jul 13 20:23:47.850732 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:47.850407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" event={"ID":"023a364d-8ed1-4120-8484-597977be2fb8","Type":"ContainerDied","Data":"ecebbc06c2baee14ba55e1d21ab97cda99d8abc0dac41a88333b58407d07f2c4"} Jul 13 20:23:54.695749 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:54.695722 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:23:54.697973 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:54.695971 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:23:54.700475 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:54.700452 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:23:54.700875 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:54.700858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:23:54.706926 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:54.706907 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:23:54.707396 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:54.707376 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:23:54.709741 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:54.709724 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 20:23:54.882422 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:54.882387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" event={"ID":"023a364d-8ed1-4120-8484-597977be2fb8","Type":"ContainerStarted","Data":"eb2f62e82153bf563858732f3aedc4b686c92b93ec3c304fbf9edad28b966ee0"} Jul 13 20:23:54.911095 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:54.909371 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" podStartSLOduration=2.541097674 podStartE2EDuration="19.909342491s" totalImagesPullingTime="17.368244817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:23:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:23:54.908422539 +0000 UTC m=+301.754045898" watchObservedRunningTime="2026-07-13 20:23:54.909342491 +0000 UTC m=+301.754965853" Jul 13 20:23:55.888046 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:55.888012 2579 generic.go:356] "Generic (PLEG): container finished" podID="023a364d-8ed1-4120-8484-597977be2fb8" containerID="eb2f62e82153bf563858732f3aedc4b686c92b93ec3c304fbf9edad28b966ee0" exitCode=0 Jul 13 20:23:55.888410 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:55.888105 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" event={"ID":"023a364d-8ed1-4120-8484-597977be2fb8","Type":"ContainerDied","Data":"eb2f62e82153bf563858732f3aedc4b686c92b93ec3c304fbf9edad28b966ee0"} Jul 13 20:23:57.069172 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.069145 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:57.197016 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.196938 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5pmb\" (UniqueName: \"kubernetes.io/projected/023a364d-8ed1-4120-8484-597977be2fb8-kube-api-access-t5pmb\") pod \"023a364d-8ed1-4120-8484-597977be2fb8\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " Jul 13 20:23:57.197196 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.197022 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-bundle\") pod \"023a364d-8ed1-4120-8484-597977be2fb8\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " Jul 13 20:23:57.197196 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.197073 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-util\") pod \"023a364d-8ed1-4120-8484-597977be2fb8\" (UID: \"023a364d-8ed1-4120-8484-597977be2fb8\") " Jul 13 20:23:57.197619 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.197595 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-bundle" (OuterVolumeSpecName: "bundle") pod "023a364d-8ed1-4120-8484-597977be2fb8" (UID: "023a364d-8ed1-4120-8484-597977be2fb8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:23:57.199158 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.199130 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023a364d-8ed1-4120-8484-597977be2fb8-kube-api-access-t5pmb" (OuterVolumeSpecName: "kube-api-access-t5pmb") pod "023a364d-8ed1-4120-8484-597977be2fb8" (UID: "023a364d-8ed1-4120-8484-597977be2fb8"). InnerVolumeSpecName "kube-api-access-t5pmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:23:57.201991 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.201967 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-util" (OuterVolumeSpecName: "util") pod "023a364d-8ed1-4120-8484-597977be2fb8" (UID: "023a364d-8ed1-4120-8484-597977be2fb8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:23:57.298448 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.298413 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5pmb\" (UniqueName: \"kubernetes.io/projected/023a364d-8ed1-4120-8484-597977be2fb8-kube-api-access-t5pmb\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:23:57.298448 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.298442 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-bundle\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:23:57.298448 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.298453 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023a364d-8ed1-4120-8484-597977be2fb8-util\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:23:57.898093 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.898049 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" Jul 13 20:23:57.898093 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.898079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5xsnzm" event={"ID":"023a364d-8ed1-4120-8484-597977be2fb8","Type":"ContainerDied","Data":"0278e16b5c340a6a94b1e806e68611c941e3670d9dd9cc8c5ade5fcb4f0176da"} Jul 13 20:23:57.898292 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:23:57.898128 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0278e16b5c340a6a94b1e806e68611c941e3670d9dd9cc8c5ade5fcb4f0176da" Jul 13 20:24:04.169940 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.169904 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg"] Jul 13 20:24:04.170341 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.170245 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023a364d-8ed1-4120-8484-597977be2fb8" containerName="util" Jul 13 20:24:04.170341 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.170258 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="023a364d-8ed1-4120-8484-597977be2fb8" containerName="util" Jul 13 20:24:04.170341 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.170277 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023a364d-8ed1-4120-8484-597977be2fb8" containerName="extract" Jul 13 20:24:04.170341 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.170282 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="023a364d-8ed1-4120-8484-597977be2fb8" containerName="extract" Jul 13 20:24:04.170341 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.170291 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023a364d-8ed1-4120-8484-597977be2fb8" containerName="pull" Jul 13 20:24:04.170341 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.170298 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="023a364d-8ed1-4120-8484-597977be2fb8" containerName="pull" Jul 13 20:24:04.170341 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.170344 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="023a364d-8ed1-4120-8484-597977be2fb8" containerName="extract" Jul 13 20:24:04.172220 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.172203 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:04.175224 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.175202 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 13 20:24:04.175442 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.175428 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-xg84t\"" Jul 13 20:24:04.176106 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.176092 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 13 20:24:04.176190 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.176154 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 13 20:24:04.195352 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.195329 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg"] Jul 13 20:24:04.257018 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.256988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwggf\" (UniqueName: \"kubernetes.io/projected/0d4c0d02-88e4-4452-8f18-789d316b4694-kube-api-access-fwggf\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-zvftg\" (UID: \"0d4c0d02-88e4-4452-8f18-789d316b4694\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:04.257199 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.257035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0d4c0d02-88e4-4452-8f18-789d316b4694-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-zvftg\" (UID: \"0d4c0d02-88e4-4452-8f18-789d316b4694\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:04.358366 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.358328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0d4c0d02-88e4-4452-8f18-789d316b4694-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-zvftg\" (UID: \"0d4c0d02-88e4-4452-8f18-789d316b4694\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:04.358550 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.358496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwggf\" (UniqueName: \"kubernetes.io/projected/0d4c0d02-88e4-4452-8f18-789d316b4694-kube-api-access-fwggf\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-zvftg\" (UID: \"0d4c0d02-88e4-4452-8f18-789d316b4694\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:04.360648 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.360630 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0d4c0d02-88e4-4452-8f18-789d316b4694-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-zvftg\" (UID: \"0d4c0d02-88e4-4452-8f18-789d316b4694\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:04.371186 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.371160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwggf\" (UniqueName: \"kubernetes.io/projected/0d4c0d02-88e4-4452-8f18-789d316b4694-kube-api-access-fwggf\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-zvftg\" (UID: \"0d4c0d02-88e4-4452-8f18-789d316b4694\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:04.482090 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.482050 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:04.621274 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.621246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg"] Jul 13 20:24:04.624580 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:24:04.624554 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4c0d02_88e4_4452_8f18_789d316b4694.slice/crio-529b04db2bcb7bca9b6dff582983a72bfca16a696c1501d8135bc68776ccca7d WatchSource:0}: Error finding container 529b04db2bcb7bca9b6dff582983a72bfca16a696c1501d8135bc68776ccca7d: Status 404 returned error can't find the container with id 529b04db2bcb7bca9b6dff582983a72bfca16a696c1501d8135bc68776ccca7d Jul 13 20:24:04.626590 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.626568 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 20:24:04.927527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:04.927452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" event={"ID":"0d4c0d02-88e4-4452-8f18-789d316b4694","Type":"ContainerStarted","Data":"529b04db2bcb7bca9b6dff582983a72bfca16a696c1501d8135bc68776ccca7d"} Jul 13 20:24:07.942917 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:07.942878 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" event={"ID":"0d4c0d02-88e4-4452-8f18-789d316b4694","Type":"ContainerStarted","Data":"2ee62b867a932bd2fe1d7fd65aae5e3aa1e69c7ed2fc4c3d804a2210f365033b"} Jul 13 20:24:07.943345 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:07.943001 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:07.967380 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:07.967319 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" podStartSLOduration=1.1799300050000001 podStartE2EDuration="3.967302228s" totalImagesPullingTime="2.787372223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:24:07.965864161 +0000 UTC m=+314.811487522" watchObservedRunningTime="2026-07-13 20:24:07.967302228 +0000 UTC m=+314.812925602" Jul 13 20:24:08.300573 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.300534 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-kjw5h"] Jul 13 20:24:08.302774 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.302756 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:08.305219 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.305193 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-4grd4\"" Jul 13 20:24:08.305335 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.305305 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 13 20:24:08.305401 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.305313 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 13 20:24:08.318936 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.318909 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-kjw5h"] Jul 13 20:24:08.491376 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.491346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/370ee87a-4440-4f2a-98f6-fe5a222767a5-cabundle0\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:08.491542 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.491399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/370ee87a-4440-4f2a-98f6-fe5a222767a5-certificates\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:08.491542 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.491427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76bpz\" (UniqueName: \"kubernetes.io/projected/370ee87a-4440-4f2a-98f6-fe5a222767a5-kube-api-access-76bpz\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:08.592264 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.592168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76bpz\" (UniqueName: \"kubernetes.io/projected/370ee87a-4440-4f2a-98f6-fe5a222767a5-kube-api-access-76bpz\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:08.592408 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.592268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/370ee87a-4440-4f2a-98f6-fe5a222767a5-cabundle0\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:08.592408 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.592329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/370ee87a-4440-4f2a-98f6-fe5a222767a5-certificates\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:08.592487 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:24:08.592443 2579 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 13 20:24:08.592487 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:24:08.592460 2579 secret.go:281] references non-existent secret key: ca.crt Jul 13 20:24:08.592487 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:24:08.592472 2579 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 13 20:24:08.592487 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:24:08.592487 2579 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-kjw5h: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 13 20:24:08.592608 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:24:08.592556 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/370ee87a-4440-4f2a-98f6-fe5a222767a5-certificates podName:370ee87a-4440-4f2a-98f6-fe5a222767a5 nodeName:}" failed. No retries permitted until 2026-07-13 20:24:09.09253756 +0000 UTC m=+315.938160903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/370ee87a-4440-4f2a-98f6-fe5a222767a5-certificates") pod "keda-operator-77f648d694-kjw5h" (UID: "370ee87a-4440-4f2a-98f6-fe5a222767a5") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 13 20:24:08.593075 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.593037 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/370ee87a-4440-4f2a-98f6-fe5a222767a5-cabundle0\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:08.601918 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.601868 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76bpz\" (UniqueName: \"kubernetes.io/projected/370ee87a-4440-4f2a-98f6-fe5a222767a5-kube-api-access-76bpz\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:08.655559 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.655524 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-8djtz"] Jul 13 20:24:08.657741 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.657724 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:08.659883 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.659861 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 13 20:24:08.673936 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.673900 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-8djtz"] Jul 13 20:24:08.793755 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.793724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:08.793755 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.793762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-certificates\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:08.794021 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.793787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55c8l\" (UniqueName: \"kubernetes.io/projected/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-kube-api-access-55c8l\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:08.894823 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.894729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55c8l\" (UniqueName: \"kubernetes.io/projected/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-kube-api-access-55c8l\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:08.894982 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.894826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:08.894982 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.894861 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-certificates\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:08.894982 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:24:08.894953 2579 secret.go:281] references non-existent secret key: tls.crt Jul 13 20:24:08.894982 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:24:08.894965 2579 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 13 20:24:08.894982 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:24:08.894981 2579 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-8djtz: references non-existent secret key: tls.crt Jul 13 20:24:08.895251 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:24:08.895043 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-certificates podName:0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8 nodeName:}" failed. No retries permitted until 2026-07-13 20:24:09.395025404 +0000 UTC m=+316.240648762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-certificates") pod "keda-metrics-apiserver-55557df8c-8djtz" (UID: "0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8") : references non-existent secret key: tls.crt Jul 13 20:24:08.895310 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.895286 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:08.906606 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:08.906580 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55c8l\" (UniqueName: \"kubernetes.io/projected/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-kube-api-access-55c8l\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:09.096144 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.096101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/370ee87a-4440-4f2a-98f6-fe5a222767a5-certificates\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:09.098475 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.098450 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/370ee87a-4440-4f2a-98f6-fe5a222767a5-certificates\") pod \"keda-operator-77f648d694-kjw5h\" (UID: \"370ee87a-4440-4f2a-98f6-fe5a222767a5\") " pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:09.186930 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.186837 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-pcmlm"] Jul 13 20:24:09.189425 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.189397 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:24:09.191624 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.191603 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 13 20:24:09.200164 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.200137 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-pcmlm"] Jul 13 20:24:09.213090 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.213064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:09.297803 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.297707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24v5j\" (UniqueName: \"kubernetes.io/projected/1cecc2c5-49ef-45cd-9627-604956fcdaee-kube-api-access-24v5j\") pod \"keda-admission-56f9798bb4-pcmlm\" (UID: \"1cecc2c5-49ef-45cd-9627-604956fcdaee\") " pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:24:09.297938 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.297854 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1cecc2c5-49ef-45cd-9627-604956fcdaee-certificates\") pod \"keda-admission-56f9798bb4-pcmlm\" (UID: \"1cecc2c5-49ef-45cd-9627-604956fcdaee\") " pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:24:09.342376 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.342351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-kjw5h"] Jul 13 20:24:09.344816 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:24:09.344788 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370ee87a_4440_4f2a_98f6_fe5a222767a5.slice/crio-f11f200bd949dc3a85767a04cd6e626863ec763df441262d6ca267d73ceb0b09 WatchSource:0}: Error finding container f11f200bd949dc3a85767a04cd6e626863ec763df441262d6ca267d73ceb0b09: Status 404 returned error can't find the container with id f11f200bd949dc3a85767a04cd6e626863ec763df441262d6ca267d73ceb0b09 Jul 13 20:24:09.398569 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.398542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v5j\" (UniqueName: \"kubernetes.io/projected/1cecc2c5-49ef-45cd-9627-604956fcdaee-kube-api-access-24v5j\") pod \"keda-admission-56f9798bb4-pcmlm\" (UID: \"1cecc2c5-49ef-45cd-9627-604956fcdaee\") " pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:24:09.398702 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.398608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-certificates\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:09.398702 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.398627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1cecc2c5-49ef-45cd-9627-604956fcdaee-certificates\") pod \"keda-admission-56f9798bb4-pcmlm\" (UID: \"1cecc2c5-49ef-45cd-9627-604956fcdaee\") " pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:24:09.401172 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.401147 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8-certificates\") pod \"keda-metrics-apiserver-55557df8c-8djtz\" (UID: \"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:09.401299 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.401250 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1cecc2c5-49ef-45cd-9627-604956fcdaee-certificates\") pod \"keda-admission-56f9798bb4-pcmlm\" (UID: \"1cecc2c5-49ef-45cd-9627-604956fcdaee\") " pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:24:09.407669 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.407647 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24v5j\" (UniqueName: \"kubernetes.io/projected/1cecc2c5-49ef-45cd-9627-604956fcdaee-kube-api-access-24v5j\") pod \"keda-admission-56f9798bb4-pcmlm\" (UID: \"1cecc2c5-49ef-45cd-9627-604956fcdaee\") " pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:24:09.501175 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.501144 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:24:09.568360 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.568331 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:09.645609 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.645586 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-pcmlm"] Jul 13 20:24:09.648198 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:24:09.648169 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cecc2c5_49ef_45cd_9627_604956fcdaee.slice/crio-80d9268d29f83dd999682899fb9b47af78f120646b1573b8ec52c3a1e2fcf486 WatchSource:0}: Error finding container 80d9268d29f83dd999682899fb9b47af78f120646b1573b8ec52c3a1e2fcf486: Status 404 returned error can't find the container with id 80d9268d29f83dd999682899fb9b47af78f120646b1573b8ec52c3a1e2fcf486 Jul 13 20:24:09.720642 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.720616 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-8djtz"] Jul 13 20:24:09.723031 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:24:09.722991 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2684ef_d19c_4e3e_a5fb_104a0b61d3c8.slice/crio-b5630d50fe65d35e167c396d646ed571c427f04c5ae74b6f3829501ef34c7ad4 WatchSource:0}: Error finding container b5630d50fe65d35e167c396d646ed571c427f04c5ae74b6f3829501ef34c7ad4: Status 404 returned error can't find the container with id b5630d50fe65d35e167c396d646ed571c427f04c5ae74b6f3829501ef34c7ad4 Jul 13 20:24:09.953158 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.953070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" event={"ID":"1cecc2c5-49ef-45cd-9627-604956fcdaee","Type":"ContainerStarted","Data":"80d9268d29f83dd999682899fb9b47af78f120646b1573b8ec52c3a1e2fcf486"} Jul 13 20:24:09.954130 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.954100 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-kjw5h" event={"ID":"370ee87a-4440-4f2a-98f6-fe5a222767a5","Type":"ContainerStarted","Data":"f11f200bd949dc3a85767a04cd6e626863ec763df441262d6ca267d73ceb0b09"} Jul 13 20:24:09.955146 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:09.955125 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" event={"ID":"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8","Type":"ContainerStarted","Data":"b5630d50fe65d35e167c396d646ed571c427f04c5ae74b6f3829501ef34c7ad4"} Jul 13 20:24:13.977170 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:13.977043 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" event={"ID":"1cecc2c5-49ef-45cd-9627-604956fcdaee","Type":"ContainerStarted","Data":"6201a5d2e3c469a8992439b7a664440b8527e971b88148728ed8ef81260bafc0"} Jul 13 20:24:13.977170 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:13.977141 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:24:13.978640 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:13.978613 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-kjw5h" event={"ID":"370ee87a-4440-4f2a-98f6-fe5a222767a5","Type":"ContainerStarted","Data":"3cf6a935e53c82d6d84cd682526d6568b376a96c126174eb547309b846ff40c2"} Jul 13 20:24:13.978764 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:13.978717 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:13.980097 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:13.980076 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" event={"ID":"0b2684ef-d19c-4e3e-a5fb-104a0b61d3c8","Type":"ContainerStarted","Data":"5028650d8e3f4c34665ad30e8aa025adda3769f953454606b7fdb647217fe286"} Jul 13 20:24:13.980170 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:13.980139 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:14.000929 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:14.000881 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" podStartSLOduration=1.005962203 podStartE2EDuration="5.000863693s" totalImagesPullingTime="3.99490149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:24:13.999156001 +0000 UTC m=+320.844779361" watchObservedRunningTime="2026-07-13 20:24:14.000863693 +0000 UTC m=+320.846487058" Jul 13 20:24:14.021846 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:14.021802 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-kjw5h" podStartSLOduration=1.717496873 podStartE2EDuration="6.021789864s" totalImagesPullingTime="4.304292991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:24:14.020525806 +0000 UTC m=+320.866149167" watchObservedRunningTime="2026-07-13 20:24:14.021789864 +0000 UTC m=+320.867413225" Jul 13 20:24:14.046532 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:14.046496 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" podStartSLOduration=2.119218916 podStartE2EDuration="6.046483739s" totalImagesPullingTime="3.927264823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:24:14.044289914 +0000 UTC m=+320.889913275" watchObservedRunningTime="2026-07-13 20:24:14.046483739 +0000 UTC m=+320.892107100" Jul 13 20:24:24.989824 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:24.989798 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8djtz" Jul 13 20:24:28.950537 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:28.950504 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-zvftg" Jul 13 20:24:34.987228 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:34.987197 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-kjw5h" Jul 13 20:24:34.987694 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:24:34.987306 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-pcmlm" Jul 13 20:25:21.598373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.598335 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-68b649c569-ptlfq"] Jul 13 20:25:21.600429 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.600412 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:21.602601 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.602574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 13 20:25:21.602705 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.602657 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-c7w4c\"" Jul 13 20:25:21.603144 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.603125 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 13 20:25:21.603311 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.603296 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 13 20:25:21.617299 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.617279 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-68b649c569-ptlfq"] Jul 13 20:25:21.653240 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.653213 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlzl4\" (UniqueName: \"kubernetes.io/projected/6aa76254-eab4-4c80-8840-93a0e5c80dee-kube-api-access-hlzl4\") pod \"kserve-controller-manager-68b649c569-ptlfq\" (UID: \"6aa76254-eab4-4c80-8840-93a0e5c80dee\") " pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:21.653337 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.653294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6aa76254-eab4-4c80-8840-93a0e5c80dee-cert\") pod \"kserve-controller-manager-68b649c569-ptlfq\" (UID: \"6aa76254-eab4-4c80-8840-93a0e5c80dee\") " pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:21.754150 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.754121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlzl4\" (UniqueName: \"kubernetes.io/projected/6aa76254-eab4-4c80-8840-93a0e5c80dee-kube-api-access-hlzl4\") pod \"kserve-controller-manager-68b649c569-ptlfq\" (UID: \"6aa76254-eab4-4c80-8840-93a0e5c80dee\") " pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:21.754268 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.754193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6aa76254-eab4-4c80-8840-93a0e5c80dee-cert\") pod \"kserve-controller-manager-68b649c569-ptlfq\" (UID: \"6aa76254-eab4-4c80-8840-93a0e5c80dee\") " pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:21.754335 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:25:21.754310 2579 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 13 20:25:21.754397 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:25:21.754386 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa76254-eab4-4c80-8840-93a0e5c80dee-cert podName:6aa76254-eab4-4c80-8840-93a0e5c80dee nodeName:}" failed. No retries permitted until 2026-07-13 20:25:22.254365018 +0000 UTC m=+389.099988360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6aa76254-eab4-4c80-8840-93a0e5c80dee-cert") pod "kserve-controller-manager-68b649c569-ptlfq" (UID: "6aa76254-eab4-4c80-8840-93a0e5c80dee") : secret "kserve-webhook-server-cert" not found Jul 13 20:25:21.766570 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:21.766549 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlzl4\" (UniqueName: \"kubernetes.io/projected/6aa76254-eab4-4c80-8840-93a0e5c80dee-kube-api-access-hlzl4\") pod \"kserve-controller-manager-68b649c569-ptlfq\" (UID: \"6aa76254-eab4-4c80-8840-93a0e5c80dee\") " pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:22.258305 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:22.258271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6aa76254-eab4-4c80-8840-93a0e5c80dee-cert\") pod \"kserve-controller-manager-68b649c569-ptlfq\" (UID: \"6aa76254-eab4-4c80-8840-93a0e5c80dee\") " pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:22.260858 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:22.260832 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6aa76254-eab4-4c80-8840-93a0e5c80dee-cert\") pod \"kserve-controller-manager-68b649c569-ptlfq\" (UID: \"6aa76254-eab4-4c80-8840-93a0e5c80dee\") " pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:22.510777 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:22.510696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:22.649083 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:22.649029 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-68b649c569-ptlfq"] Jul 13 20:25:22.652833 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:25:22.652808 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa76254_eab4_4c80_8840_93a0e5c80dee.slice/crio-786899963e25b181c589bb6baabb7b9a17f1ce8c4a5dc68ed7237ff25f401518 WatchSource:0}: Error finding container 786899963e25b181c589bb6baabb7b9a17f1ce8c4a5dc68ed7237ff25f401518: Status 404 returned error can't find the container with id 786899963e25b181c589bb6baabb7b9a17f1ce8c4a5dc68ed7237ff25f401518 Jul 13 20:25:23.288524 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:23.288484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" event={"ID":"6aa76254-eab4-4c80-8840-93a0e5c80dee","Type":"ContainerStarted","Data":"786899963e25b181c589bb6baabb7b9a17f1ce8c4a5dc68ed7237ff25f401518"} Jul 13 20:25:26.304047 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:26.304011 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" event={"ID":"6aa76254-eab4-4c80-8840-93a0e5c80dee","Type":"ContainerStarted","Data":"c78a6ea8e1bb5831b5d512410ff7c7580b1a10efa1853c8c04fc9376d4adb60c"} Jul 13 20:25:26.304411 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:26.304166 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:26.327577 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:26.327533 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" podStartSLOduration=2.567631211 podStartE2EDuration="5.327519057s" totalImagesPullingTime="2.759887846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:25:26.325758898 +0000 UTC m=+393.171382278" watchObservedRunningTime="2026-07-13 20:25:26.327519057 +0000 UTC m=+393.173142417" Jul 13 20:25:41.456964 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.456920 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd7694c84-2nvl2"] Jul 13 20:25:41.460523 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.460497 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.482387 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.482355 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd7694c84-2nvl2"] Jul 13 20:25:41.514604 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.514572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn7t7\" (UniqueName: \"kubernetes.io/projected/e654a04a-f899-4a39-800c-6b756e53d6f5-kube-api-access-nn7t7\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.514772 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.514738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e654a04a-f899-4a39-800c-6b756e53d6f5-console-oauth-config\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.514772 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.514766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-trusted-ca-bundle\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.514864 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.514838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-service-ca\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.514911 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.514876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-oauth-serving-cert\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.514911 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.514904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e654a04a-f899-4a39-800c-6b756e53d6f5-console-serving-cert\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.514988 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.514928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-console-config\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.615862 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.615828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e654a04a-f899-4a39-800c-6b756e53d6f5-console-oauth-config\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.615862 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.615862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-trusted-ca-bundle\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.616127 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.615898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-service-ca\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.616127 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.615922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-oauth-serving-cert\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.616127 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.615944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e654a04a-f899-4a39-800c-6b756e53d6f5-console-serving-cert\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.616127 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.615967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-console-config\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.616127 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.615987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn7t7\" (UniqueName: \"kubernetes.io/projected/e654a04a-f899-4a39-800c-6b756e53d6f5-kube-api-access-nn7t7\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.616717 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.616686 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-service-ca\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.616834 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.616769 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-oauth-serving-cert\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.616911 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.616886 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-trusted-ca-bundle\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.617083 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.617044 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e654a04a-f899-4a39-800c-6b756e53d6f5-console-config\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.618308 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.618278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e654a04a-f899-4a39-800c-6b756e53d6f5-console-oauth-config\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.618507 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.618488 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e654a04a-f899-4a39-800c-6b756e53d6f5-console-serving-cert\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.625261 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.625239 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn7t7\" (UniqueName: \"kubernetes.io/projected/e654a04a-f899-4a39-800c-6b756e53d6f5-kube-api-access-nn7t7\") pod \"console-7dd7694c84-2nvl2\" (UID: \"e654a04a-f899-4a39-800c-6b756e53d6f5\") " pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.770009 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.769972 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:41.923405 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:41.923372 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd7694c84-2nvl2"] Jul 13 20:25:41.927502 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:25:41.927476 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode654a04a_f899_4a39_800c_6b756e53d6f5.slice/crio-11474377dcad37c50a58ee3e32b979fcc87c4cc8ebad24f71ca2f810021be081 WatchSource:0}: Error finding container 11474377dcad37c50a58ee3e32b979fcc87c4cc8ebad24f71ca2f810021be081: Status 404 returned error can't find the container with id 11474377dcad37c50a58ee3e32b979fcc87c4cc8ebad24f71ca2f810021be081 Jul 13 20:25:42.372759 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:42.372729 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd7694c84-2nvl2" event={"ID":"e654a04a-f899-4a39-800c-6b756e53d6f5","Type":"ContainerStarted","Data":"03d47fa0b942c0bff54f90aad461eb98fffef5cd50b07e172e334ca96650db2f"} Jul 13 20:25:42.372902 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:42.372775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd7694c84-2nvl2" event={"ID":"e654a04a-f899-4a39-800c-6b756e53d6f5","Type":"ContainerStarted","Data":"11474377dcad37c50a58ee3e32b979fcc87c4cc8ebad24f71ca2f810021be081"} Jul 13 20:25:51.771042 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:51.771010 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:51.771449 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:51.771167 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:51.775947 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:51.775923 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:51.806403 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:51.806358 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd7694c84-2nvl2" podStartSLOduration=10.806345539 podStartE2EDuration="10.806345539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:25:42.42116641 +0000 UTC m=+409.266789772" watchObservedRunningTime="2026-07-13 20:25:51.806345539 +0000 UTC m=+418.651968899" Jul 13 20:25:52.419128 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:52.419090 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd7694c84-2nvl2" Jul 13 20:25:52.486629 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:52.486593 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4f484d48-k4rk6"] Jul 13 20:25:57.313830 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:57.313799 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:59.167016 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.166981 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-68b649c569-ptlfq"] Jul 13 20:25:59.167419 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.167184 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" podUID="6aa76254-eab4-4c80-8840-93a0e5c80dee" containerName="manager" containerID="cri-o://c78a6ea8e1bb5831b5d512410ff7c7580b1a10efa1853c8c04fc9376d4adb60c" gracePeriod=10 Jul 13 20:25:59.201997 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.201974 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-68b649c569-cz996"] Jul 13 20:25:59.218722 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.218696 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-68b649c569-cz996"] Jul 13 20:25:59.218833 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.218816 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:25:59.349354 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.349313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dab7b54-0be0-4eae-9622-624825a97c20-cert\") pod \"kserve-controller-manager-68b649c569-cz996\" (UID: \"6dab7b54-0be0-4eae-9622-624825a97c20\") " pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:25:59.349500 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.349381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmqc7\" (UniqueName: \"kubernetes.io/projected/6dab7b54-0be0-4eae-9622-624825a97c20-kube-api-access-bmqc7\") pod \"kserve-controller-manager-68b649c569-cz996\" (UID: \"6dab7b54-0be0-4eae-9622-624825a97c20\") " pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:25:59.445476 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.445421 2579 generic.go:356] "Generic (PLEG): container finished" podID="6aa76254-eab4-4c80-8840-93a0e5c80dee" containerID="c78a6ea8e1bb5831b5d512410ff7c7580b1a10efa1853c8c04fc9376d4adb60c" exitCode=0 Jul 13 20:25:59.445576 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.445485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" event={"ID":"6aa76254-eab4-4c80-8840-93a0e5c80dee","Type":"ContainerDied","Data":"c78a6ea8e1bb5831b5d512410ff7c7580b1a10efa1853c8c04fc9376d4adb60c"} Jul 13 20:25:59.445576 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.445545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" event={"ID":"6aa76254-eab4-4c80-8840-93a0e5c80dee","Type":"ContainerDied","Data":"786899963e25b181c589bb6baabb7b9a17f1ce8c4a5dc68ed7237ff25f401518"} Jul 13 20:25:59.445576 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.445561 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="786899963e25b181c589bb6baabb7b9a17f1ce8c4a5dc68ed7237ff25f401518" Jul 13 20:25:59.445875 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.445854 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:25:59.449870 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.449849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dab7b54-0be0-4eae-9622-624825a97c20-cert\") pod \"kserve-controller-manager-68b649c569-cz996\" (UID: \"6dab7b54-0be0-4eae-9622-624825a97c20\") " pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:25:59.449968 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.449910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmqc7\" (UniqueName: \"kubernetes.io/projected/6dab7b54-0be0-4eae-9622-624825a97c20-kube-api-access-bmqc7\") pod \"kserve-controller-manager-68b649c569-cz996\" (UID: \"6dab7b54-0be0-4eae-9622-624825a97c20\") " pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:25:59.452044 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.452016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dab7b54-0be0-4eae-9622-624825a97c20-cert\") pod \"kserve-controller-manager-68b649c569-cz996\" (UID: \"6dab7b54-0be0-4eae-9622-624825a97c20\") " pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:25:59.472812 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.472788 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmqc7\" (UniqueName: \"kubernetes.io/projected/6dab7b54-0be0-4eae-9622-624825a97c20-kube-api-access-bmqc7\") pod \"kserve-controller-manager-68b649c569-cz996\" (UID: \"6dab7b54-0be0-4eae-9622-624825a97c20\") " pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:25:59.550257 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.550234 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlzl4\" (UniqueName: \"kubernetes.io/projected/6aa76254-eab4-4c80-8840-93a0e5c80dee-kube-api-access-hlzl4\") pod \"6aa76254-eab4-4c80-8840-93a0e5c80dee\" (UID: \"6aa76254-eab4-4c80-8840-93a0e5c80dee\") " Jul 13 20:25:59.550404 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.550291 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6aa76254-eab4-4c80-8840-93a0e5c80dee-cert\") pod \"6aa76254-eab4-4c80-8840-93a0e5c80dee\" (UID: \"6aa76254-eab4-4c80-8840-93a0e5c80dee\") " Jul 13 20:25:59.552282 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.552254 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aa76254-eab4-4c80-8840-93a0e5c80dee-cert" (OuterVolumeSpecName: "cert") pod "6aa76254-eab4-4c80-8840-93a0e5c80dee" (UID: "6aa76254-eab4-4c80-8840-93a0e5c80dee"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:25:59.552282 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.552269 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa76254-eab4-4c80-8840-93a0e5c80dee-kube-api-access-hlzl4" (OuterVolumeSpecName: "kube-api-access-hlzl4") pod "6aa76254-eab4-4c80-8840-93a0e5c80dee" (UID: "6aa76254-eab4-4c80-8840-93a0e5c80dee"). InnerVolumeSpecName "kube-api-access-hlzl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:25:59.558425 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.558404 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:25:59.651835 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.651811 2579 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6aa76254-eab4-4c80-8840-93a0e5c80dee-cert\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:25:59.651835 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.651834 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlzl4\" (UniqueName: \"kubernetes.io/projected/6aa76254-eab4-4c80-8840-93a0e5c80dee-kube-api-access-hlzl4\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:25:59.708340 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:25:59.708312 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-68b649c569-cz996"] Jul 13 20:25:59.709952 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:25:59.709927 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dab7b54_0be0_4eae_9622_624825a97c20.slice/crio-0ce4a3354b158f00f17b06a4773091eb5bd7d0d6ad03199c5398895cc983317d WatchSource:0}: Error finding container 0ce4a3354b158f00f17b06a4773091eb5bd7d0d6ad03199c5398895cc983317d: Status 404 returned error can't find the container with id 0ce4a3354b158f00f17b06a4773091eb5bd7d0d6ad03199c5398895cc983317d Jul 13 20:26:00.452791 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:00.452706 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-68b649c569-cz996" event={"ID":"6dab7b54-0be0-4eae-9622-624825a97c20","Type":"ContainerStarted","Data":"f2c9abd6e1e7f526916335bac360c7cf38a78056675f98947cc50767e346dfb6"} Jul 13 20:26:00.452791 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:00.452762 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-68b649c569-cz996" event={"ID":"6dab7b54-0be0-4eae-9622-624825a97c20","Type":"ContainerStarted","Data":"0ce4a3354b158f00f17b06a4773091eb5bd7d0d6ad03199c5398895cc983317d"} Jul 13 20:26:00.453268 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:00.452875 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:26:00.453268 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:00.452872 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-68b649c569-ptlfq" Jul 13 20:26:00.532813 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:00.532767 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-68b649c569-cz996" podStartSLOduration=0.903590879 podStartE2EDuration="1.532750731s" totalImagesPullingTime="629.159852ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:26:00.510858093 +0000 UTC m=+427.356481454" watchObservedRunningTime="2026-07-13 20:26:00.532750731 +0000 UTC m=+427.378374092" Jul 13 20:26:00.533901 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:00.533882 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-68b649c569-ptlfq"] Jul 13 20:26:00.540195 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:00.540154 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-68b649c569-ptlfq"] Jul 13 20:26:02.445402 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:02.445366 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aa76254-eab4-4c80-8840-93a0e5c80dee" path="/var/lib/kubelet/pods/6aa76254-eab4-4c80-8840-93a0e5c80dee/volumes" Jul 13 20:26:17.509666 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.509587 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c4f484d48-k4rk6" podUID="1d186aba-044f-45e3-92c2-1d7d736823a9" containerName="console" containerID="cri-o://527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83" gracePeriod=15 Jul 13 20:26:17.748549 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.748529 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:26:17.888570 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888508 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-service-ca\") pod \"1d186aba-044f-45e3-92c2-1d7d736823a9\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " Jul 13 20:26:17.888699 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888572 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-console-config\") pod \"1d186aba-044f-45e3-92c2-1d7d736823a9\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " Jul 13 20:26:17.888699 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888597 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nw7r\" (UniqueName: \"kubernetes.io/projected/1d186aba-044f-45e3-92c2-1d7d736823a9-kube-api-access-6nw7r\") pod \"1d186aba-044f-45e3-92c2-1d7d736823a9\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " Jul 13 20:26:17.888699 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888625 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-oauth-serving-cert\") pod \"1d186aba-044f-45e3-92c2-1d7d736823a9\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " Jul 13 20:26:17.888699 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888672 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-serving-cert\") pod \"1d186aba-044f-45e3-92c2-1d7d736823a9\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " Jul 13 20:26:17.888699 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888688 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-oauth-config\") pod \"1d186aba-044f-45e3-92c2-1d7d736823a9\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " Jul 13 20:26:17.888950 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888696 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "1d186aba-044f-45e3-92c2-1d7d736823a9" (UID: "1d186aba-044f-45e3-92c2-1d7d736823a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:26:17.888950 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888724 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-trusted-ca-bundle\") pod \"1d186aba-044f-45e3-92c2-1d7d736823a9\" (UID: \"1d186aba-044f-45e3-92c2-1d7d736823a9\") " Jul 13 20:26:17.889082 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888968 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-console-config" (OuterVolumeSpecName: "console-config") pod "1d186aba-044f-45e3-92c2-1d7d736823a9" (UID: "1d186aba-044f-45e3-92c2-1d7d736823a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:26:17.889082 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.888985 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-service-ca\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:26:17.889194 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.889154 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1d186aba-044f-45e3-92c2-1d7d736823a9" (UID: "1d186aba-044f-45e3-92c2-1d7d736823a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:26:17.889248 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.889217 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1d186aba-044f-45e3-92c2-1d7d736823a9" (UID: "1d186aba-044f-45e3-92c2-1d7d736823a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:26:17.890797 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.890766 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1d186aba-044f-45e3-92c2-1d7d736823a9" (UID: "1d186aba-044f-45e3-92c2-1d7d736823a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:26:17.890797 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.890775 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d186aba-044f-45e3-92c2-1d7d736823a9-kube-api-access-6nw7r" (OuterVolumeSpecName: "kube-api-access-6nw7r") pod "1d186aba-044f-45e3-92c2-1d7d736823a9" (UID: "1d186aba-044f-45e3-92c2-1d7d736823a9"). InnerVolumeSpecName "kube-api-access-6nw7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:26:17.890797 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.890783 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1d186aba-044f-45e3-92c2-1d7d736823a9" (UID: "1d186aba-044f-45e3-92c2-1d7d736823a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:26:17.990014 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.989987 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-serving-cert\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:26:17.990014 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.990011 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d186aba-044f-45e3-92c2-1d7d736823a9-console-oauth-config\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:26:17.990186 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.990024 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-trusted-ca-bundle\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:26:17.990186 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.990036 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-console-config\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:26:17.990186 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.990048 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nw7r\" (UniqueName: \"kubernetes.io/projected/1d186aba-044f-45e3-92c2-1d7d736823a9-kube-api-access-6nw7r\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:26:17.990186 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:17.990076 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d186aba-044f-45e3-92c2-1d7d736823a9-oauth-serving-cert\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:26:18.526657 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:18.526628 2579 generic.go:356] "Generic (PLEG): container finished" podID="1d186aba-044f-45e3-92c2-1d7d736823a9" containerID="527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83" exitCode=0 Jul 13 20:26:18.527003 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:18.526669 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4f484d48-k4rk6" event={"ID":"1d186aba-044f-45e3-92c2-1d7d736823a9","Type":"ContainerDied","Data":"527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83"} Jul 13 20:26:18.527003 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:18.526672 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4f484d48-k4rk6" Jul 13 20:26:18.527003 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:18.526701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4f484d48-k4rk6" event={"ID":"1d186aba-044f-45e3-92c2-1d7d736823a9","Type":"ContainerDied","Data":"db0cf3749a87b71a9a5041a0f331bb326f0bd704a47585a7d02e5ce3bd972740"} Jul 13 20:26:18.527003 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:18.526719 2579 scope.go:117] "RemoveContainer" containerID="527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83" Jul 13 20:26:18.535023 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:18.535003 2579 scope.go:117] "RemoveContainer" containerID="527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83" Jul 13 20:26:18.535310 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:26:18.535292 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83\": container with ID starting with 527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83 not found: ID does not exist" containerID="527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83" Jul 13 20:26:18.535373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:18.535318 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83"} err="failed to get container status \"527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83\": rpc error: code = NotFound desc = could not find container \"527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83\": container with ID starting with 527cf2e6238cb4dcb6642903c84af54d5792fde7d21b7dd7a8fad1aad6bdbe83 not found: ID does not exist" Jul 13 20:26:18.551750 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:18.551728 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4f484d48-k4rk6"] Jul 13 20:26:18.558176 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:18.558155 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c4f484d48-k4rk6"] Jul 13 20:26:20.445033 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:20.444998 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d186aba-044f-45e3-92c2-1d7d736823a9" path="/var/lib/kubelet/pods/1d186aba-044f-45e3-92c2-1d7d736823a9/volumes" Jul 13 20:26:31.462162 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:31.462124 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-68b649c569-cz996" Jul 13 20:26:32.546315 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.546286 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-s822k"] Jul 13 20:26:32.546782 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.546613 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d186aba-044f-45e3-92c2-1d7d736823a9" containerName="console" Jul 13 20:26:32.546782 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.546624 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d186aba-044f-45e3-92c2-1d7d736823a9" containerName="console" Jul 13 20:26:32.546782 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.546648 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aa76254-eab4-4c80-8840-93a0e5c80dee" containerName="manager" Jul 13 20:26:32.546782 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.546654 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aa76254-eab4-4c80-8840-93a0e5c80dee" containerName="manager" Jul 13 20:26:32.546782 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.546701 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d186aba-044f-45e3-92c2-1d7d736823a9" containerName="console" Jul 13 20:26:32.546782 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.546709 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aa76254-eab4-4c80-8840-93a0e5c80dee" containerName="manager" Jul 13 20:26:32.551170 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.551145 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:32.554200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.554179 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 13 20:26:32.554374 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.554357 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-hnv98\"" Jul 13 20:26:32.564080 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.564041 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-s822k"] Jul 13 20:26:32.590319 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.590290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f-cert\") pod \"odh-model-controller-84b54b7f97-s822k\" (UID: \"d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f\") " pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:32.590520 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.590502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xjmr\" (UniqueName: \"kubernetes.io/projected/d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f-kube-api-access-4xjmr\") pod \"odh-model-controller-84b54b7f97-s822k\" (UID: \"d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f\") " pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:32.691794 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.691769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f-cert\") pod \"odh-model-controller-84b54b7f97-s822k\" (UID: \"d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f\") " pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:32.691941 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.691810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xjmr\" (UniqueName: \"kubernetes.io/projected/d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f-kube-api-access-4xjmr\") pod \"odh-model-controller-84b54b7f97-s822k\" (UID: \"d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f\") " pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:32.691941 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:26:32.691905 2579 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 13 20:26:32.692009 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:26:32.691962 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f-cert podName:d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f nodeName:}" failed. No retries permitted until 2026-07-13 20:26:33.191945641 +0000 UTC m=+460.037568984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f-cert") pod "odh-model-controller-84b54b7f97-s822k" (UID: "d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f") : secret "odh-model-controller-webhook-cert" not found Jul 13 20:26:32.701663 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:32.701643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xjmr\" (UniqueName: \"kubernetes.io/projected/d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f-kube-api-access-4xjmr\") pod \"odh-model-controller-84b54b7f97-s822k\" (UID: \"d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f\") " pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:33.195732 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:33.195694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f-cert\") pod \"odh-model-controller-84b54b7f97-s822k\" (UID: \"d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f\") " pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:33.197986 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:33.197964 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f-cert\") pod \"odh-model-controller-84b54b7f97-s822k\" (UID: \"d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f\") " pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:33.461982 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:33.461914 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:33.595849 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:33.595817 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-s822k"] Jul 13 20:26:33.599376 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:26:33.599347 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cc471f_4dbf_4cbb_8eb8_1b073a4e936f.slice/crio-297ab08ea82181cc573f097b5d5a5020470eeca55c6de08c023c59573e4b6050 WatchSource:0}: Error finding container 297ab08ea82181cc573f097b5d5a5020470eeca55c6de08c023c59573e4b6050: Status 404 returned error can't find the container with id 297ab08ea82181cc573f097b5d5a5020470eeca55c6de08c023c59573e4b6050 Jul 13 20:26:34.604141 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:34.604108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-s822k" event={"ID":"d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f","Type":"ContainerStarted","Data":"297ab08ea82181cc573f097b5d5a5020470eeca55c6de08c023c59573e4b6050"} Jul 13 20:26:37.619101 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:37.619045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-s822k" event={"ID":"d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f","Type":"ContainerStarted","Data":"cd57545ae88f3d07317d30f82e9498109b570a0ff640acd8ae34ab13790da0db"} Jul 13 20:26:37.619480 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:37.619140 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:26:37.641265 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:37.641223 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-s822k" podStartSLOduration=2.063029744 podStartE2EDuration="5.641209449s" totalImagesPullingTime="3.578179705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:26:37.640362894 +0000 UTC m=+464.485986256" watchObservedRunningTime="2026-07-13 20:26:37.641209449 +0000 UTC m=+464.486832811" Jul 13 20:26:48.625877 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:26:48.625849 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-s822k" Jul 13 20:28:54.724174 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:28:54.724078 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:28:54.727301 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:28:54.725153 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:28:54.729255 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:28:54.729229 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:28:54.735650 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:28:54.735631 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:28:54.740808 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:28:54.740789 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:28:54.741931 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:28:54.741915 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:31:45.888363 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:45.888332 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg"] Jul 13 20:31:45.891815 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:45.891794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:45.894353 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:45.894326 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-732aa-serving-cert\"" Jul 13 20:31:45.894471 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:45.894438 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-732aa-kube-rbac-proxy-sar-config\"" Jul 13 20:31:45.894471 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:45.894463 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 13 20:31:45.894622 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:45.894606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-d8krp\"" Jul 13 20:31:45.908758 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:45.908738 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg"] Jul 13 20:31:46.052182 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.052146 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb8c640e-379a-473c-9e6a-4a89ebdbb417-proxy-tls\") pod \"model-chainer-raw-732aa-5749bff444-gzmcg\" (UID: \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\") " pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:46.052323 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.052207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb8c640e-379a-473c-9e6a-4a89ebdbb417-openshift-service-ca-bundle\") pod \"model-chainer-raw-732aa-5749bff444-gzmcg\" (UID: \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\") " pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:46.152998 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.152925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb8c640e-379a-473c-9e6a-4a89ebdbb417-proxy-tls\") pod \"model-chainer-raw-732aa-5749bff444-gzmcg\" (UID: \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\") " pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:46.152998 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.152986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb8c640e-379a-473c-9e6a-4a89ebdbb417-openshift-service-ca-bundle\") pod \"model-chainer-raw-732aa-5749bff444-gzmcg\" (UID: \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\") " pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:46.153201 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:31:46.153115 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-732aa-serving-cert: secret "model-chainer-raw-732aa-serving-cert" not found Jul 13 20:31:46.153201 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:31:46.153185 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8c640e-379a-473c-9e6a-4a89ebdbb417-proxy-tls podName:fb8c640e-379a-473c-9e6a-4a89ebdbb417 nodeName:}" failed. No retries permitted until 2026-07-13 20:31:46.653166767 +0000 UTC m=+773.498790108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fb8c640e-379a-473c-9e6a-4a89ebdbb417-proxy-tls") pod "model-chainer-raw-732aa-5749bff444-gzmcg" (UID: "fb8c640e-379a-473c-9e6a-4a89ebdbb417") : secret "model-chainer-raw-732aa-serving-cert" not found Jul 13 20:31:46.153615 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.153597 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb8c640e-379a-473c-9e6a-4a89ebdbb417-openshift-service-ca-bundle\") pod \"model-chainer-raw-732aa-5749bff444-gzmcg\" (UID: \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\") " pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:46.657896 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.657849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb8c640e-379a-473c-9e6a-4a89ebdbb417-proxy-tls\") pod \"model-chainer-raw-732aa-5749bff444-gzmcg\" (UID: \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\") " pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:46.660314 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.660289 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb8c640e-379a-473c-9e6a-4a89ebdbb417-proxy-tls\") pod \"model-chainer-raw-732aa-5749bff444-gzmcg\" (UID: \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\") " pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:46.802488 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.802460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:46.935386 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.935281 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg"] Jul 13 20:31:46.937794 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:31:46.937766 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8c640e_379a_473c_9e6a_4a89ebdbb417.slice/crio-e65263c4ede77fe7a2adbba8f07ede9c662d3195f56faa4864e25fbd1f0943f5 WatchSource:0}: Error finding container e65263c4ede77fe7a2adbba8f07ede9c662d3195f56faa4864e25fbd1f0943f5: Status 404 returned error can't find the container with id e65263c4ede77fe7a2adbba8f07ede9c662d3195f56faa4864e25fbd1f0943f5 Jul 13 20:31:46.939676 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.939659 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 20:31:46.995373 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:46.995345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" event={"ID":"fb8c640e-379a-473c-9e6a-4a89ebdbb417","Type":"ContainerStarted","Data":"e65263c4ede77fe7a2adbba8f07ede9c662d3195f56faa4864e25fbd1f0943f5"} Jul 13 20:31:50.010551 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:50.010509 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" event={"ID":"fb8c640e-379a-473c-9e6a-4a89ebdbb417","Type":"ContainerStarted","Data":"d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600"} Jul 13 20:31:50.010932 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:50.010595 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:31:50.034752 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:50.034709 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" podStartSLOduration=2.6522730450000003 podStartE2EDuration="5.034694615s" totalImagesPullingTime="2.38242157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:31:50.033751797 +0000 UTC m=+776.879375158" watchObservedRunningTime="2026-07-13 20:31:50.034694615 +0000 UTC m=+776.880318021" Jul 13 20:31:54.384572 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:54.384541 2579 scope.go:117] "RemoveContainer" containerID="c78a6ea8e1bb5831b5d512410ff7c7580b1a10efa1853c8c04fc9376d4adb60c" Jul 13 20:31:55.919396 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:55.919354 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg"] Jul 13 20:31:55.920208 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:55.920156 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" containerID="cri-o://d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600" gracePeriod=30 Jul 13 20:31:55.927302 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:31:55.927269 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:32:00.924378 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:00.924338 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:32:05.924181 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:05.924144 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:32:10.924363 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:10.924320 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:32:15.924815 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:15.924730 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:32:20.924089 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:20.924034 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:32:25.924618 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:25.924581 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" probeResult="failure" output="Get \"https://10.132.0.34:8080/readyz\": dial tcp 10.132.0.34:8080: connect: connection refused" Jul 13 20:32:26.115608 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.115586 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:32:26.153439 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.153414 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb8c640e-379a-473c-9e6a-4a89ebdbb417-proxy-tls\") pod \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\" (UID: \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\") " Jul 13 20:32:26.153553 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.153506 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb8c640e-379a-473c-9e6a-4a89ebdbb417-openshift-service-ca-bundle\") pod \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\" (UID: \"fb8c640e-379a-473c-9e6a-4a89ebdbb417\") " Jul 13 20:32:26.153830 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.153805 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb8c640e-379a-473c-9e6a-4a89ebdbb417-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "fb8c640e-379a-473c-9e6a-4a89ebdbb417" (UID: "fb8c640e-379a-473c-9e6a-4a89ebdbb417"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:32:26.155475 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.155456 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb8c640e-379a-473c-9e6a-4a89ebdbb417-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fb8c640e-379a-473c-9e6a-4a89ebdbb417" (UID: "fb8c640e-379a-473c-9e6a-4a89ebdbb417"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:32:26.172180 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.172155 2579 generic.go:356] "Generic (PLEG): container finished" podID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerID="d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600" exitCode=0 Jul 13 20:32:26.172270 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.172228 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" event={"ID":"fb8c640e-379a-473c-9e6a-4a89ebdbb417","Type":"ContainerDied","Data":"d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600"} Jul 13 20:32:26.172270 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.172258 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" Jul 13 20:32:26.172356 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.172272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg" event={"ID":"fb8c640e-379a-473c-9e6a-4a89ebdbb417","Type":"ContainerDied","Data":"e65263c4ede77fe7a2adbba8f07ede9c662d3195f56faa4864e25fbd1f0943f5"} Jul 13 20:32:26.172356 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.172295 2579 scope.go:117] "RemoveContainer" containerID="d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600" Jul 13 20:32:26.180786 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.180771 2579 scope.go:117] "RemoveContainer" containerID="d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600" Jul 13 20:32:26.181037 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:32:26.181019 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600\": container with ID starting with d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600 not found: ID does not exist" containerID="d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600" Jul 13 20:32:26.181118 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.181045 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600"} err="failed to get container status \"d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600\": rpc error: code = NotFound desc = could not find container \"d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600\": container with ID starting with d2dea9d72b6d16f60a221ffbb02fef9f983c52f885c7ccb1565cf14dccffd600 not found: ID does not exist" Jul 13 20:32:26.191948 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.191927 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg"] Jul 13 20:32:26.197392 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.197372 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-732aa-5749bff444-gzmcg"] Jul 13 20:32:26.254988 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.254965 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb8c640e-379a-473c-9e6a-4a89ebdbb417-openshift-service-ca-bundle\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:32:26.254988 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.254986 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb8c640e-379a-473c-9e6a-4a89ebdbb417-proxy-tls\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:32:26.445198 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:32:26.445134 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" path="/var/lib/kubelet/pods/fb8c640e-379a-473c-9e6a-4a89ebdbb417/volumes" Jul 13 20:33:36.220101 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.220049 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq"] Jul 13 20:33:36.220662 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.220402 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" Jul 13 20:33:36.220662 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.220413 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" Jul 13 20:33:36.220662 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.220485 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb8c640e-379a-473c-9e6a-4a89ebdbb417" containerName="model-chainer-raw-732aa" Jul 13 20:33:36.223450 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.223433 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:36.225741 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.225716 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-553c9-kube-rbac-proxy-sar-config\"" Jul 13 20:33:36.225855 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.225743 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-553c9-serving-cert\"" Jul 13 20:33:36.225855 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.225751 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-d8krp\"" Jul 13 20:33:36.226324 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.226309 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 13 20:33:36.232630 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.232608 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq"] Jul 13 20:33:36.375199 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.375165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3a8d9f-6b39-471d-bde8-0afc6319210a-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-553c9-669bd4d77-4p6cq\" (UID: \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:36.375342 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.375253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca3a8d9f-6b39-471d-bde8-0afc6319210a-proxy-tls\") pod \"model-chainer-raw-hpa-553c9-669bd4d77-4p6cq\" (UID: \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:36.476443 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.476368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca3a8d9f-6b39-471d-bde8-0afc6319210a-proxy-tls\") pod \"model-chainer-raw-hpa-553c9-669bd4d77-4p6cq\" (UID: \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:36.476443 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.476436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3a8d9f-6b39-471d-bde8-0afc6319210a-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-553c9-669bd4d77-4p6cq\" (UID: \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:36.476601 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:33:36.476519 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-serving-cert: secret "model-chainer-raw-hpa-553c9-serving-cert" not found Jul 13 20:33:36.476601 ip-10-0-136-103 kubenswrapper[2579]: E0713 20:33:36.476590 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3a8d9f-6b39-471d-bde8-0afc6319210a-proxy-tls podName:ca3a8d9f-6b39-471d-bde8-0afc6319210a nodeName:}" failed. No retries permitted until 2026-07-13 20:33:36.976571497 +0000 UTC m=+883.822194853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ca3a8d9f-6b39-471d-bde8-0afc6319210a-proxy-tls") pod "model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" (UID: "ca3a8d9f-6b39-471d-bde8-0afc6319210a") : secret "model-chainer-raw-hpa-553c9-serving-cert" not found Jul 13 20:33:36.476992 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.476977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3a8d9f-6b39-471d-bde8-0afc6319210a-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-553c9-669bd4d77-4p6cq\" (UID: \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:36.981044 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.981015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca3a8d9f-6b39-471d-bde8-0afc6319210a-proxy-tls\") pod \"model-chainer-raw-hpa-553c9-669bd4d77-4p6cq\" (UID: \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:36.983345 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:36.983321 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca3a8d9f-6b39-471d-bde8-0afc6319210a-proxy-tls\") pod \"model-chainer-raw-hpa-553c9-669bd4d77-4p6cq\" (UID: \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:37.134851 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:37.134825 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:37.267038 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:37.267016 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq"] Jul 13 20:33:37.269659 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:33:37.269634 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3a8d9f_6b39_471d_bde8_0afc6319210a.slice/crio-d3f666d7405c1f098ea021c6c675772e7e3893338af06215314d56512fc9e16d WatchSource:0}: Error finding container d3f666d7405c1f098ea021c6c675772e7e3893338af06215314d56512fc9e16d: Status 404 returned error can't find the container with id d3f666d7405c1f098ea021c6c675772e7e3893338af06215314d56512fc9e16d Jul 13 20:33:37.489171 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:37.489133 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" event={"ID":"ca3a8d9f-6b39-471d-bde8-0afc6319210a","Type":"ContainerStarted","Data":"ab9b78f051cef24707f88c0b7ea3dd817e959951c575d5bc051a79f9860afac4"} Jul 13 20:33:37.489307 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:37.489280 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:37.489348 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:37.489308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" event={"ID":"ca3a8d9f-6b39-471d-bde8-0afc6319210a","Type":"ContainerStarted","Data":"d3f666d7405c1f098ea021c6c675772e7e3893338af06215314d56512fc9e16d"} Jul 13 20:33:37.506954 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:37.506902 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" podStartSLOduration=1.506888121 podStartE2EDuration="1.506888121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:33:37.505906192 +0000 UTC m=+884.351529573" watchObservedRunningTime="2026-07-13 20:33:37.506888121 +0000 UTC m=+884.352511524" Jul 13 20:33:43.498922 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:43.498897 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:33:46.273660 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:46.273575 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq"] Jul 13 20:33:46.274073 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:46.273798 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" containerID="cri-o://ab9b78f051cef24707f88c0b7ea3dd817e959951c575d5bc051a79f9860afac4" gracePeriod=30 Jul 13 20:33:48.497008 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:48.496969 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:33:53.497369 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:53.497331 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:33:54.758191 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:54.758155 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:33:54.760624 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:54.759123 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:33:54.762936 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:54.762917 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:33:54.763878 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:54.763860 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:33:54.769336 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:54.769316 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:33:54.770283 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:54.770263 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:33:58.497835 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:58.497797 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:33:58.498200 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:33:58.497896 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:34:03.496873 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:03.496834 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:34:08.497593 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:08.497557 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:34:13.497870 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:13.497831 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 20:34:16.677782 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:16.677698 2579 generic.go:356] "Generic (PLEG): container finished" podID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerID="ab9b78f051cef24707f88c0b7ea3dd817e959951c575d5bc051a79f9860afac4" exitCode=0 Jul 13 20:34:16.678169 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:16.677772 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" event={"ID":"ca3a8d9f-6b39-471d-bde8-0afc6319210a","Type":"ContainerDied","Data":"ab9b78f051cef24707f88c0b7ea3dd817e959951c575d5bc051a79f9860afac4"} Jul 13 20:34:16.929817 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:16.929764 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:34:16.990959 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:16.990931 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca3a8d9f-6b39-471d-bde8-0afc6319210a-proxy-tls\") pod \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\" (UID: \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\") " Jul 13 20:34:16.991121 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:16.990972 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3a8d9f-6b39-471d-bde8-0afc6319210a-openshift-service-ca-bundle\") pod \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\" (UID: \"ca3a8d9f-6b39-471d-bde8-0afc6319210a\") " Jul 13 20:34:16.991374 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:16.991354 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3a8d9f-6b39-471d-bde8-0afc6319210a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ca3a8d9f-6b39-471d-bde8-0afc6319210a" (UID: "ca3a8d9f-6b39-471d-bde8-0afc6319210a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 20:34:16.992895 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:16.992873 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3a8d9f-6b39-471d-bde8-0afc6319210a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ca3a8d9f-6b39-471d-bde8-0afc6319210a" (UID: "ca3a8d9f-6b39-471d-bde8-0afc6319210a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:34:17.091513 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:17.091485 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca3a8d9f-6b39-471d-bde8-0afc6319210a-proxy-tls\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:34:17.091513 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:17.091509 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3a8d9f-6b39-471d-bde8-0afc6319210a-openshift-service-ca-bundle\") on node \"ip-10-0-136-103.ec2.internal\" DevicePath \"\"" Jul 13 20:34:17.683456 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:17.683422 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" event={"ID":"ca3a8d9f-6b39-471d-bde8-0afc6319210a","Type":"ContainerDied","Data":"d3f666d7405c1f098ea021c6c675772e7e3893338af06215314d56512fc9e16d"} Jul 13 20:34:17.683456 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:17.683456 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq" Jul 13 20:34:17.683926 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:17.683482 2579 scope.go:117] "RemoveContainer" containerID="ab9b78f051cef24707f88c0b7ea3dd817e959951c575d5bc051a79f9860afac4" Jul 13 20:34:17.703289 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:17.703259 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq"] Jul 13 20:34:17.706745 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:17.706724 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-553c9-669bd4d77-4p6cq"] Jul 13 20:34:18.445286 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:34:18.445254 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" path="/var/lib/kubelet/pods/ca3a8d9f-6b39-471d-bde8-0afc6319210a/volumes" Jul 13 20:38:54.784904 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:38:54.784810 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:38:54.787939 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:38:54.786986 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:38:54.789593 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:38:54.789576 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:38:54.791697 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:38:54.791677 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:38:54.798377 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:38:54.798358 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:38:54.800438 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:38:54.800420 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:43:54.814114 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:43:54.813991 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:43:54.818088 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:43:54.818052 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:43:54.818786 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:43:54.818770 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:43:54.822857 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:43:54.822840 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:43:54.825106 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:43:54.825089 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:43:54.828811 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:43:54.828794 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:44:26.083359 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:26.083328 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4b8vd_843d1046-24bb-4afa-a9d6-04b55ff30163/global-pull-secret-syncer/0.log" Jul 13 20:44:26.289678 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:26.289647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l5s88_4ccfa1f6-8e9b-4f05-9aec-e315c4acd31d/konnectivity-agent/0.log" Jul 13 20:44:26.363569 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:26.363509 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-103.ec2.internal_9ce1c96c462bac221c22632c6690050c/haproxy/0.log" Jul 13 20:44:30.789256 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:30.789229 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/1.log" Jul 13 20:44:30.961366 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:30.961324 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mb8gp_df15cdd6-58e8-434a-8f53-e711defd5ee1/cluster-monitoring-operator/0.log" Jul 13 20:44:30.986395 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:30.986366 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-csk48_799006dd-374b-4520-85c8-ed8c12010b6c/kube-state-metrics/0.log" Jul 13 20:44:31.004989 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:31.004964 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-csk48_799006dd-374b-4520-85c8-ed8c12010b6c/kube-rbac-proxy-main/0.log" Jul 13 20:44:31.025876 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:31.025855 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-csk48_799006dd-374b-4520-85c8-ed8c12010b6c/kube-rbac-proxy-self/0.log" Jul 13 20:44:31.208998 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:31.208923 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpc6h_d7795fa4-64a1-480b-b223-b7ae3866ddf0/node-exporter/0.log" Jul 13 20:44:31.228830 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:31.228806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpc6h_d7795fa4-64a1-480b-b223-b7ae3866ddf0/kube-rbac-proxy/0.log" Jul 13 20:44:31.249072 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:31.249045 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpc6h_d7795fa4-64a1-480b-b223-b7ae3866ddf0/init-textfile/0.log" Jul 13 20:44:31.381639 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:31.381613 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4n2rr_1cce3fca-53fc-458d-970d-e0c8032a0dbe/kube-rbac-proxy-main/0.log" Jul 13 20:44:31.406788 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:31.406749 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4n2rr_1cce3fca-53fc-458d-970d-e0c8032a0dbe/kube-rbac-proxy-self/0.log" Jul 13 20:44:31.429539 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:31.429502 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4n2rr_1cce3fca-53fc-458d-970d-e0c8032a0dbe/openshift-state-metrics/0.log" Jul 13 20:44:33.188935 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:33.188906 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-kmxss_2d60f1b4-4230-4b66-9e24-f10be9dd0b2e/networking-console-plugin/0.log" Jul 13 20:44:33.663592 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:33.663561 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/2.log" Jul 13 20:44:33.671413 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:33.671384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ds7x7_ac2aa198-e44e-421a-b230-f1151d0a5845/console-operator/3.log" Jul 13 20:44:34.054621 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.054595 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dd7694c84-2nvl2_e654a04a-f899-4a39-800c-6b756e53d6f5/console/0.log" Jul 13 20:44:34.090447 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.090422 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-6lrjk_1cec0934-fcfd-4c11-9705-d15fe19fc6dd/download-server/0.log" Jul 13 20:44:34.260835 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.260805 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67"] Jul 13 20:44:34.261165 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.261131 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" Jul 13 20:44:34.261165 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.261143 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" Jul 13 20:44:34.261241 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.261214 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3a8d9f-6b39-471d-bde8-0afc6319210a" containerName="model-chainer-raw-hpa-553c9" Jul 13 20:44:34.264191 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.264170 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.266081 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.266040 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k5kgn\"/\"kube-root-ca.crt\"" Jul 13 20:44:34.266181 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.266044 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k5kgn\"/\"openshift-service-ca.crt\"" Jul 13 20:44:34.266458 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.266440 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k5kgn\"/\"default-dockercfg-rgvhk\"" Jul 13 20:44:34.271356 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.271336 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67"] Jul 13 20:44:34.373738 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.373684 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-sys\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.373738 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.373719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-podres\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.373868 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.373806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-proc\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.373868 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.373836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-lib-modules\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.373868 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.373855 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhg4s\" (UniqueName: \"kubernetes.io/projected/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-kube-api-access-rhg4s\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.474905 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.474882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-proc\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.475016 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.474908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-lib-modules\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.475016 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.474926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhg4s\" (UniqueName: \"kubernetes.io/projected/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-kube-api-access-rhg4s\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.475016 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.474964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-sys\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.475016 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.474995 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-proc\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.475016 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.474996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-podres\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.475299 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.475106 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-podres\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.475299 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.475120 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-sys\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.475299 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.475106 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-lib-modules\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.482337 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.482317 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhg4s\" (UniqueName: \"kubernetes.io/projected/2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2-kube-api-access-rhg4s\") pod \"perf-node-gather-daemonset-9tb67\" (UID: \"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2\") " pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.575214 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.575190 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:34.620725 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.620681 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-s5rcb_5874dd0e-2396-4ccc-9927-a00a1a0152c9/volume-data-source-validator/0.log" Jul 13 20:44:34.703479 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:34.703453 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67"] Jul 13 20:44:34.705558 ip-10-0-136-103 kubenswrapper[2579]: W0713 20:44:34.705533 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2aaacaa0_2e6c_4091_a273_0ffeba9ab9f2.slice/crio-68819e0cbeff10f095bfa3285a62d72dccb794432de0ba920ca103e665500fd3 WatchSource:0}: Error finding container 68819e0cbeff10f095bfa3285a62d72dccb794432de0ba920ca103e665500fd3: Status 404 returned error can't find the container with id 68819e0cbeff10f095bfa3285a62d72dccb794432de0ba920ca103e665500fd3 Jul 13 20:44:35.357752 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:35.357720 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" event={"ID":"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2","Type":"ContainerStarted","Data":"924d44089283dfd4156cc9c8e59e5d402dc688a8f59be61b6e67c730558ed5b0"} Jul 13 20:44:35.358210 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:35.357769 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" event={"ID":"2aaacaa0-2e6c-4091-a273-0ffeba9ab9f2","Type":"ContainerStarted","Data":"68819e0cbeff10f095bfa3285a62d72dccb794432de0ba920ca103e665500fd3"} Jul 13 20:44:35.358210 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:35.357861 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:35.374834 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:35.374791 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" podStartSLOduration=1.374778313 podStartE2EDuration="1.374778313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:44:35.373380835 +0000 UTC m=+1542.219004222" watchObservedRunningTime="2026-07-13 20:44:35.374778313 +0000 UTC m=+1542.220401719" Jul 13 20:44:35.601883 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:35.601856 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xt9sl_ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b/dns/0.log" Jul 13 20:44:35.623298 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:35.623239 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xt9sl_ac8c9f73-8d8a-4cc7-95ac-3a7ea1d5172b/kube-rbac-proxy/0.log" Jul 13 20:44:35.694074 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:35.694027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5lt8_a54b0936-585f-4e53-8676-22a998094566/dns-node-resolver/0.log" Jul 13 20:44:36.244793 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:36.244766 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6bf9_c21f4720-1194-47ad-9668-8be83c1a675d/node-ca/0.log" Jul 13 20:44:37.074577 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:37.074546 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7566899d6d-mtpt5_6aa5ad3e-945a-47b3-be93-f0ee06ab0574/router/0.log" Jul 13 20:44:37.433527 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:37.433457 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l6rc7_f067a1c5-ef63-4180-90c6-bdde795c45ff/serve-healthcheck-canary/0.log" Jul 13 20:44:37.841531 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:37.841499 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-w9wm9_3829d617-e9aa-4ba6-9d02-fe8e0c3932c5/insights-operator/0.log" Jul 13 20:44:37.842086 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:37.842041 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-w9wm9_3829d617-e9aa-4ba6-9d02-fe8e0c3932c5/insights-operator/1.log" Jul 13 20:44:37.935567 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:37.935534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8l48_a9bcfb11-121a-4350-a1ed-c3fabc0e484e/kube-rbac-proxy/0.log" Jul 13 20:44:37.953581 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:37.953559 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8l48_a9bcfb11-121a-4350-a1ed-c3fabc0e484e/exporter/0.log" Jul 13 20:44:37.972551 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:37.972525 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8l48_a9bcfb11-121a-4350-a1ed-c3fabc0e484e/extractor/0.log" Jul 13 20:44:40.068994 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:40.068959 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-68b649c569-cz996_6dab7b54-0be0-4eae-9622-624825a97c20/manager/0.log" Jul 13 20:44:40.250455 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:40.250426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-s822k_d4cc471f-4dbf-4cbb-8eb8-1b073a4e936f/manager/0.log" Jul 13 20:44:41.372045 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:41.372022 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k5kgn/perf-node-gather-daemonset-9tb67" Jul 13 20:44:44.468633 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:44.468600 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-pclwn_20250b6c-773c-46d9-b14c-9a80426b394c/kube-storage-version-migrator-operator/1.log" Jul 13 20:44:44.470120 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:44.470093 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-pclwn_20250b6c-773c-46d9-b14c-9a80426b394c/kube-storage-version-migrator-operator/0.log" Jul 13 20:44:45.697596 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:45.697521 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7hzx_508218ce-1c54-42c4-ac46-0a2aaa2dfcd2/kube-multus-additional-cni-plugins/0.log" Jul 13 20:44:45.716614 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:45.716585 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7hzx_508218ce-1c54-42c4-ac46-0a2aaa2dfcd2/egress-router-binary-copy/0.log" Jul 13 20:44:45.736881 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:45.736857 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7hzx_508218ce-1c54-42c4-ac46-0a2aaa2dfcd2/cni-plugins/0.log" Jul 13 20:44:45.754990 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:45.754972 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7hzx_508218ce-1c54-42c4-ac46-0a2aaa2dfcd2/bond-cni-plugin/0.log" Jul 13 20:44:45.773628 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:45.773605 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7hzx_508218ce-1c54-42c4-ac46-0a2aaa2dfcd2/routeoverride-cni/0.log" Jul 13 20:44:45.792028 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:45.792006 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7hzx_508218ce-1c54-42c4-ac46-0a2aaa2dfcd2/whereabouts-cni-bincopy/0.log" Jul 13 20:44:45.810441 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:45.810424 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f7hzx_508218ce-1c54-42c4-ac46-0a2aaa2dfcd2/whereabouts-cni/0.log" Jul 13 20:44:46.067594 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:46.067561 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dp6f8_3f2c18f2-0cfb-404e-8e5d-9b3e6b200f0f/kube-multus/0.log" Jul 13 20:44:46.206255 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:46.206231 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fgd98_4e9a31a5-740a-49f7-a36a-e0fc8cc83df2/network-metrics-daemon/0.log" Jul 13 20:44:46.228148 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:46.228129 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fgd98_4e9a31a5-740a-49f7-a36a-e0fc8cc83df2/kube-rbac-proxy/0.log" Jul 13 20:44:47.004329 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:47.004291 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-controller/0.log" Jul 13 20:44:47.021628 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:47.021594 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/1.log" Jul 13 20:44:47.021901 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:47.021885 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovn-acl-logging/0.log" Jul 13 20:44:47.040974 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:47.040954 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/kube-rbac-proxy-node/0.log" Jul 13 20:44:47.063068 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:47.063026 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/kube-rbac-proxy-ovn-metrics/0.log" Jul 13 20:44:47.080219 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:47.080195 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/northd/0.log" Jul 13 20:44:47.099945 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:47.099915 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/nbdb/0.log" Jul 13 20:44:47.118987 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:47.118968 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/sbdb/0.log" Jul 13 20:44:47.175821 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:47.175800 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6vz2w_354b055a-f556-4dc1-9af0-073c9132ce64/ovnkube-controller/0.log" Jul 13 20:44:48.564162 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:48.564125 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-57k6c_fbaa099e-ac4c-4c7b-bc7d-13fad446335a/check-endpoints/0.log" Jul 13 20:44:48.608516 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:48.608496 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-b757q_369082c4-9db4-4aa2-9327-6f87a74fb81b/network-check-target-container/0.log" Jul 13 20:44:49.540755 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:49.540728 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-g8kd2_bc79ec05-9471-4524-93d6-c2ebf0a37e87/iptables-alerter/0.log" Jul 13 20:44:50.195168 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:50.195126 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-86tqx_c2605218-19c6-4790-a5b6-86c9bc29e572/tuned/0.log" Jul 13 20:44:51.935166 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:51.935136 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-65db858894-f4mrv_e357c558-9aee-46e5-8ce5-74272e1560ab/cluster-samples-operator/0.log" Jul 13 20:44:51.949482 ip-10-0-136-103 kubenswrapper[2579]: I0713 20:44:51.949432 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-65db858894-f4mrv_e357c558-9aee-46e5-8ce5-74272e1560ab/cluster-samples-operator-watch/0.log"