Jul 14 15:08:38.331936 ip-10-0-137-89 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 15:08:38.331951 ip-10-0-137-89 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 15:08:38.331960 ip-10-0-137-89 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 15:08:38.332283 ip-10-0-137-89 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 15:08:48.510576 ip-10-0-137-89 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 15:08:48.510595 ip-10-0-137-89 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c4413304e2df4d93b2d9c1f4d8aa0a3d -- Jul 14 15:10:29.381980 ip-10-0-137-89 systemd[1]: Starting Kubernetes Kubelet... Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.794785 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799870 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799884 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799889 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799894 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799898 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799902 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799906 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:29.817629 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799910 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799914 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799917 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799921 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799934 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799939 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799942 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799946 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799951 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799956 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799962 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799966 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799971 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799974 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799978 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799982 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799987 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799991 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.799996 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:29.819625 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800000 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800004 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800008 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800011 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800015 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800019 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800030 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800034 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800038 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800042 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800046 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800049 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800053 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800057 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800061 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800065 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800070 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800075 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800078 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800082 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:29.838123 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800087 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800091 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800095 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800099 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800103 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800107 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800111 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800115 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800119 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800123 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800127 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800130 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800134 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800138 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800143 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800148 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800153 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800156 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800160 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:29.854993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800165 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800171 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800175 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800180 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800184 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800188 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800191 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800196 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800201 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800205 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800209 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800214 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800218 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800222 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800226 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800229 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800235 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800240 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800243 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800247 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:29.861910 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800252 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800256 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800260 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800264 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800268 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800272 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800277 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800281 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800284 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800287 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800290 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800292 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800295 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.800300 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801301 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801310 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801314 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801318 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801322 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:29.877324 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801328 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:29.877480 ip-10-0-137-89 systemd[1]: Started Kubernetes Kubelet. Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801334 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801338 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801342 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801354 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801359 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801363 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801367 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801370 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801374 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801378 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801382 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801386 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801392 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801397 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801401 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801405 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801408 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801413 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:29.879989 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801417 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801421 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801425 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801429 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801433 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801437 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801441 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801447 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801451 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801456 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801460 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801464 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801468 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801472 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801476 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801480 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801484 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801487 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801495 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801499 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:29.910827 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801503 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801507 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801511 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801514 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801518 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801523 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801526 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801530 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801534 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801537 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801541 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801545 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801551 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801555 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801559 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801562 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801566 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801570 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801574 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801580 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:29.933040 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801585 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801592 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801596 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801600 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801603 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801607 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801611 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801614 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801618 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801622 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801625 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801630 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801634 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801638 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801641 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801645 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801649 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801653 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801657 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:29.955866 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801660 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801679 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801683 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801687 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801691 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801694 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801699 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801703 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801706 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801710 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801714 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801717 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801723 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801727 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801733 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.801736 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802217 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802224 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802228 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802232 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:30.093413 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802236 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802239 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802243 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802247 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802252 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802256 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802259 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802263 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802266 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802270 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802274 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802278 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802282 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802286 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802289 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802293 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802296 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802300 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802304 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802308 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:30.094121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802311 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802314 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802318 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802322 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802327 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802331 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802337 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802341 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802345 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802349 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802353 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802357 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802360 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802364 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802368 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802371 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802375 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802379 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802383 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802387 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:30.219979 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802391 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802396 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802401 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802406 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802411 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802415 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802418 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802422 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802426 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802429 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802433 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802439 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802444 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802447 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802452 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802457 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802462 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802466 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802471 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:30.220740 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802475 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802479 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802482 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802486 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802490 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802493 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802497 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802501 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802505 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802511 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802516 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802520 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802524 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802528 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802531 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802535 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802539 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802542 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802547 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:30.221398 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802551 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802554 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802557 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802561 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802565 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802568 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802572 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802576 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802579 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802583 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802589 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802593 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802598 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802602 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802606 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802610 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.802614 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802717 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802726 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802733 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802739 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 15:10:30.222054 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802745 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802749 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802755 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802761 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802766 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802771 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802775 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802780 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802785 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802789 2585 flags.go:64] FLAG: --cgroup-root="" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802794 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802798 2585 flags.go:64] FLAG: --client-ca-file="" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802803 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802807 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802814 2585 flags.go:64] FLAG: --cluster-domain="" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802818 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802823 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802828 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802832 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802838 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802843 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802849 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802854 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802860 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 14 15:10:30.222659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802864 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802868 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802873 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802877 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802883 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802887 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802892 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802896 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802900 2585 flags.go:64] FLAG: --enable-server="true" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802905 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802911 2585 flags.go:64] FLAG: --event-burst="100" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802915 2585 flags.go:64] FLAG: --event-qps="50" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802919 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802923 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802926 2585 flags.go:64] FLAG: --eviction-hard="" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802929 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802932 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802935 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802938 2585 flags.go:64] FLAG: --eviction-soft="" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802941 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802944 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802947 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802949 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802952 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802955 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 15:10:30.223402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802958 2585 flags.go:64] FLAG: --feature-gates="" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802961 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802965 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802968 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802973 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802976 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802980 2585 flags.go:64] FLAG: --help="false" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802983 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802986 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802989 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802992 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802995 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.802999 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803002 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803004 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803007 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803010 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803013 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803016 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803019 2585 flags.go:64] FLAG: --kube-reserved="" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803022 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803025 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803028 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803031 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 15:10:30.224200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803034 2585 flags.go:64] FLAG: --lock-file="" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803036 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803039 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803042 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803047 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803050 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803053 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803055 2585 flags.go:64] FLAG: --logging-format="text" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803058 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803061 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803064 2585 flags.go:64] FLAG: --manifest-url="" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803067 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803072 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803075 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803081 2585 flags.go:64] FLAG: --max-pods="110" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803084 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803087 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803090 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803094 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803097 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803099 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803102 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803109 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803112 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803115 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 15:10:30.224961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803118 2585 flags.go:64] FLAG: --pod-cidr="" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803121 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803126 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803129 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803132 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803136 2585 flags.go:64] FLAG: --port="10250" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803139 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803141 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08ee7891084a913b1" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803144 2585 flags.go:64] FLAG: --qos-reserved="" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803147 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803150 2585 flags.go:64] FLAG: --register-node="true" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803153 2585 flags.go:64] FLAG: --register-with-taints="" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803156 2585 flags.go:64] FLAG: --registry-burst="10" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803159 2585 flags.go:64] FLAG: --registry-qps="5" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803162 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803164 2585 flags.go:64] FLAG: --reserved-memory="" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803168 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803171 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803174 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803178 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803181 2585 flags.go:64] FLAG: --runonce="false" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803184 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803188 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803191 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803194 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 15:10:30.225682 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803196 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803199 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803202 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803205 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803208 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803211 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803214 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803217 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803220 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803223 2585 flags.go:64] FLAG: --system-cgroups="" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803226 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803231 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803233 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803237 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803241 2585 flags.go:64] FLAG: --tls-min-version="" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803244 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803246 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803249 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803252 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803255 2585 flags.go:64] FLAG: --v="2" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803258 2585 flags.go:64] FLAG: --version="false" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803262 2585 flags.go:64] FLAG: --vmodule="" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803265 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.803268 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803647 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:30.226452 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803657 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803683 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803689 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803693 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803701 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803705 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803710 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803715 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803725 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803730 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803734 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803741 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803746 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803751 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803755 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803760 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803764 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803768 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803772 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:30.227150 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803777 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803786 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803792 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803797 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803801 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803805 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803809 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803814 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803818 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803822 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803827 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803831 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803835 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803840 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803851 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803855 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803860 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803866 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803870 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803874 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:30.227724 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803878 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803883 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803887 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803891 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803895 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803900 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803909 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803913 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803917 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803921 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803925 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803929 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803936 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803942 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803947 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803953 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803957 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803962 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803966 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803976 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:30.228289 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803981 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803986 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803990 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803995 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.803999 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804004 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804010 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804014 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804019 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804025 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804030 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804039 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804044 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804048 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804052 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804057 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804061 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804066 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804070 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:30.228889 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804077 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804082 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804087 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804092 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804101 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804106 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804110 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804114 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804119 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804124 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804128 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804132 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804136 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804140 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804145 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804149 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804153 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804162 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804167 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:30.229391 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.804172 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.804971 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.811958 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.811984 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.812004 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.812009 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812065 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812070 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812073 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812077 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812080 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812083 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812086 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812089 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:30.230024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812092 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812095 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812098 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812100 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812103 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812106 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812108 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812111 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812113 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812117 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812121 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812124 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812126 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812129 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812131 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812134 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812136 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812139 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812142 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812146 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:30.230486 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812149 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812152 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812155 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812157 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812160 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812163 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812165 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812167 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812170 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812173 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812175 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812178 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812182 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812186 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812189 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812191 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812194 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812196 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812199 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:30.231090 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812201 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812204 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812207 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812211 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812214 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812216 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812219 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812221 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812223 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812226 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812228 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812231 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812235 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812238 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812240 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812243 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812245 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812248 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812250 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812253 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:30.233939 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812256 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812259 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812263 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812267 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812269 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812272 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812275 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812277 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812280 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812282 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812285 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812288 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812291 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812293 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812296 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812302 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812305 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812308 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812310 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:30.234556 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812314 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812317 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812320 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812322 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812325 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812329 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812332 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812334 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812337 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812339 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812342 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812344 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812347 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.812353 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812462 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:30.235960 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812466 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812468 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812471 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812474 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812477 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812480 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812483 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812486 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812489 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812493 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812496 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812499 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812501 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812506 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812509 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812511 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812514 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812516 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812519 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812521 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:30.236417 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812524 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812526 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812529 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812534 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812537 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812541 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812545 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812548 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812551 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812553 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812556 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812559 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812562 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812565 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812568 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812570 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812573 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812576 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812578 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:30.416456 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812581 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812583 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812586 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812589 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812591 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812594 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812598 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812601 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812603 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812606 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812608 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812611 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812613 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812616 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812618 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812621 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812625 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812628 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812631 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812633 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:30.417063 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812636 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812639 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812641 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812644 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812646 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812649 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812651 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812654 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812656 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812659 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812661 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812664 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812683 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812686 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812688 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812691 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812694 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812696 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812700 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:30.417599 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812703 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812705 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812708 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812710 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812713 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812715 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812718 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812721 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812723 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812727 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812729 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812732 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812736 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812740 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812742 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812745 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812748 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812751 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812754 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:30.418148 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:29.812757 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.812762 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.812860 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.816002 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.817432 2585 server.go:1019] "Starting client certificate rotation" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.817540 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.817579 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.820061 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.821690 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.835243 2585 log.go:25] "Validated CRI v1 runtime API" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.839313 2585 log.go:25] "Validated CRI v1 image API" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.840074 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 15:10:30.418663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.846436 2585 fs.go:135] Filesystem UUIDs: map[63600bb1-432a-49a7-955a-bad10f3d9bb0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 955a0edb-60cd-4285-9cfc-257b74cd8cef:/dev/nvme0n1p3] Jul 14 15:10:30.419079 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.846477 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 15:10:30.419079 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.848063 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.853937 2585 manager.go:216] Machine: {Timestamp:2026-07-14 15:10:29.851989787 +0000 UTC m=+0.352462358 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093878 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25af04e28455adf621876097a0b7d1 SystemUUID:ec25af04-e284-55ad-f621-876097a0b7d1 BootID:c4413304-e2df-4d93-b2d9-c1f4d8aa0a3d Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:17:a0:dd:ea:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:17:a0:dd:ea:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:49:76:e7:69:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.854058 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.854157 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.856714 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.856739 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-89.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.858181 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.858192 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.858201 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.858796 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.861941 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.865272 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.865386 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.865413 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.865423 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.865436 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.865446 2585 kubelet.go:398] "Adding apiserver pod source" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.865456 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 15:10:30.419250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.865807 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.865828 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.867969 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.870407 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.870433 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.870567 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.870580 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.870587 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.870592 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.870602 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.870607 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.871289 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.871296 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.871303 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.871308 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.871325 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.871333 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.871961 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.871969 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.874965 2585 server.go:1268] "Started kubelet" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.875047 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.875051 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.875141 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.876403 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.877518 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.878266 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-89.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.878441 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.878614 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.881073 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.881390 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-89.ec2.internal.18c230978e2253b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-89.ec2.internal,UID:ip-10-0-137-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-89.ec2.internal,},FirstTimestamp:2026-07-14 15:10:29.874946994 +0000 UTC m=+0.375419564,LastTimestamp:2026-07-14 15:10:29.874946994 +0000 UTC m=+0.375419564,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-89.ec2.internal,}" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.883298 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.883335 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.883366 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.883930 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.883950 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.883980 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.884052 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.884066 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.884765 2585 factory.go:153] Registering CRI-O factory Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.884780 2585 factory.go:223] Registration of the crio container factory successfully Jul 14 15:10:30.419803 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.884830 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.884839 2585 factory.go:55] Registering systemd factory Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.884846 2585 factory.go:223] Registration of the systemd container factory successfully Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.884866 2585 factory.go:103] Registering Raw factory Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.884879 2585 manager.go:1196] Started watching for new ooms in manager Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.886019 2585 manager.go:349] Starting recovery of all containers Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.895324 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.895363 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.899199 2585 manager.go:354] Recovery completed Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.903420 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.904851 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8dwk6" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.905469 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.905504 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.905518 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.906075 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.906087 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.906100 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.906105 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.906857 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.906885 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.906900 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.907447 2585 policy_none.go:49] "None policy: Start" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.907463 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.907486 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.908820 2585 policy_none.go:47] "Start" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.913517 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8dwk6" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.914605 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-89.ec2.internal.18c230978ff44e1b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-89.ec2.internal,UID:ip-10-0-137-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-89.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-89.ec2.internal,},FirstTimestamp:2026-07-14 15:10:29.905485339 +0000 UTC m=+0.405957914,LastTimestamp:2026-07-14 15:10:29.905485339 +0000 UTC m=+0.405957914,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-89.ec2.internal,}" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.918449 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-89.ec2.internal.18c230978ff4b1b7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-89.ec2.internal,UID:ip-10-0-137-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-89.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-89.ec2.internal,},FirstTimestamp:2026-07-14 15:10:29.905510839 +0000 UTC m=+0.405983411,LastTimestamp:2026-07-14 15:10:29.905510839 +0000 UTC m=+0.405983411,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-89.ec2.internal,}" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.971879 2585 manager.go:337] "Starting Device Plugin manager" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.971950 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.971965 2585 server.go:87] "Starting device plugin registration server" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.972183 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.972196 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.972285 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 15:10:30.420900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.972534 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:29.972543 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.972923 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:29.972978 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.017143 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.018436 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.018466 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.018488 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.018520 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.021070 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.072473 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.073343 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.073367 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.073378 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.073399 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.083273 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.083293 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-89.ec2.internal\": node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.126267 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.126306 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal"] Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.126366 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.128013 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.128039 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.128053 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.129269 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.129392 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.129420 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.130090 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.130101 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.130114 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.130124 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.130126 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.130135 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.131333 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.131353 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.131993 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.132019 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.132032 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.167357 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-89.ec2.internal\" not found" node="ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.421832 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.180157 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-89.ec2.internal\" not found" node="ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.185388 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de3f0c058702c4bc5b538ac4c27a4cf9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal\" (UID: \"de3f0c058702c4bc5b538ac4c27a4cf9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.185412 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de3f0c058702c4bc5b538ac4c27a4cf9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal\" (UID: \"de3f0c058702c4bc5b538ac4c27a4cf9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.185431 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/337d027ddbda42a4cd3b3abf536a25de-config\") pod \"kube-apiserver-proxy-ip-10-0-137-89.ec2.internal\" (UID: \"337d027ddbda42a4cd3b3abf536a25de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.226524 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.286445 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/337d027ddbda42a4cd3b3abf536a25de-config\") pod \"kube-apiserver-proxy-ip-10-0-137-89.ec2.internal\" (UID: \"337d027ddbda42a4cd3b3abf536a25de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.286475 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de3f0c058702c4bc5b538ac4c27a4cf9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal\" (UID: \"de3f0c058702c4bc5b538ac4c27a4cf9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.286494 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de3f0c058702c4bc5b538ac4c27a4cf9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal\" (UID: \"de3f0c058702c4bc5b538ac4c27a4cf9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.286550 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/337d027ddbda42a4cd3b3abf536a25de-config\") pod \"kube-apiserver-proxy-ip-10-0-137-89.ec2.internal\" (UID: \"337d027ddbda42a4cd3b3abf536a25de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.286600 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de3f0c058702c4bc5b538ac4c27a4cf9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal\" (UID: \"de3f0c058702c4bc5b538ac4c27a4cf9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.286631 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de3f0c058702c4bc5b538ac4c27a4cf9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal\" (UID: \"de3f0c058702c4bc5b538ac4c27a4cf9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.422896 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.326707 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.594054 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.427327 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.594054 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.481431 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.594054 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.482509 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal" Jul 14 15:10:30.594054 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.527551 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.767788 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.628070 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.767788 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.728506 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:30.767788 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.750367 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:32.536092 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.816786 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 15:10:32.536092 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.816925 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 15:10:32.536092 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:30.816957 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 15:10:32.536092 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:30.829492 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:32.625510 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:32.543389 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 15:05:31 +0000 UTC" deadline="2027-12-08 09:58:45.414468384 +0000 UTC" Jul 14 15:10:32.625510 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:32.543415 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12282h48m12.871057411s" Jul 14 15:10:32.625510 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:32.555516 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:32.764745 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:32.640127 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:32.764745 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:32.641699 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:32.764745 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:32.641733 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:32.764745 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:32.641747 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:32.764745 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:32.655837 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:32.764745 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:32.698750 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:32.764745 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:32.724715 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337d027ddbda42a4cd3b3abf536a25de.slice/crio-7393e73a72435e86c67bc3d85886f44f51e297f185cc72177ca929eccceae8ce WatchSource:0}: Error finding container 7393e73a72435e86c67bc3d85886f44f51e297f185cc72177ca929eccceae8ce: Status 404 returned error can't find the container with id 7393e73a72435e86c67bc3d85886f44f51e297f185cc72177ca929eccceae8ce Jul 14 15:10:32.764745 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:32.729228 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 15:10:32.764745 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:32.756897 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:32.964154 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:32.857348 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:32.964154 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:32.957957 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-89.ec2.internal\" not found" Jul 14 15:10:32.965176 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:32.964878 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:33.168023 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:32.988633 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3f0c058702c4bc5b538ac4c27a4cf9.slice/crio-3c8cf776d2adb2c9212c18c38441df3b0f32a081f96e5ae64ca0f25ec632f64f WatchSource:0}: Error finding container 3c8cf776d2adb2c9212c18c38441df3b0f32a081f96e5ae64ca0f25ec632f64f: Status 404 returned error can't find the container with id 3c8cf776d2adb2c9212c18c38441df3b0f32a081f96e5ae64ca0f25ec632f64f Jul 14 15:10:33.168023 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.009889 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" Jul 14 15:10:33.168023 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.026925 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 15:10:33.168023 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.027867 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal" Jul 14 15:10:33.168023 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.037931 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.491563 2585 apiserver.go:52] "Watching apiserver" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.501820 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.502159 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-sfsv6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal","openshift-multus/multus-additional-cni-plugins-jhmb8","openshift-multus/network-metrics-daemon-6qjr4","openshift-network-diagnostics/network-check-target-228j9","kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f","openshift-cluster-node-tuning-operator/tuned-dl86s","openshift-multus/multus-wwhqt","openshift-network-operator/iptables-alerter-x4fm7","openshift-ovn-kubernetes/ovnkube-node-8khwt","kube-system/global-pull-secret-syncer-zq7j2","kube-system/konnectivity-agent-hvgvs","openshift-dns/node-resolver-jt4bd"] Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.504208 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.504908 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.506577 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.507426 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.507455 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.507638 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.507729 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mfsxc\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.507754 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qmtdb\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.507877 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.507941 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.508093 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.508101 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.508148 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.508284 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.508889 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.509144 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.509326 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.509442 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.509573 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rb4rl\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.509814 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.510039 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.515901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.510543 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.517048 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.516865 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 15:10:33.517818 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.517645 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:33.518824 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.518659 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.518856 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.518994 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-br2cp\"" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.519025 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.519220 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tlgxs\"" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.519264 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.519463 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.519546 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-psnr6\"" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.519877 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-tuned\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.519916 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.519943 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlw9h\" (UniqueName: \"kubernetes.io/projected/10fc53e3-505f-404c-a379-c96f6c1e0ef4-kube-api-access-jlw9h\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.519965 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-var-lib-cni-multus\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520011 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxvl\" (UniqueName: \"kubernetes.io/projected/031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4-kube-api-access-ccxvl\") pod \"iptables-alerter-x4fm7\" (UID: \"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4\") " pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520044 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aefa2d6-4dd1-4a6c-aba0-980d23df0f42-tmp-dir\") pod \"node-resolver-jt4bd\" (UID: \"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42\") " pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520101 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-kubernetes\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520170 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ebbefc1-c122-449e-97d8-85c026d7bb32-tmp\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520210 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-system-cni-dir\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520238 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-conf-dir\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520277 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-run-multus-certs\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520315 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4-iptables-alerter-script\") pod \"iptables-alerter-x4fm7\" (UID: \"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4\") " pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520342 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.621520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520344 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d46a976a-5e32-4f3c-a844-24aa323c4ffd-host\") pod \"node-ca-sfsv6\" (UID: \"d46a976a-5e32-4f3c-a844-24aa323c4ffd\") " pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520453 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmjbj\" (UniqueName: \"kubernetes.io/projected/d46a976a-5e32-4f3c-a844-24aa323c4ffd-kube-api-access-fmjbj\") pod \"node-ca-sfsv6\" (UID: \"d46a976a-5e32-4f3c-a844-24aa323c4ffd\") " pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520503 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2227\" (UniqueName: \"kubernetes.io/projected/3ebbefc1-c122-449e-97d8-85c026d7bb32-kube-api-access-v2227\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520535 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-run-netns\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520590 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-var-lib-cni-bin\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520629 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxnpt\" (UniqueName: \"kubernetes.io/projected/8aefa2d6-4dd1-4a6c-aba0-980d23df0f42-kube-api-access-zxnpt\") pod \"node-resolver-jt4bd\" (UID: \"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42\") " pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520660 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-var-lib-kubelet\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520719 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-os-release\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520768 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520802 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520825 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-cni-dir\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.520843 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-os-release\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.521808 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca8e4bb9-9873-450a-9016-29c671599bfd-cni-binary-copy\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.521857 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4-host-slash\") pod \"iptables-alerter-x4fm7\" (UID: \"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4\") " pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.521885 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-systemd\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.521903 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-run\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.521928 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-system-cni-dir\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.622731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.521955 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-cnibin\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.521979 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-socket-dir-parent\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522007 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522006 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbthl\" (UniqueName: \"kubernetes.io/projected/ca8e4bb9-9873-450a-9016-29c671599bfd-kube-api-access-qbthl\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522089 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8aefa2d6-4dd1-4a6c-aba0-980d23df0f42-hosts-file\") pod \"node-resolver-jt4bd\" (UID: \"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42\") " pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522116 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-sysconfig\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522139 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-sysctl-d\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522153 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522161 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-sys\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522188 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522224 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c28wx\"" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522230 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-hostroot\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522252 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-daemon-config\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522274 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-etc-kubernetes\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522293 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-modprobe-d\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522307 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj26k\" (UniqueName: \"kubernetes.io/projected/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-kube-api-access-xj26k\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522322 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-run-k8s-cni-cncf-io\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522342 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-var-lib-kubelet\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.624225 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522362 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8-konnectivity-ca\") pod \"konnectivity-agent-hvgvs\" (UID: \"9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8\") " pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522378 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d46a976a-5e32-4f3c-a844-24aa323c4ffd-serviceca\") pod \"node-ca-sfsv6\" (UID: \"d46a976a-5e32-4f3c-a844-24aa323c4ffd\") " pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522397 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-lib-modules\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522418 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522437 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8-agent-certs\") pod \"konnectivity-agent-hvgvs\" (UID: \"9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8\") " pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522458 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-cnibin\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522474 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-sysctl-conf\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522503 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522505 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-host\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.522708 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.523120 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.523770 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.523801 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f4lml\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.524472 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.524534 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.525448 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.525649 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.525667 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.525789 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.525868 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.526007 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.526062 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.526354 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pt7p7\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.526639 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.530120 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 15:10:33.625275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.553351 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-thjbr" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.558976 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-thjbr" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.611124 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623611 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-sysctl-conf\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623643 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-tuned\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623668 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623769 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-sysctl-conf\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623786 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-var-lib-cni-multus\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623814 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623816 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxvl\" (UniqueName: \"kubernetes.io/projected/031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4-kube-api-access-ccxvl\") pod \"iptables-alerter-x4fm7\" (UID: \"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4\") " pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623868 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aefa2d6-4dd1-4a6c-aba0-980d23df0f42-tmp-dir\") pod \"node-resolver-jt4bd\" (UID: \"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42\") " pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623856 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-var-lib-cni-multus\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623892 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-kubernetes\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623955 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.623993 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-kubernetes\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624023 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-slash\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624044 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624071 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4-iptables-alerter-script\") pod \"iptables-alerter-x4fm7\" (UID: \"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4\") " pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.628730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624107 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d46a976a-5e32-4f3c-a844-24aa323c4ffd-host\") pod \"node-ca-sfsv6\" (UID: \"d46a976a-5e32-4f3c-a844-24aa323c4ffd\") " pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624123 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aefa2d6-4dd1-4a6c-aba0-980d23df0f42-tmp-dir\") pod \"node-resolver-jt4bd\" (UID: \"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42\") " pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2227\" (UniqueName: \"kubernetes.io/projected/3ebbefc1-c122-449e-97d8-85c026d7bb32-kube-api-access-v2227\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624229 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d46a976a-5e32-4f3c-a844-24aa323c4ffd-host\") pod \"node-ca-sfsv6\" (UID: \"d46a976a-5e32-4f3c-a844-24aa323c4ffd\") " pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624268 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-run-netns\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624386 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-env-overrides\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624413 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnpt\" (UniqueName: \"kubernetes.io/projected/8aefa2d6-4dd1-4a6c-aba0-980d23df0f42-kube-api-access-zxnpt\") pod \"node-resolver-jt4bd\" (UID: \"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42\") " pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624420 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-run-netns\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624438 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-var-lib-kubelet\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624462 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-os-release\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624501 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-os-release\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624527 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8-konnectivity-ca\") pod \"konnectivity-agent-hvgvs\" (UID: \"9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8\") " pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624610 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4-iptables-alerter-script\") pod \"iptables-alerter-x4fm7\" (UID: \"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4\") " pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624613 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-os-release\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624638 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-cni-netd\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624852 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-systemd\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624933 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8-konnectivity-ca\") pod \"konnectivity-agent-hvgvs\" (UID: \"9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8\") " pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624536 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-var-lib-kubelet\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.630392 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.624701 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-systemd\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625272 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-cnibin\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625293 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-socket-dir-parent\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625308 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-socket-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625331 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-sysconfig\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625356 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-sysctl-d\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625380 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-etc-kubernetes\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625385 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-cnibin\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625403 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-modprobe-d\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625416 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-sysconfig\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625427 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-run-k8s-cni-cncf-io\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625439 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-socket-dir-parent\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625473 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-etc-kubernetes\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625495 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-sysctl-d\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625508 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-run-k8s-cni-cncf-io\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625507 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4a6247b-81bd-4835-ae81-f0a07a52af12-kubelet-config\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625518 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-modprobe-d\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625544 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-lib-modules\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.631424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625567 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-node-log\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625584 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-os-release\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625587 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-log-socket\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625615 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-device-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625633 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-cnibin\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625655 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-host\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625658 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-lib-modules\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625675 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-cnibin\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625680 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlw9h\" (UniqueName: \"kubernetes.io/projected/10fc53e3-505f-404c-a379-c96f6c1e0ef4-kube-api-access-jlw9h\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625703 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-run-multus-certs\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625713 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-host\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625728 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-etc-openvswitch\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625763 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-run-multus-certs\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625832 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-cni-bin\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625861 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4a6247b-81bd-4835-ae81-f0a07a52af12-dbus\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625885 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625911 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ebbefc1-c122-449e-97d8-85c026d7bb32-tmp\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.633102 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625928 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-system-cni-dir\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625958 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-conf-dir\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.625980 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-run-netns\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626003 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-system-cni-dir\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626002 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whk8v\" (UniqueName: \"kubernetes.io/projected/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-kube-api-access-whk8v\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626032 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-conf-dir\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626036 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626075 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmjbj\" (UniqueName: \"kubernetes.io/projected/d46a976a-5e32-4f3c-a844-24aa323c4ffd-kube-api-access-fmjbj\") pod \"node-ca-sfsv6\" (UID: \"d46a976a-5e32-4f3c-a844-24aa323c4ffd\") " pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626101 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-var-lib-cni-bin\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626130 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-ovn-node-metrics-cert\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626157 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626181 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626205 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-cni-dir\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626230 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca8e4bb9-9873-450a-9016-29c671599bfd-cni-binary-copy\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626240 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-var-lib-cni-bin\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626257 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626281 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-ovnkube-config\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.635929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626304 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-sys-fs\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626327 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkp2d\" (UniqueName: \"kubernetes.io/projected/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-kube-api-access-hkp2d\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626353 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4-host-slash\") pod \"iptables-alerter-x4fm7\" (UID: \"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4\") " pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626362 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-cni-dir\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626381 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-run\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626407 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-system-cni-dir\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626433 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbthl\" (UniqueName: \"kubernetes.io/projected/ca8e4bb9-9873-450a-9016-29c671599bfd-kube-api-access-qbthl\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.626448 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.627445 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs podName:10fc53e3-505f-404c-a379-c96f6c1e0ef4 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:34.126510633 +0000 UTC m=+3.001172547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs") pod "network-metrics-daemon-6qjr4" (UID: "10fc53e3-505f-404c-a379-c96f6c1e0ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.626457 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8-agent-certs\") pod \"konnectivity-agent-hvgvs\" (UID: \"9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8\") " pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.627696 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.627813 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-system-cni-dir\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.627855 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4-host-slash\") pod \"iptables-alerter-x4fm7\" (UID: \"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4\") " pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.627897 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ebbefc1-c122-449e-97d8-85c026d7bb32-etc-tuned\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.627916 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-run\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.628051 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-systemd-units\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.628085 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-run-ovn\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.636870 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.628281 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca8e4bb9-9873-450a-9016-29c671599bfd-cni-binary-copy\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.628334 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8aefa2d6-4dd1-4a6c-aba0-980d23df0f42-hosts-file\") pod \"node-resolver-jt4bd\" (UID: \"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42\") " pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.628386 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8aefa2d6-4dd1-4a6c-aba0-980d23df0f42-hosts-file\") pod \"node-resolver-jt4bd\" (UID: \"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42\") " pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.628416 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ebbefc1-c122-449e-97d8-85c026d7bb32-tmp\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.629558 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8-agent-certs\") pod \"konnectivity-agent-hvgvs\" (UID: \"9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8\") " pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635316 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-sys\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635384 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635499 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-hostroot\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635569 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ebbefc1-c122-449e-97d8-85c026d7bb32-sys\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635633 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-hostroot\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635665 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-daemon-config\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635691 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-kubelet\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635722 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-var-lib-openvswitch\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635753 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj26k\" (UniqueName: \"kubernetes.io/projected/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-kube-api-access-xj26k\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635803 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-var-lib-kubelet\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635831 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-run-systemd\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-registration-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.638515 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635883 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635902 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxvl\" (UniqueName: \"kubernetes.io/projected/031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4-kube-api-access-ccxvl\") pod \"iptables-alerter-x4fm7\" (UID: \"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4\") " pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.635916 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d46a976a-5e32-4f3c-a844-24aa323c4ffd-serviceca\") pod \"node-ca-sfsv6\" (UID: \"d46a976a-5e32-4f3c-a844-24aa323c4ffd\") " pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.636279 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.636338 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.636364 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-run-openvswitch\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.636386 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-ovnkube-script-lib\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.636519 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d46a976a-5e32-4f3c-a844-24aa323c4ffd-serviceca\") pod \"node-ca-sfsv6\" (UID: \"d46a976a-5e32-4f3c-a844-24aa323c4ffd\") " pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.636587 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca8e4bb9-9873-450a-9016-29c671599bfd-host-var-lib-kubelet\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.637088 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca8e4bb9-9873-450a-9016-29c671599bfd-multus-daemon-config\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.637432 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2227\" (UniqueName: \"kubernetes.io/projected/3ebbefc1-c122-449e-97d8-85c026d7bb32-kube-api-access-v2227\") pod \"tuned-dl86s\" (UID: \"3ebbefc1-c122-449e-97d8-85c026d7bb32\") " pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.637615 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.638099 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlw9h\" (UniqueName: \"kubernetes.io/projected/10fc53e3-505f-404c-a379-c96f6c1e0ef4-kube-api-access-jlw9h\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.639401 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxnpt\" (UniqueName: \"kubernetes.io/projected/8aefa2d6-4dd1-4a6c-aba0-980d23df0f42-kube-api-access-zxnpt\") pod \"node-resolver-jt4bd\" (UID: \"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42\") " pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.639888 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.639780 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbthl\" (UniqueName: \"kubernetes.io/projected/ca8e4bb9-9873-450a-9016-29c671599bfd-kube-api-access-qbthl\") pod \"multus-wwhqt\" (UID: \"ca8e4bb9-9873-450a-9016-29c671599bfd\") " pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.641270 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.639937 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmjbj\" (UniqueName: \"kubernetes.io/projected/d46a976a-5e32-4f3c-a844-24aa323c4ffd-kube-api-access-fmjbj\") pod \"node-ca-sfsv6\" (UID: \"d46a976a-5e32-4f3c-a844-24aa323c4ffd\") " pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.649126 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.646247 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj26k\" (UniqueName: \"kubernetes.io/projected/6513bd8b-e3f7-4b46-8145-97d98ddc5dc4-kube-api-access-xj26k\") pod \"multus-additional-cni-plugins-jhmb8\" (UID: \"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4\") " pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.652200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.651291 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" event={"ID":"de3f0c058702c4bc5b538ac4c27a4cf9","Type":"ContainerStarted","Data":"3c8cf776d2adb2c9212c18c38441df3b0f32a081f96e5ae64ca0f25ec632f64f"} Jul 14 15:10:33.653067 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.652817 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal" event={"ID":"337d027ddbda42a4cd3b3abf536a25de","Type":"ContainerStarted","Data":"7393e73a72435e86c67bc3d85886f44f51e297f185cc72177ca929eccceae8ce"} Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737212 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-systemd-units\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737246 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-run-ovn\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737267 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-kubelet\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737289 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-var-lib-openvswitch\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737314 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-run-systemd\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737327 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-systemd-units\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737338 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-registration-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737359 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737358 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-run-ovn\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737385 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-run-openvswitch\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737408 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-ovnkube-script-lib\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737420 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-run-openvswitch\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737375 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-var-lib-openvswitch\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737437 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737375 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-kubelet\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737381 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-run-systemd\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.797709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737463 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-slash\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-registration-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737495 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737530 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-env-overrides\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737532 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737542 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737543 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737561 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-slash\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737605 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-cni-netd\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737556 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-cni-netd\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737650 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-socket-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737680 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4a6247b-81bd-4835-ae81-f0a07a52af12-kubelet-config\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737719 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-node-log\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737745 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-log-socket\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737776 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-device-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737801 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-etc-openvswitch\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737801 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-socket-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.799222 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737822 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-cni-bin\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737844 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4a6247b-81bd-4835-ae81-f0a07a52af12-dbus\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737849 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-log-socket\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737870 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737895 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4a6247b-81bd-4835-ae81-f0a07a52af12-kubelet-config\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737904 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-run-netns\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737930 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whk8v\" (UniqueName: \"kubernetes.io/projected/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-kube-api-access-whk8v\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737931 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-node-log\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737979 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-env-overrides\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.737980 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-cni-bin\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738000 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738030 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-ovn-node-metrics-cert\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.738036 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738136 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738162 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-run-netns\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738178 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-ovnkube-config\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738071 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-etc-openvswitch\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738209 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-sys-fs\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.800086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738220 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738084 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-device-dir\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738241 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkp2d\" (UniqueName: \"kubernetes.io/projected/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-kube-api-access-hkp2d\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738234 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4a6247b-81bd-4835-ae81-f0a07a52af12-dbus\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738039 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-ovnkube-script-lib\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.738271 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret podName:a4a6247b-81bd-4835-ae81-f0a07a52af12 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:34.238253384 +0000 UTC m=+3.112915309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret") pod "global-pull-secret-syncer-zq7j2" (UID: "a4a6247b-81bd-4835-ae81-f0a07a52af12") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738276 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-sys-fs\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.738626 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-ovnkube-config\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.740575 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-ovn-node-metrics-cert\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.760119 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.760142 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.760156 2585 projected.go:196] Error preparing data for projected volume kube-api-access-zt5kn for pod openshift-network-diagnostics/network-check-target-228j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:33.760223 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn podName:867d8cf3-1d05-4535-a7fd-54f866b89f96 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:34.260206922 +0000 UTC m=+3.134868825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zt5kn" (UniqueName: "kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn") pod "network-check-target-228j9" (UID: "867d8cf3-1d05-4535-a7fd-54f866b89f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.761674 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkp2d\" (UniqueName: \"kubernetes.io/projected/fdec6018-661a-4e86-8c9e-4e1203e9d3ca-kube-api-access-hkp2d\") pod \"aws-ebs-csi-driver-node-v6s8f\" (UID: \"fdec6018-661a-4e86-8c9e-4e1203e9d3ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.802232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.765223 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whk8v\" (UniqueName: \"kubernetes.io/projected/8ad40ef9-c129-40f8-87c3-31ad85ca85b8-kube-api-access-whk8v\") pod \"ovnkube-node-8khwt\" (UID: \"8ad40ef9-c129-40f8-87c3-31ad85ca85b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.809368 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.808638 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:33.823148 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.822298 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4fm7" Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.830423 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sfsv6" Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:33.831701 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031ed674_1bcb_4cfd_b84a_d70e1e1d3ad4.slice/crio-f361dea45d1b3d42c8deee88e3d95c057b9fd6708ede3033c18fd3ebba3d091b WatchSource:0}: Error finding container f361dea45d1b3d42c8deee88e3d95c057b9fd6708ede3033c18fd3ebba3d091b: Status 404 returned error can't find the container with id f361dea45d1b3d42c8deee88e3d95c057b9fd6708ede3033c18fd3ebba3d091b Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.836620 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:33.838238 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46a976a_5e32_4f3c_a844_24aa323c4ffd.slice/crio-13810939de0993cdbfe74f76ab709295a5d44a74cf999faba488369cc924cb71 WatchSource:0}: Error finding container 13810939de0993cdbfe74f76ab709295a5d44a74cf999faba488369cc924cb71: Status 404 returned error can't find the container with id 13810939de0993cdbfe74f76ab709295a5d44a74cf999faba488369cc924cb71 Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.849046 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dl86s" Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.849319 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jt4bd" Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.857273 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwhqt" Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.861473 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.866680 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" Jul 14 15:10:33.879320 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:33.871031 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:10:33.949974 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:33.890403 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebbefc1_c122_449e_97d8_85c026d7bb32.slice/crio-0db3e7a0182fc007383d30a16db5585a500fa87d2fd6ac64b4d648e64b886d97 WatchSource:0}: Error finding container 0db3e7a0182fc007383d30a16db5585a500fa87d2fd6ac64b4d648e64b886d97: Status 404 returned error can't find the container with id 0db3e7a0182fc007383d30a16db5585a500fa87d2fd6ac64b4d648e64b886d97 Jul 14 15:10:34.007946 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:33.955063 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad40ef9_c129_40f8_87c3_31ad85ca85b8.slice/crio-9ff15290b4b35876113d4ca35cc873a149153634737d6513e6cd4f9dd74fd9a2 WatchSource:0}: Error finding container 9ff15290b4b35876113d4ca35cc873a149153634737d6513e6cd4f9dd74fd9a2: Status 404 returned error can't find the container with id 9ff15290b4b35876113d4ca35cc873a149153634737d6513e6cd4f9dd74fd9a2 Jul 14 15:10:34.007946 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:33.958171 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aefa2d6_4dd1_4a6c_aba0_980d23df0f42.slice/crio-1b73a73a86e5a5f1577d6a689b406d7f10fcce2c4cbcf5b442f65821e041a310 WatchSource:0}: Error finding container 1b73a73a86e5a5f1577d6a689b406d7f10fcce2c4cbcf5b442f65821e041a310: Status 404 returned error can't find the container with id 1b73a73a86e5a5f1577d6a689b406d7f10fcce2c4cbcf5b442f65821e041a310 Jul 14 15:10:34.007946 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:33.966230 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f012efc_dc5c_4bfd_8c7e_fd87bb0acbb8.slice/crio-110d19ae34bed8e44a38d8ea94648c42f7a1226a448c75acde6e8d1ada7cc3e9 WatchSource:0}: Error finding container 110d19ae34bed8e44a38d8ea94648c42f7a1226a448c75acde6e8d1ada7cc3e9: Status 404 returned error can't find the container with id 110d19ae34bed8e44a38d8ea94648c42f7a1226a448c75acde6e8d1ada7cc3e9 Jul 14 15:10:34.087056 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:10:34.087023 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8e4bb9_9873_450a_9016_29c671599bfd.slice/crio-540337a1f9065f69c3a5313927fce1235d3307a79db752cb163da8ffcec7bf44 WatchSource:0}: Error finding container 540337a1f9065f69c3a5313927fce1235d3307a79db752cb163da8ffcec7bf44: Status 404 returned error can't find the container with id 540337a1f9065f69c3a5313927fce1235d3307a79db752cb163da8ffcec7bf44 Jul 14 15:10:34.175033 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.174955 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:34.175196 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.175129 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:34.175259 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.175214 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs podName:10fc53e3-505f-404c-a379-c96f6c1e0ef4 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:35.17519387 +0000 UTC m=+4.049855774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs") pod "network-metrics-daemon-6qjr4" (UID: "10fc53e3-505f-404c-a379-c96f6c1e0ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:34.275610 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.275576 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:34.275774 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.275617 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:34.275774 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.275728 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:34.275774 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.275741 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:34.275774 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.275758 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:34.275774 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.275769 2585 projected.go:196] Error preparing data for projected volume kube-api-access-zt5kn for pod openshift-network-diagnostics/network-check-target-228j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:34.276014 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.275799 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret podName:a4a6247b-81bd-4835-ae81-f0a07a52af12 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:35.275780223 +0000 UTC m=+4.150442134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret") pod "global-pull-secret-syncer-zq7j2" (UID: "a4a6247b-81bd-4835-ae81-f0a07a52af12") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:34.276014 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.275813 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn podName:867d8cf3-1d05-4535-a7fd-54f866b89f96 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:35.275807585 +0000 UTC m=+4.150469484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt5kn" (UniqueName: "kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn") pod "network-check-target-228j9" (UID: "867d8cf3-1d05-4535-a7fd-54f866b89f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:34.537456 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.537412 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:34.561656 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.561607 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 15:05:33 +0000 UTC" deadline="2028-01-20 02:36:29.220941379 +0000 UTC" Jul 14 15:10:34.561656 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.561653 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13307h25m54.659291855s" Jul 14 15:10:34.644587 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.644555 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:34.644587 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.644572 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:34.645295 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.644679 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:34.645295 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:34.644811 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:34.655722 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.655664 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hvgvs" event={"ID":"9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8","Type":"ContainerStarted","Data":"110d19ae34bed8e44a38d8ea94648c42f7a1226a448c75acde6e8d1ada7cc3e9"} Jul 14 15:10:34.657112 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.657088 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwhqt" event={"ID":"ca8e4bb9-9873-450a-9016-29c671599bfd","Type":"ContainerStarted","Data":"540337a1f9065f69c3a5313927fce1235d3307a79db752cb163da8ffcec7bf44"} Jul 14 15:10:34.658393 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.658363 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerStarted","Data":"9ff15290b4b35876113d4ca35cc873a149153634737d6513e6cd4f9dd74fd9a2"} Jul 14 15:10:34.659798 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.659753 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sfsv6" event={"ID":"d46a976a-5e32-4f3c-a844-24aa323c4ffd","Type":"ContainerStarted","Data":"13810939de0993cdbfe74f76ab709295a5d44a74cf999faba488369cc924cb71"} Jul 14 15:10:34.661172 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.661128 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jt4bd" event={"ID":"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42","Type":"ContainerStarted","Data":"1b73a73a86e5a5f1577d6a689b406d7f10fcce2c4cbcf5b442f65821e041a310"} Jul 14 15:10:34.662572 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.662545 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dl86s" event={"ID":"3ebbefc1-c122-449e-97d8-85c026d7bb32","Type":"ContainerStarted","Data":"0db3e7a0182fc007383d30a16db5585a500fa87d2fd6ac64b4d648e64b886d97"} Jul 14 15:10:34.663920 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.663897 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" event={"ID":"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4","Type":"ContainerStarted","Data":"effd15325fe951cea9e2fd9e90c19dfd575b0dd719678094ba1cfc9289a628e5"} Jul 14 15:10:34.665167 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.665134 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4fm7" event={"ID":"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4","Type":"ContainerStarted","Data":"f361dea45d1b3d42c8deee88e3d95c057b9fd6708ede3033c18fd3ebba3d091b"} Jul 14 15:10:34.666431 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:34.666397 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" event={"ID":"fdec6018-661a-4e86-8c9e-4e1203e9d3ca","Type":"ContainerStarted","Data":"a38d215366035ea3ff16549b771ad6480d675e04f252bb58f64fb6a8a3e33501"} Jul 14 15:10:35.181096 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:35.181054 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:35.181282 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:35.181248 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:35.181344 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:35.181316 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs podName:10fc53e3-505f-404c-a379-c96f6c1e0ef4 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:37.181296204 +0000 UTC m=+6.055958103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs") pod "network-metrics-daemon-6qjr4" (UID: "10fc53e3-505f-404c-a379-c96f6c1e0ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:35.282047 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:35.282005 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:35.282227 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:35.282064 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:35.282301 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:35.282258 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:35.282301 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:35.282282 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:35.282301 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:35.282295 2585 projected.go:196] Error preparing data for projected volume kube-api-access-zt5kn for pod openshift-network-diagnostics/network-check-target-228j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:35.282454 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:35.282352 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn podName:867d8cf3-1d05-4535-a7fd-54f866b89f96 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:37.282333761 +0000 UTC m=+6.156995676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt5kn" (UniqueName: "kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn") pod "network-check-target-228j9" (UID: "867d8cf3-1d05-4535-a7fd-54f866b89f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:35.282781 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:35.282753 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:35.282781 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:35.282812 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret podName:a4a6247b-81bd-4835-ae81-f0a07a52af12 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:37.282796705 +0000 UTC m=+6.157458609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret") pod "global-pull-secret-syncer-zq7j2" (UID: "a4a6247b-81bd-4835-ae81-f0a07a52af12") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:35.562885 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:35.562795 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 15:05:33 +0000 UTC" deadline="2028-01-20 09:31:50.742523288 +0000 UTC" Jul 14 15:10:35.562885 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:35.562838 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13314h21m15.17968964s" Jul 14 15:10:35.646113 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:35.646069 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:35.646617 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:35.646221 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:36.645553 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:36.645282 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:36.645741 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:36.645672 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:36.646112 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:36.646087 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:36.646236 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:36.646186 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:36.678147 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:36.678074 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal" event={"ID":"337d027ddbda42a4cd3b3abf536a25de","Type":"ContainerStarted","Data":"7c56ce702b7c4fbb635f51b62534afa4bda1940c68952b15fda0518da1ad2ed9"} Jul 14 15:10:36.685412 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:36.685382 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" event={"ID":"de3f0c058702c4bc5b538ac4c27a4cf9","Type":"ContainerStarted","Data":"000b3ba71c30be8d755739c8336921cae502bb6a9a8598b552568fd71aeddadf"} Jul 14 15:10:36.695230 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:36.695181 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-89.ec2.internal" podStartSLOduration=3.6951628960000003 podStartE2EDuration="3.695162896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:36.694705166 +0000 UTC m=+5.569367084" watchObservedRunningTime="2026-07-14 15:10:36.695162896 +0000 UTC m=+5.569824819" Jul 14 15:10:37.202381 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:37.202344 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:37.202585 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:37.202504 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:37.202585 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:37.202565 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs podName:10fc53e3-505f-404c-a379-c96f6c1e0ef4 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:41.202545656 +0000 UTC m=+10.077207558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs") pod "network-metrics-daemon-6qjr4" (UID: "10fc53e3-505f-404c-a379-c96f6c1e0ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:37.302991 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:37.302956 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:37.303176 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:37.303011 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:37.303176 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:37.303099 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:37.303176 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:37.303134 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:37.303176 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:37.303150 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:37.303176 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:37.303160 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret podName:a4a6247b-81bd-4835-ae81-f0a07a52af12 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:41.303140588 +0000 UTC m=+10.177802506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret") pod "global-pull-secret-syncer-zq7j2" (UID: "a4a6247b-81bd-4835-ae81-f0a07a52af12") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:37.303176 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:37.303164 2585 projected.go:196] Error preparing data for projected volume kube-api-access-zt5kn for pod openshift-network-diagnostics/network-check-target-228j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:37.303521 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:37.303198 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn podName:867d8cf3-1d05-4535-a7fd-54f866b89f96 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:41.30318907 +0000 UTC m=+10.177850969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt5kn" (UniqueName: "kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn") pod "network-check-target-228j9" (UID: "867d8cf3-1d05-4535-a7fd-54f866b89f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:37.646684 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:37.646608 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:37.647147 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:37.646768 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:38.644696 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:38.644657 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:38.644906 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:38.644800 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:38.644906 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:38.644881 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:38.645037 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:38.644956 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:38.693948 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:38.693911 2585 generic.go:356] "Generic (PLEG): container finished" podID="de3f0c058702c4bc5b538ac4c27a4cf9" containerID="000b3ba71c30be8d755739c8336921cae502bb6a9a8598b552568fd71aeddadf" exitCode=0 Jul 14 15:10:38.694358 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:38.693966 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" event={"ID":"de3f0c058702c4bc5b538ac4c27a4cf9","Type":"ContainerDied","Data":"000b3ba71c30be8d755739c8336921cae502bb6a9a8598b552568fd71aeddadf"} Jul 14 15:10:39.644613 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:39.644577 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:39.644779 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:39.644733 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:40.645367 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:40.645287 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:40.645826 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:40.645285 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:40.645826 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:40.645448 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:40.645826 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:40.645529 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:41.236844 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:41.236207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:41.236844 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:41.236387 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:41.236844 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:41.236459 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs podName:10fc53e3-505f-404c-a379-c96f6c1e0ef4 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:49.236436022 +0000 UTC m=+18.111097941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs") pod "network-metrics-daemon-6qjr4" (UID: "10fc53e3-505f-404c-a379-c96f6c1e0ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:41.337966 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:41.337238 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:41.337966 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:41.337297 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:41.337966 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:41.337509 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:41.337966 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:41.337533 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:41.337966 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:41.337547 2585 projected.go:196] Error preparing data for projected volume kube-api-access-zt5kn for pod openshift-network-diagnostics/network-check-target-228j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:41.337966 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:41.337606 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn podName:867d8cf3-1d05-4535-a7fd-54f866b89f96 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:49.337586853 +0000 UTC m=+18.212248755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt5kn" (UniqueName: "kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn") pod "network-check-target-228j9" (UID: "867d8cf3-1d05-4535-a7fd-54f866b89f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:41.337966 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:41.337617 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:41.337966 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:41.337655 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret podName:a4a6247b-81bd-4835-ae81-f0a07a52af12 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:49.337644527 +0000 UTC m=+18.212306430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret") pod "global-pull-secret-syncer-zq7j2" (UID: "a4a6247b-81bd-4835-ae81-f0a07a52af12") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:41.646337 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:41.646213 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:41.646849 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:41.646328 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:42.645215 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:42.645170 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:42.645356 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:42.645167 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:42.645356 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:42.645306 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:42.645356 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:42.645334 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:43.645145 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:43.645112 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:43.645576 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:43.645262 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:44.645074 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:44.644994 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:44.645219 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:44.644995 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:44.645219 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:44.645102 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:44.645219 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:44.645185 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:45.645118 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:45.645086 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:45.645301 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:45.645232 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:46.645296 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:46.645258 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:46.645772 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:46.645258 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:46.645772 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:46.645374 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:46.645772 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:46.645505 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:47.645580 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:47.645538 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:47.645961 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:47.645697 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:48.645355 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:48.645322 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:48.645564 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:48.645326 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:48.645564 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:48.645416 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:48.645564 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:48.645506 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:49.294409 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:49.294312 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:49.294620 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:49.294499 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:49.294620 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:49.294571 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs podName:10fc53e3-505f-404c-a379-c96f6c1e0ef4 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:05.294551402 +0000 UTC m=+34.169213320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs") pod "network-metrics-daemon-6qjr4" (UID: "10fc53e3-505f-404c-a379-c96f6c1e0ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:49.395495 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:49.395439 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:49.395672 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:49.395515 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:49.395672 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:49.395616 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:49.395672 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:49.395666 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:49.395850 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:49.395687 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:49.395850 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:49.395696 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret podName:a4a6247b-81bd-4835-ae81-f0a07a52af12 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:05.395674408 +0000 UTC m=+34.270336308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret") pod "global-pull-secret-syncer-zq7j2" (UID: "a4a6247b-81bd-4835-ae81-f0a07a52af12") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:49.395850 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:49.395697 2585 projected.go:196] Error preparing data for projected volume kube-api-access-zt5kn for pod openshift-network-diagnostics/network-check-target-228j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:49.395850 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:49.395739 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn podName:867d8cf3-1d05-4535-a7fd-54f866b89f96 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:05.395728575 +0000 UTC m=+34.270390476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt5kn" (UniqueName: "kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn") pod "network-check-target-228j9" (UID: "867d8cf3-1d05-4535-a7fd-54f866b89f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:49.645626 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:49.645536 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:49.646073 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:49.645681 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:50.644834 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:50.644806 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:50.645042 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:50.644805 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:50.645042 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:50.644918 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:50.645042 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:50.645022 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:51.645589 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:51.645555 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:51.646067 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:51.645656 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:52.645367 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:52.645326 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:52.645367 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:52.645365 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:52.645617 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:52.645454 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:52.645952 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:52.645610 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:53.645820 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.645512 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:53.646598 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:53.645954 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:53.727768 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.727725 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dl86s" event={"ID":"3ebbefc1-c122-449e-97d8-85c026d7bb32","Type":"ContainerStarted","Data":"e72b5836f8f565fdeb88dc3030f440551631ac7e814f4024ce806922855c0127"} Jul 14 15:10:53.731279 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.731244 2585 generic.go:356] "Generic (PLEG): container finished" podID="6513bd8b-e3f7-4b46-8145-97d98ddc5dc4" containerID="dfd3a09dc0b0aa1226e67489c9822369dd80043bd24506caaacbc6b63249fc5f" exitCode=0 Jul 14 15:10:53.731377 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.731324 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" event={"ID":"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4","Type":"ContainerDied","Data":"dfd3a09dc0b0aa1226e67489c9822369dd80043bd24506caaacbc6b63249fc5f"} Jul 14 15:10:53.733663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.733638 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" event={"ID":"de3f0c058702c4bc5b538ac4c27a4cf9","Type":"ContainerStarted","Data":"06fe8fa7595a3bb8e10ea6549d51e1911375244fb6694cab53ad23590b317743"} Jul 14 15:10:53.735123 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.735102 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" event={"ID":"fdec6018-661a-4e86-8c9e-4e1203e9d3ca","Type":"ContainerStarted","Data":"437dc77b61bd3634cd4a37e00bc46b9eef3dabd17f69180d78ba667a9cc70b86"} Jul 14 15:10:53.736639 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.736617 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hvgvs" event={"ID":"9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8","Type":"ContainerStarted","Data":"fc6c7330a19a64b3837419fbfc2ae70cb55d8f2d8047e8ab44d15ac885c37c53"} Jul 14 15:10:53.738326 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.738301 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwhqt" event={"ID":"ca8e4bb9-9873-450a-9016-29c671599bfd","Type":"ContainerStarted","Data":"f7ca9aa94a7342b6726dbd44f89e69f9993c6cfc4f1e4431507ef03f89dc56c0"} Jul 14 15:10:53.741030 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.741012 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:10:53.741930 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.741903 2585 generic.go:356] "Generic (PLEG): container finished" podID="8ad40ef9-c129-40f8-87c3-31ad85ca85b8" containerID="e833fb0530fb8d650c302388d596f047d51dcb7dc588ece769c879569309f756" exitCode=1 Jul 14 15:10:53.742016 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.741966 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerStarted","Data":"eae49d1d2960d33da779cc224eb43374eb3fe3c075891dccb8d63f22ed2fb300"} Jul 14 15:10:53.742077 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.742040 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerStarted","Data":"3234f4a580ebb8d2df2939d84b74aaaef63d482aef493307af734269a18ad918"} Jul 14 15:10:53.742163 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.742092 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerDied","Data":"e833fb0530fb8d650c302388d596f047d51dcb7dc588ece769c879569309f756"} Jul 14 15:10:53.742163 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.742144 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerStarted","Data":"7a5931d09b30a6d0f8b265f208c4f810523e065d06fe8148cb1e3bea87b20a53"} Jul 14 15:10:53.743618 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.743599 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sfsv6" event={"ID":"d46a976a-5e32-4f3c-a844-24aa323c4ffd","Type":"ContainerStarted","Data":"70e2ddfe9ff1b7e826be44f8cf492cdae0bfd4adf70474f3d722e68f707f35a6"} Jul 14 15:10:53.745059 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.745039 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jt4bd" event={"ID":"8aefa2d6-4dd1-4a6c-aba0-980d23df0f42","Type":"ContainerStarted","Data":"f5ca7d97cdcfc80f820bbe527d231dcddcea88b2850cbc03ec35b82f0dc4ba59"} Jul 14 15:10:53.751203 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.751163 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dl86s" podStartSLOduration=3.57898492 podStartE2EDuration="22.751151336s" totalImagesPullingTime="19.172166416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:53.750945307 +0000 UTC m=+22.625607230" watchObservedRunningTime="2026-07-14 15:10:53.751151336 +0000 UTC m=+22.625813257" Jul 14 15:10:53.770640 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.770582 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wwhqt" podStartSLOduration=3.37913194 podStartE2EDuration="22.770562537s" totalImagesPullingTime="19.391430597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:53.770111901 +0000 UTC m=+22.644773823" watchObservedRunningTime="2026-07-14 15:10:53.770562537 +0000 UTC m=+22.645224459" Jul 14 15:10:53.790070 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.790033 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hvgvs" podStartSLOduration=2.69382144 podStartE2EDuration="21.790018033s" totalImagesPullingTime="19.096196593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:53.789851983 +0000 UTC m=+22.664513904" watchObservedRunningTime="2026-07-14 15:10:53.790018033 +0000 UTC m=+22.664679955" Jul 14 15:10:53.816209 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.816168 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-89.ec2.internal" podStartSLOduration=20.816151988 podStartE2EDuration="20.816151988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:53.81612201 +0000 UTC m=+22.690783931" watchObservedRunningTime="2026-07-14 15:10:53.816151988 +0000 UTC m=+22.690813909" Jul 14 15:10:53.874264 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.874141 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sfsv6" podStartSLOduration=3.660068264 podStartE2EDuration="22.874125867s" totalImagesPullingTime="19.214057603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:53.836119897 +0000 UTC m=+22.710781818" watchObservedRunningTime="2026-07-14 15:10:53.874125867 +0000 UTC m=+22.748787844" Jul 14 15:10:53.898517 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:53.898460 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jt4bd" podStartSLOduration=3.794802741 podStartE2EDuration="22.89844395s" totalImagesPullingTime="19.103641209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:53.898384193 +0000 UTC m=+22.773046115" watchObservedRunningTime="2026-07-14 15:10:53.89844395 +0000 UTC m=+22.773105871" Jul 14 15:10:54.644576 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:54.644492 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:54.644760 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:54.644501 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:54.644760 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:54.644591 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:54.644760 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:54.644692 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:54.748258 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:54.748224 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4fm7" event={"ID":"031ed674-1bcb-4cfd-b84a-d70e1e1d3ad4","Type":"ContainerStarted","Data":"453c0bb0f65c818dd12c1b62bfeffdabc7ccc54366abb15ead9ea34787adfb44"} Jul 14 15:10:54.751027 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:54.751008 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:10:54.751427 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:54.751408 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerStarted","Data":"add3d34f067198cda716ee67f602250174664bafbcbb97786e7906c6d7960750"} Jul 14 15:10:54.751511 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:54.751470 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerStarted","Data":"95f1f832dbd3946fb3a87050024efdec9e355746503858a7fc951fb1e4463c2e"} Jul 14 15:10:55.644987 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:55.644960 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:55.645121 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:55.645100 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:55.692589 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:55.692561 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 15:10:55.755105 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:55.755065 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" event={"ID":"fdec6018-661a-4e86-8c9e-4e1203e9d3ca","Type":"ContainerStarted","Data":"7867184eef101cff00b5533a4da9bb8a7beb43792ab1c6e1fda2d5f9b36cdbc3"} Jul 14 15:10:56.610672 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:56.610343 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T15:10:55.692583734Z","UUID":"b0a1c3f3-5ebd-493c-a250-b6714858e977","Handler":null,"Name":"","Endpoint":""} Jul 14 15:10:56.611939 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:56.611919 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 15:10:56.612063 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:56.611958 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 15:10:56.644807 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:56.644775 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:56.644977 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:56.644880 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:56.644977 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:56.644940 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:56.645072 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:56.645050 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:56.760919 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:56.760888 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:10:56.761459 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:56.761352 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerStarted","Data":"07c348d8ae4df53d088206337dfdaf510a693c0d3da5dd7c42c7eb96bcc9ae5f"} Jul 14 15:10:57.644756 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:57.644719 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:57.645042 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:57.645018 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:57.765566 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:57.765514 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" event={"ID":"fdec6018-661a-4e86-8c9e-4e1203e9d3ca","Type":"ContainerStarted","Data":"553bf09c4fa23ab3967525457021480b62f82182763545833cafe3b6226a5e38"} Jul 14 15:10:57.786322 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:57.786269 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6s8f" podStartSLOduration=3.53162036 podStartE2EDuration="25.786254371s" totalImagesPullingTime="22.254634011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:57.78594015 +0000 UTC m=+26.660602072" watchObservedRunningTime="2026-07-14 15:10:57.786254371 +0000 UTC m=+26.660916291" Jul 14 15:10:57.786523 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:57.786502 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x4fm7" podStartSLOduration=15.957448645 podStartE2EDuration="26.786496384s" totalImagesPullingTime="10.829047739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:54.775307207 +0000 UTC m=+23.649969129" watchObservedRunningTime="2026-07-14 15:10:57.786496384 +0000 UTC m=+26.661158296" Jul 14 15:10:58.305405 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:58.305359 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:58.306466 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:58.306429 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:58.645338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:58.645296 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:10:58.645540 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:58.645439 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:10:58.645640 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:58.645307 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:10:58.645756 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:58.645721 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:10:58.768029 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:58.767997 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:58.768460 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:58.768430 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hvgvs" Jul 14 15:10:59.645089 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:59.645067 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:10:59.645241 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:10:59.645218 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:10:59.774062 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:59.773810 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:10:59.775219 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:59.774515 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerStarted","Data":"e00644c987185a98d151432ad31441344f6ef44f3e5ed4f75883985ca53e6dba"} Jul 14 15:10:59.775219 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:10:59.775138 2585 scope.go:117] "RemoveContainer" containerID="e833fb0530fb8d650c302388d596f047d51dcb7dc588ece769c879569309f756" Jul 14 15:11:00.645361 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.645332 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:11:00.645465 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.645335 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:11:00.645465 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:00.645429 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:11:00.645574 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:00.645517 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:11:00.780321 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.780286 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:11:00.780815 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.780676 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" event={"ID":"8ad40ef9-c129-40f8-87c3-31ad85ca85b8","Type":"ContainerStarted","Data":"49e79b528aa0482a8cf0cc1de62dc2a29ce8f1bf2dd40c639211fd905d53df57"} Jul 14 15:11:00.780879 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.780848 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:11:00.780930 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.780911 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:11:00.780976 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.780958 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:11:00.782744 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.782716 2585 generic.go:356] "Generic (PLEG): container finished" podID="6513bd8b-e3f7-4b46-8145-97d98ddc5dc4" containerID="bcebd4cf5320c4ad8722a1ba5f9cea142b3ada8710470714089736a6a882b200" exitCode=0 Jul 14 15:11:00.782843 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.782744 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" event={"ID":"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4","Type":"ContainerDied","Data":"bcebd4cf5320c4ad8722a1ba5f9cea142b3ada8710470714089736a6a882b200"} Jul 14 15:11:00.796660 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.796640 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:11:00.796778 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.796761 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:11:00.810598 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:00.810558 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" podStartSLOduration=9.362939232 podStartE2EDuration="28.810545927s" totalImagesPullingTime="19.447606695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:00.810245375 +0000 UTC m=+29.684907320" watchObservedRunningTime="2026-07-14 15:11:00.810545927 +0000 UTC m=+29.685207842" Jul 14 15:11:01.645885 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:01.645856 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:11:01.646019 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:01.645950 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:11:02.049734 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:02.049556 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zq7j2"] Jul 14 15:11:02.050096 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:02.049809 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:11:02.050096 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:02.049897 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:11:02.064543 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:02.064514 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qjr4"] Jul 14 15:11:02.064651 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:02.064610 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:11:02.064711 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:02.064694 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:11:02.066014 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:02.065994 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-228j9"] Jul 14 15:11:02.066100 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:02.066075 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:11:02.066157 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:02.066140 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:11:02.790007 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:02.789932 2585 generic.go:356] "Generic (PLEG): container finished" podID="6513bd8b-e3f7-4b46-8145-97d98ddc5dc4" containerID="95b29d1b3ed8d2f03abf26ff83935be6a6836f3eef0bfd6c9adcb3388b991d84" exitCode=0 Jul 14 15:11:02.790126 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:02.790006 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" event={"ID":"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4","Type":"ContainerDied","Data":"95b29d1b3ed8d2f03abf26ff83935be6a6836f3eef0bfd6c9adcb3388b991d84"} Jul 14 15:11:03.645091 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:03.645056 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:11:03.645704 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:03.645056 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:11:03.645704 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:03.645181 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qjr4" podUID="10fc53e3-505f-404c-a379-c96f6c1e0ef4" Jul 14 15:11:03.645704 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:03.645061 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:11:03.645704 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:03.645250 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq7j2" podUID="a4a6247b-81bd-4835-ae81-f0a07a52af12" Jul 14 15:11:03.645704 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:03.645319 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-228j9" podUID="867d8cf3-1d05-4535-a7fd-54f866b89f96" Jul 14 15:11:04.795867 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:04.795829 2585 generic.go:356] "Generic (PLEG): container finished" podID="6513bd8b-e3f7-4b46-8145-97d98ddc5dc4" containerID="a731f2a1dcff22a8ccc7f94cd9f54af9aba088d5e6d4f93efbd73752f5259099" exitCode=0 Jul 14 15:11:04.796415 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:04.795868 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" event={"ID":"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4","Type":"ContainerDied","Data":"a731f2a1dcff22a8ccc7f94cd9f54af9aba088d5e6d4f93efbd73752f5259099"} Jul 14 15:11:05.311307 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.311268 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:11:05.311527 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.311412 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:11:05.311527 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.311474 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs podName:10fc53e3-505f-404c-a379-c96f6c1e0ef4 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:37.311459916 +0000 UTC m=+66.186121816 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs") pod "network-metrics-daemon-6qjr4" (UID: "10fc53e3-505f-404c-a379-c96f6c1e0ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:11:05.411981 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.411942 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:11:05.411981 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.411987 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:11:05.412225 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.412090 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:11:05.412225 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.412102 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:11:05.412225 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.412118 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:11:05.412225 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.412127 2585 projected.go:196] Error preparing data for projected volume kube-api-access-zt5kn for pod openshift-network-diagnostics/network-check-target-228j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:11:05.412225 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.412156 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret podName:a4a6247b-81bd-4835-ae81-f0a07a52af12 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:37.412141279 +0000 UTC m=+66.286803179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret") pod "global-pull-secret-syncer-zq7j2" (UID: "a4a6247b-81bd-4835-ae81-f0a07a52af12") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:11:05.412225 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.412226 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn podName:867d8cf3-1d05-4535-a7fd-54f866b89f96 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:37.412207092 +0000 UTC m=+66.286868995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt5kn" (UniqueName: "kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn") pod "network-check-target-228j9" (UID: "867d8cf3-1d05-4535-a7fd-54f866b89f96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:11:05.460513 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.460469 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-89.ec2.internal" event="NodeReady" Jul 14 15:11:05.460667 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.460628 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 15:11:05.498629 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.498596 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5557d8bc88-nkb57"] Jul 14 15:11:05.500518 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.500493 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.503646 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.503624 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 15:11:05.503753 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.503628 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-flhw9\"" Jul 14 15:11:05.504007 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.503987 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 15:11:05.504815 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.504798 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 15:11:05.509356 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.508895 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 15:11:05.519243 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.519092 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6mltn"] Jul 14 15:11:05.521052 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.521032 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2r877"] Jul 14 15:11:05.521178 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.521158 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mltn" Jul 14 15:11:05.523144 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.522944 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5557d8bc88-nkb57"] Jul 14 15:11:05.523144 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.523036 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.524448 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.524427 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xkwnw\"" Jul 14 15:11:05.524723 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.524700 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 15:11:05.524995 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.524975 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 15:11:05.525219 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.525041 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 15:11:05.526090 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.526071 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 15:11:05.526243 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.526226 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 15:11:05.526453 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.526436 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlfph\"" Jul 14 15:11:05.540101 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.539560 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mltn"] Jul 14 15:11:05.545899 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.545874 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2r877"] Jul 14 15:11:05.613188 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613103 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/daf0970a-8472-44cc-b652-63d930a8314a-config-volume\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.613188 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613143 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.613188 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613180 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7dx8\" (UniqueName: \"kubernetes.io/projected/daf0970a-8472-44cc-b652-63d930a8314a-kube-api-access-c7dx8\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.613440 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613265 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-certificates\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.613440 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613302 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/247a017f-af9c-4894-ac46-1eb4c984514c-cert\") pod \"ingress-canary-6mltn\" (UID: \"247a017f-af9c-4894-ac46-1eb4c984514c\") " pod="openshift-ingress-canary/ingress-canary-6mltn" Jul 14 15:11:05.613440 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613328 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-image-registry-private-configuration\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.613440 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613387 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.613440 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613428 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-installation-pull-secrets\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.613693 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613449 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-trusted-ca\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.613693 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613466 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpqpw\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-kube-api-access-qpqpw\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.613693 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613559 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-ca-trust-extracted\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.613693 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613612 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daf0970a-8472-44cc-b652-63d930a8314a-tmp-dir\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.613832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613695 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-bound-sa-token\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.613832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.613724 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zb4\" (UniqueName: \"kubernetes.io/projected/247a017f-af9c-4894-ac46-1eb4c984514c-kube-api-access-z6zb4\") pod \"ingress-canary-6mltn\" (UID: \"247a017f-af9c-4894-ac46-1eb4c984514c\") " pod="openshift-ingress-canary/ingress-canary-6mltn" Jul 14 15:11:05.645423 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.645385 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:11:05.645423 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.645407 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:11:05.645666 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.645429 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:11:05.654334 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.654311 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 15:11:05.654495 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.654456 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 15:11:05.654578 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.654458 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 15:11:05.654668 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.654578 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pkcw\"" Jul 14 15:11:05.654668 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.654588 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 15:11:05.654668 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.654467 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5qssq\"" Jul 14 15:11:05.708728 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.708688 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvgvs_9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:05.715073 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715045 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/247a017f-af9c-4894-ac46-1eb4c984514c-cert\") pod \"ingress-canary-6mltn\" (UID: \"247a017f-af9c-4894-ac46-1eb4c984514c\") " pod="openshift-ingress-canary/ingress-canary-6mltn" Jul 14 15:11:05.715201 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715083 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-image-registry-private-configuration\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.715201 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715105 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.715354 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.715329 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:05.715354 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.715348 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5557d8bc88-nkb57: secret "image-registry-tls" not found Jul 14 15:11:05.715535 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.715412 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls podName:ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:06.215392472 +0000 UTC m=+35.090054381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls") pod "image-registry-5557d8bc88-nkb57" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07") : secret "image-registry-tls" not found Jul 14 15:11:05.715603 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715545 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-installation-pull-secrets\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.715603 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715588 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-trusted-ca\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.715706 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715617 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpqpw\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-kube-api-access-qpqpw\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.715706 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715653 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-ca-trust-extracted\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.715706 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715680 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daf0970a-8472-44cc-b652-63d930a8314a-tmp-dir\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.715849 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-bound-sa-token\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.715849 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715741 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zb4\" (UniqueName: \"kubernetes.io/projected/247a017f-af9c-4894-ac46-1eb4c984514c-kube-api-access-z6zb4\") pod \"ingress-canary-6mltn\" (UID: \"247a017f-af9c-4894-ac46-1eb4c984514c\") " pod="openshift-ingress-canary/ingress-canary-6mltn" Jul 14 15:11:05.715849 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715817 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/daf0970a-8472-44cc-b652-63d930a8314a-config-volume\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.716005 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715845 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.716005 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715905 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7dx8\" (UniqueName: \"kubernetes.io/projected/daf0970a-8472-44cc-b652-63d930a8314a-kube-api-access-c7dx8\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.716005 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.715943 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-certificates\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.716145 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.716067 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-ca-trust-extracted\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.716203 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.716163 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:05.716254 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.716199 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daf0970a-8472-44cc-b652-63d930a8314a-tmp-dir\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.716254 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:05.716218 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls podName:daf0970a-8472-44cc-b652-63d930a8314a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:06.216202824 +0000 UTC m=+35.090864737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls") pod "dns-default-2r877" (UID: "daf0970a-8472-44cc-b652-63d930a8314a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:05.716592 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.716465 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-certificates\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.716696 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.716677 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-trusted-ca\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.717040 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.716985 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/daf0970a-8472-44cc-b652-63d930a8314a-config-volume\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.719773 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.719750 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-image-registry-private-configuration\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.719773 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.719762 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/247a017f-af9c-4894-ac46-1eb4c984514c-cert\") pod \"ingress-canary-6mltn\" (UID: \"247a017f-af9c-4894-ac46-1eb4c984514c\") " pod="openshift-ingress-canary/ingress-canary-6mltn" Jul 14 15:11:05.719908 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.719751 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-installation-pull-secrets\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.728376 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.728351 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpqpw\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-kube-api-access-qpqpw\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.728902 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.728823 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-bound-sa-token\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:05.729360 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.729339 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zb4\" (UniqueName: \"kubernetes.io/projected/247a017f-af9c-4894-ac46-1eb4c984514c-kube-api-access-z6zb4\") pod \"ingress-canary-6mltn\" (UID: \"247a017f-af9c-4894-ac46-1eb4c984514c\") " pod="openshift-ingress-canary/ingress-canary-6mltn" Jul 14 15:11:05.730270 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.730243 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7dx8\" (UniqueName: \"kubernetes.io/projected/daf0970a-8472-44cc-b652-63d930a8314a-kube-api-access-c7dx8\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:05.832430 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.832390 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mltn" Jul 14 15:11:05.879994 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:05.879683 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvgvs_9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:06.004255 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:06.004226 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mltn"] Jul 14 15:11:06.008435 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:11:06.008408 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247a017f_af9c_4894_ac46_1eb4c984514c.slice/crio-728986cb262e0e438c7349a5a7e20fb3b50fe7ae329c3a3f828e10dab87fbe6c WatchSource:0}: Error finding container 728986cb262e0e438c7349a5a7e20fb3b50fe7ae329c3a3f828e10dab87fbe6c: Status 404 returned error can't find the container with id 728986cb262e0e438c7349a5a7e20fb3b50fe7ae329c3a3f828e10dab87fbe6c Jul 14 15:11:06.219829 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:06.219794 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:06.220002 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:06.219873 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:06.220002 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:06.219974 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:06.220002 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:06.219998 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:06.220122 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:06.220010 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5557d8bc88-nkb57: secret "image-registry-tls" not found Jul 14 15:11:06.220122 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:06.220056 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls podName:daf0970a-8472-44cc-b652-63d930a8314a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:07.220032883 +0000 UTC m=+36.094694796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls") pod "dns-default-2r877" (UID: "daf0970a-8472-44cc-b652-63d930a8314a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:06.220122 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:06.220076 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls podName:ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:07.220066325 +0000 UTC m=+36.094728226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls") pod "image-registry-5557d8bc88-nkb57" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07") : secret "image-registry-tls" not found Jul 14 15:11:06.802018 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:06.801974 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mltn" event={"ID":"247a017f-af9c-4894-ac46-1eb4c984514c","Type":"ContainerStarted","Data":"728986cb262e0e438c7349a5a7e20fb3b50fe7ae329c3a3f828e10dab87fbe6c"} Jul 14 15:11:07.227043 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:07.227001 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:07.227638 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:07.227100 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:07.227638 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:07.227177 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:07.227638 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:07.227200 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5557d8bc88-nkb57: secret "image-registry-tls" not found Jul 14 15:11:07.227638 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:07.227214 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:07.227638 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:07.227274 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls podName:ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:09.227251827 +0000 UTC m=+38.101913738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls") pod "image-registry-5557d8bc88-nkb57" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07") : secret "image-registry-tls" not found Jul 14 15:11:07.227638 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:07.227294 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls podName:daf0970a-8472-44cc-b652-63d930a8314a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:09.22728503 +0000 UTC m=+38.101946959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls") pod "dns-default-2r877" (UID: "daf0970a-8472-44cc-b652-63d930a8314a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:07.599943 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:07.599858 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvgvs_9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:07.699546 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:07.699504 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvgvs_9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:09.244973 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:09.244930 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:09.245395 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:09.245004 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:09.245395 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:09.245165 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:09.245395 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:09.245182 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:09.245395 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:09.245202 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5557d8bc88-nkb57: secret "image-registry-tls" not found Jul 14 15:11:09.245395 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:09.245250 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls podName:daf0970a-8472-44cc-b652-63d930a8314a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:13.245227903 +0000 UTC m=+42.119889824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls") pod "dns-default-2r877" (UID: "daf0970a-8472-44cc-b652-63d930a8314a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:09.245395 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:09.245273 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls podName:ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:13.245262774 +0000 UTC m=+42.119924676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls") pod "image-registry-5557d8bc88-nkb57" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07") : secret "image-registry-tls" not found Jul 14 15:11:10.814952 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:10.814774 2585 generic.go:356] "Generic (PLEG): container finished" podID="6513bd8b-e3f7-4b46-8145-97d98ddc5dc4" containerID="e7962c411b2b8afe192c5a8c2ff7a334fa526b3046bb09b29936632783fd36ce" exitCode=0 Jul 14 15:11:10.815415 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:10.814854 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" event={"ID":"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4","Type":"ContainerDied","Data":"e7962c411b2b8afe192c5a8c2ff7a334fa526b3046bb09b29936632783fd36ce"} Jul 14 15:11:10.816437 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:10.816420 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mltn" event={"ID":"247a017f-af9c-4894-ac46-1eb4c984514c","Type":"ContainerStarted","Data":"8a108a6a2dcba22c0349057b983b99c668bd6e87c6d38bceac317b92ce0c0591"} Jul 14 15:11:10.855932 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:10.855892 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6mltn" podStartSLOduration=2.148155346 podStartE2EDuration="5.855875239s" totalImagesPullingTime="3.707719893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:10.855070383 +0000 UTC m=+39.729732306" watchObservedRunningTime="2026-07-14 15:11:10.855875239 +0000 UTC m=+39.730537160" Jul 14 15:11:11.821199 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:11.821111 2585 generic.go:356] "Generic (PLEG): container finished" podID="6513bd8b-e3f7-4b46-8145-97d98ddc5dc4" containerID="ae7b7311e4ad813fbd8064505631325e9fe73d0fe605aef4cda436b0422f2a2b" exitCode=0 Jul 14 15:11:11.821199 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:11.821183 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" event={"ID":"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4","Type":"ContainerDied","Data":"ae7b7311e4ad813fbd8064505631325e9fe73d0fe605aef4cda436b0422f2a2b"} Jul 14 15:11:12.826337 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:12.826301 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" event={"ID":"6513bd8b-e3f7-4b46-8145-97d98ddc5dc4","Type":"ContainerStarted","Data":"e92e6a9a530d3ab1cb032209a1927022d2254361a9c13e6cd87bd073c81ac4b3"} Jul 14 15:11:12.850619 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:12.850573 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jhmb8" podStartSLOduration=8.980897916 podStartE2EDuration="41.850558243s" totalImagesPullingTime="32.869660327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:12.849066856 +0000 UTC m=+41.723728776" watchObservedRunningTime="2026-07-14 15:11:12.850558243 +0000 UTC m=+41.725220163" Jul 14 15:11:13.274297 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:13.274266 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:13.274433 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:13.274324 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:13.274433 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:13.274411 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:13.274433 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:13.274412 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:13.274564 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:13.274475 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls podName:daf0970a-8472-44cc-b652-63d930a8314a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:21.274458195 +0000 UTC m=+50.149120094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls") pod "dns-default-2r877" (UID: "daf0970a-8472-44cc-b652-63d930a8314a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:13.274564 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:13.274422 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5557d8bc88-nkb57: secret "image-registry-tls" not found Jul 14 15:11:13.274564 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:13.274553 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls podName:ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:21.274541585 +0000 UTC m=+50.149203484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls") pod "image-registry-5557d8bc88-nkb57" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07") : secret "image-registry-tls" not found Jul 14 15:11:16.432657 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.432626 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f6bcfb954-zx7cm"] Jul 14 15:11:16.464586 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.464559 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f6bcfb954-zx7cm"] Jul 14 15:11:16.464744 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.464657 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.468020 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.467996 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 15:11:16.468127 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.467998 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 15:11:16.468167 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.468123 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 15:11:16.468615 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.468597 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 15:11:16.468704 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.468619 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 15:11:16.468704 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.468627 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 15:11:16.468704 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.468645 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jm4q5\"" Jul 14 15:11:16.498591 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.498570 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.498719 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.498608 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-default-certificate\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.498719 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.498625 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.498799 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.498729 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-stats-auth\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.498799 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.498752 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrcss\" (UniqueName: \"kubernetes.io/projected/2b004017-332e-4387-9412-3a85c4fd503b-kube-api-access-hrcss\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.528598 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.528571 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8g5z7"] Jul 14 15:11:16.551100 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.551061 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz"] Jul 14 15:11:16.551242 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.551227 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.553841 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.553820 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 15:11:16.554005 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.553991 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 15:11:16.554141 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.554124 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 15:11:16.554217 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.554165 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 15:11:16.554342 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.554329 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5fpgg\"" Jul 14 15:11:16.559097 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.559074 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 15:11:16.574554 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.574529 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8g5z7"] Jul 14 15:11:16.574554 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.574558 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz"] Jul 14 15:11:16.574670 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.574632 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:16.577067 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.577023 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 15:11:16.577234 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.577213 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 15:11:16.577234 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.577230 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 15:11:16.577374 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.577313 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zhk8b\"" Jul 14 15:11:16.578880 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.578864 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 15:11:16.599708 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.599689 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-stats-auth\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.599816 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.599717 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrcss\" (UniqueName: \"kubernetes.io/projected/2b004017-332e-4387-9412-3a85c4fd503b-kube-api-access-hrcss\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.599816 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.599755 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.599816 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.599804 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0b72a7-399a-4de4-9383-3b1735d30641-tmp\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.599938 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.599836 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa0b72a7-399a-4de4-9383-3b1735d30641-snapshots\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.599938 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:16.599837 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 15:11:16.599938 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:16.599898 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:17.09988302 +0000 UTC m=+45.974544919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : secret "router-metrics-certs-default" not found Jul 14 15:11:16.600097 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.599960 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0b72a7-399a-4de4-9383-3b1735d30641-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.600097 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.600005 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-default-certificate\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.600097 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.600035 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.600097 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.600061 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0b72a7-399a-4de4-9383-3b1735d30641-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.600256 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.600140 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa0b72a7-399a-4de4-9383-3b1735d30641-serving-cert\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.600256 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:16.600167 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:17.100151524 +0000 UTC m=+45.974813432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : configmap references non-existent config key: service-ca.crt Jul 14 15:11:16.600256 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.600194 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w82jn\" (UniqueName: \"kubernetes.io/projected/fa0b72a7-399a-4de4-9383-3b1735d30641-kube-api-access-w82jn\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.603699 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.603676 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-default-certificate\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.603781 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.603680 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-stats-auth\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.613280 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.613259 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrcss\" (UniqueName: \"kubernetes.io/projected/2b004017-332e-4387-9412-3a85c4fd503b-kube-api-access-hrcss\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:16.701540 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.701439 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0b72a7-399a-4de4-9383-3b1735d30641-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.701540 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.701497 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa0b72a7-399a-4de4-9383-3b1735d30641-serving-cert\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.701540 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.701514 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w82jn\" (UniqueName: \"kubernetes.io/projected/fa0b72a7-399a-4de4-9383-3b1735d30641-kube-api-access-w82jn\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.701822 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.701556 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0b72a7-399a-4de4-9383-3b1735d30641-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.701822 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.701601 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:16.701822 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.701665 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:16.701822 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.701695 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0b72a7-399a-4de4-9383-3b1735d30641-tmp\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.701822 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.701790 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa0b72a7-399a-4de4-9383-3b1735d30641-snapshots\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.702045 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.701939 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q6sx\" (UniqueName: \"kubernetes.io/projected/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-kube-api-access-9q6sx\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:16.702045 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.702009 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0b72a7-399a-4de4-9383-3b1735d30641-tmp\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.702143 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.702121 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0b72a7-399a-4de4-9383-3b1735d30641-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.702308 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.702292 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa0b72a7-399a-4de4-9383-3b1735d30641-snapshots\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.703848 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.703826 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa0b72a7-399a-4de4-9383-3b1735d30641-serving-cert\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.709576 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.709557 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w82jn\" (UniqueName: \"kubernetes.io/projected/fa0b72a7-399a-4de4-9383-3b1735d30641-kube-api-access-w82jn\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.712753 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.712731 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0b72a7-399a-4de4-9383-3b1735d30641-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8g5z7\" (UID: \"fa0b72a7-399a-4de4-9383-3b1735d30641\") " pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:16.802624 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.802592 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q6sx\" (UniqueName: \"kubernetes.io/projected/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-kube-api-access-9q6sx\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:16.802769 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.802683 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:16.802769 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.802720 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:16.802842 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:16.802814 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:16.802884 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:16.802871 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls podName:ab6c4c34-acab-4cf2-b1df-d81dcda1124b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:17.302857735 +0000 UTC m=+46.177519634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-p54tz" (UID: "ab6c4c34-acab-4cf2-b1df-d81dcda1124b") : secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:16.803317 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.803299 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:16.811183 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.811165 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q6sx\" (UniqueName: \"kubernetes.io/projected/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-kube-api-access-9q6sx\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:16.860495 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:16.860461 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" Jul 14 15:11:17.000070 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:17.000038 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8g5z7"] Jul 14 15:11:17.003363 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:11:17.003334 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0b72a7_399a_4de4_9383_3b1735d30641.slice/crio-a3beec1c5edf2ba8a313d34d1bb111cc7c2bdad1876324978fa889e61a7fa085 WatchSource:0}: Error finding container a3beec1c5edf2ba8a313d34d1bb111cc7c2bdad1876324978fa889e61a7fa085: Status 404 returned error can't find the container with id a3beec1c5edf2ba8a313d34d1bb111cc7c2bdad1876324978fa889e61a7fa085 Jul 14 15:11:17.105706 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:17.105664 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:17.105706 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:17.105708 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:17.105904 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:17.105814 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 15:11:17.105904 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:17.105841 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:18.10582865 +0000 UTC m=+46.980490550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : configmap references non-existent config key: service-ca.crt Jul 14 15:11:17.105904 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:17.105867 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:18.105854057 +0000 UTC m=+46.980515956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : secret "router-metrics-certs-default" not found Jul 14 15:11:17.306972 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:17.306889 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:17.307122 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:17.307026 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:17.307122 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:17.307081 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls podName:ab6c4c34-acab-4cf2-b1df-d81dcda1124b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:18.307067551 +0000 UTC m=+47.181729450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-p54tz" (UID: "ab6c4c34-acab-4cf2-b1df-d81dcda1124b") : secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:17.839939 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:17.839902 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" event={"ID":"fa0b72a7-399a-4de4-9383-3b1735d30641","Type":"ContainerStarted","Data":"a3beec1c5edf2ba8a313d34d1bb111cc7c2bdad1876324978fa889e61a7fa085"} Jul 14 15:11:18.114229 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:18.114153 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:18.114229 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:18.114191 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:18.114374 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:18.114298 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 15:11:18.114374 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:18.114303 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:20.114289804 +0000 UTC m=+48.988951703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : configmap references non-existent config key: service-ca.crt Jul 14 15:11:18.114374 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:18.114359 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:20.114347235 +0000 UTC m=+48.989009138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : secret "router-metrics-certs-default" not found Jul 14 15:11:18.316440 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:18.316396 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:18.316642 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:18.316572 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:18.316682 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:18.316643 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls podName:ab6c4c34-acab-4cf2-b1df-d81dcda1124b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:20.316626598 +0000 UTC m=+49.191288498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-p54tz" (UID: "ab6c4c34-acab-4cf2-b1df-d81dcda1124b") : secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:20.133538 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:20.133502 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:20.133945 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:20.133551 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:20.133945 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:20.133660 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 15:11:20.133945 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:20.133731 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:24.133713071 +0000 UTC m=+53.008374985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : secret "router-metrics-certs-default" not found Jul 14 15:11:20.133945 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:20.133749 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:24.133740285 +0000 UTC m=+53.008402188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : configmap references non-existent config key: service-ca.crt Jul 14 15:11:20.335082 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:20.335047 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:20.335261 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:20.335197 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:20.335312 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:20.335272 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls podName:ab6c4c34-acab-4cf2-b1df-d81dcda1124b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:24.335257857 +0000 UTC m=+53.209919756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-p54tz" (UID: "ab6c4c34-acab-4cf2-b1df-d81dcda1124b") : secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:20.848571 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:20.848468 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" event={"ID":"fa0b72a7-399a-4de4-9383-3b1735d30641","Type":"ContainerStarted","Data":"c50fff29f40ff47f998557ef1ae0c31a3f99ddd566898992b33c74925bb10918"} Jul 14 15:11:20.866347 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:20.866306 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" podStartSLOduration=1.3052290260000001 podStartE2EDuration="4.866293184s" totalImagesPullingTime="3.561064158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:20.866018602 +0000 UTC m=+49.740680522" watchObservedRunningTime="2026-07-14 15:11:20.866293184 +0000 UTC m=+49.740955109" Jul 14 15:11:21.344157 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:21.344118 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:21.344555 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:21.344176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:21.344555 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:21.344272 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:21.344555 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:21.344294 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5557d8bc88-nkb57: secret "image-registry-tls" not found Jul 14 15:11:21.344555 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:21.344313 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:21.344555 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:21.344350 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls podName:ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:37.344333297 +0000 UTC m=+66.218995200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls") pod "image-registry-5557d8bc88-nkb57" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07") : secret "image-registry-tls" not found Jul 14 15:11:21.344555 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:21.344365 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls podName:daf0970a-8472-44cc-b652-63d930a8314a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:37.344358552 +0000 UTC m=+66.219020450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls") pod "dns-default-2r877" (UID: "daf0970a-8472-44cc-b652-63d930a8314a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:22.728913 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.728879 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5h6q4"] Jul 14 15:11:22.739759 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.739735 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.744083 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.744054 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 15:11:22.744506 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.744460 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 15:11:22.744649 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.744460 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmzk8\"" Jul 14 15:11:22.744843 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.744826 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5h6q4"] Jul 14 15:11:22.857025 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.856996 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v6rt\" (UniqueName: \"kubernetes.io/projected/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-api-access-8v6rt\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.857195 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.857031 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.857195 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.857062 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b84b9a6-0934-471d-87ec-203ed1d6e002-crio-socket\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.857195 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.857149 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b84b9a6-0934-471d-87ec-203ed1d6e002-data-volume\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.857293 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.857228 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.958328 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.958291 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v6rt\" (UniqueName: \"kubernetes.io/projected/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-api-access-8v6rt\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.958328 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.958330 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.958550 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.958354 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b84b9a6-0934-471d-87ec-203ed1d6e002-crio-socket\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.958550 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.958381 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b84b9a6-0934-471d-87ec-203ed1d6e002-data-volume\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.958550 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:22.958453 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:22.958550 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:22.958543 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:23.458522381 +0000 UTC m=+52.333184281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:22.958730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.958622 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b84b9a6-0934-471d-87ec-203ed1d6e002-crio-socket\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.958730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.958674 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.958730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.958676 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b84b9a6-0934-471d-87ec-203ed1d6e002-data-volume\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:22.958820 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:22.958746 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:22.958820 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:22.958785 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:23.458775195 +0000 UTC m=+52.333437094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : configmap "kube-rbac-proxy" not found Jul 14 15:11:22.967148 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:22.967120 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v6rt\" (UniqueName: \"kubernetes.io/projected/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-api-access-8v6rt\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:23.463131 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:23.463094 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:23.463307 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:23.463166 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:23.463307 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:23.463222 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:23.463307 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:23.463265 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:23.463421 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:23.463309 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:24.463288324 +0000 UTC m=+53.337950224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : configmap "kube-rbac-proxy" not found Jul 14 15:11:23.463421 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:23.463325 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:24.463318405 +0000 UTC m=+53.337980305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:24.169009 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:24.168973 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:24.169438 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:24.169029 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:24.169438 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:24.169138 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 15:11:24.169438 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:24.169205 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:32.169190688 +0000 UTC m=+61.043852586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : secret "router-metrics-certs-default" not found Jul 14 15:11:24.169438 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:24.169219 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:32.169213247 +0000 UTC m=+61.043875146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : configmap references non-existent config key: service-ca.crt Jul 14 15:11:24.328547 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:24.328514 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jt4bd_8aefa2d6-4dd1-4a6c-aba0-980d23df0f42/dns-node-resolver/0.log" Jul 14 15:11:24.370435 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:24.370402 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:24.370659 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:24.370597 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:24.370712 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:24.370673 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls podName:ab6c4c34-acab-4cf2-b1df-d81dcda1124b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:32.370655207 +0000 UTC m=+61.245317125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-p54tz" (UID: "ab6c4c34-acab-4cf2-b1df-d81dcda1124b") : secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:24.471914 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:24.471881 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:24.472073 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:24.471980 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:24.472073 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:24.472001 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:24.472073 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:24.472061 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:26.472044872 +0000 UTC m=+55.346706792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : configmap "kube-rbac-proxy" not found Jul 14 15:11:24.472182 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:24.472131 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:24.472214 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:24.472193 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:26.472176762 +0000 UTC m=+55.346838660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:25.128632 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:25.128605 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sfsv6_d46a976a-5e32-4f3c-a844-24aa323c4ffd/node-ca/0.log" Jul 14 15:11:25.728534 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:25.728501 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6mltn_247a017f-af9c-4894-ac46-1eb4c984514c/serve-healthcheck-canary/0.log" Jul 14 15:11:26.489854 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:26.489817 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:26.490096 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:26.489911 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:26.490096 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:26.489969 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:26.490096 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:26.490007 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:26.490096 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:26.490035 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:30.490020292 +0000 UTC m=+59.364682192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:26.490096 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:26.490052 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:30.490042962 +0000 UTC m=+59.364704861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : configmap "kube-rbac-proxy" not found Jul 14 15:11:30.520531 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:30.520474 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:30.520906 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:30.520608 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:30.520906 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:30.520647 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:30.520906 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:30.520677 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:38.520662703 +0000 UTC m=+67.395324607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : configmap "kube-rbac-proxy" not found Jul 14 15:11:30.520906 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:30.520735 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:30.520906 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:30.520782 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:38.520772002 +0000 UTC m=+67.395433901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:32.236091 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:32.236040 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:32.236091 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:32.236094 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:32.236560 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:32.236202 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 15:11:32.236560 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:32.236227 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:48.23621419 +0000 UTC m=+77.110876090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : configmap references non-existent config key: service-ca.crt Jul 14 15:11:32.236560 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:32.236266 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:48.236252847 +0000 UTC m=+77.110914746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : secret "router-metrics-certs-default" not found Jul 14 15:11:32.436977 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:32.436941 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:32.437142 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:32.437099 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:32.437187 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:32.437170 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls podName:ab6c4c34-acab-4cf2-b1df-d81dcda1124b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:48.437155822 +0000 UTC m=+77.311817721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-p54tz" (UID: "ab6c4c34-acab-4cf2-b1df-d81dcda1124b") : secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:32.800722 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:32.800695 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8khwt" Jul 14 15:11:37.376980 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.376940 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:11:37.376980 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.376988 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:11:37.377568 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.377028 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:11:37.377568 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:37.377140 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:37.377568 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:37.377166 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5557d8bc88-nkb57: secret "image-registry-tls" not found Jul 14 15:11:37.377568 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:37.377224 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls podName:ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07 nodeName:}" failed. No retries permitted until 2026-07-14 15:12:09.377209397 +0000 UTC m=+98.251871297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls") pod "image-registry-5557d8bc88-nkb57" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07") : secret "image-registry-tls" not found Jul 14 15:11:37.377568 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:37.377148 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:37.377568 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:37.377297 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls podName:daf0970a-8472-44cc-b652-63d930a8314a nodeName:}" failed. No retries permitted until 2026-07-14 15:12:09.377281951 +0000 UTC m=+98.251943852 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls") pod "dns-default-2r877" (UID: "daf0970a-8472-44cc-b652-63d930a8314a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:37.380592 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.380574 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 15:11:37.387871 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:37.387855 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 15:11:37.387927 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:37.387899 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs podName:10fc53e3-505f-404c-a379-c96f6c1e0ef4 nodeName:}" failed. No retries permitted until 2026-07-14 15:12:41.387888458 +0000 UTC m=+130.262550358 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs") pod "network-metrics-daemon-6qjr4" (UID: "10fc53e3-505f-404c-a379-c96f6c1e0ef4") : secret "metrics-daemon-secret" not found Jul 14 15:11:37.478317 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.478279 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:11:37.478317 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.478325 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:11:37.481136 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.481109 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 15:11:37.481436 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.481418 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 15:11:37.490935 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.490909 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4a6247b-81bd-4835-ae81-f0a07a52af12-original-pull-secret\") pod \"global-pull-secret-syncer-zq7j2\" (UID: \"a4a6247b-81bd-4835-ae81-f0a07a52af12\") " pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:11:37.491192 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.491178 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 15:11:37.501429 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.501408 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt5kn\" (UniqueName: \"kubernetes.io/projected/867d8cf3-1d05-4535-a7fd-54f866b89f96-kube-api-access-zt5kn\") pod \"network-check-target-228j9\" (UID: \"867d8cf3-1d05-4535-a7fd-54f866b89f96\") " pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:11:37.760650 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.760614 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5qssq\"" Jul 14 15:11:37.768911 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.768884 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:11:37.770128 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.770113 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq7j2" Jul 14 15:11:37.902638 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.902604 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zq7j2"] Jul 14 15:11:37.905714 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:11:37.905680 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a6247b_81bd_4835_ae81_f0a07a52af12.slice/crio-5b3b4e08f3d6f3250097fa23c7e6b05f0a4906b071b70c2723ae336b6a65d93a WatchSource:0}: Error finding container 5b3b4e08f3d6f3250097fa23c7e6b05f0a4906b071b70c2723ae336b6a65d93a: Status 404 returned error can't find the container with id 5b3b4e08f3d6f3250097fa23c7e6b05f0a4906b071b70c2723ae336b6a65d93a Jul 14 15:11:37.916511 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:37.916470 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-228j9"] Jul 14 15:11:37.919024 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:11:37.919004 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867d8cf3_1d05_4535_a7fd_54f866b89f96.slice/crio-b5a8d2c9c734ff0eee66a5381c1fdd47d35b3a33be9b2e2389591581eab8a5d0 WatchSource:0}: Error finding container b5a8d2c9c734ff0eee66a5381c1fdd47d35b3a33be9b2e2389591581eab8a5d0: Status 404 returned error can't find the container with id b5a8d2c9c734ff0eee66a5381c1fdd47d35b3a33be9b2e2389591581eab8a5d0 Jul 14 15:11:38.587332 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:38.587256 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:38.588334 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:38.587396 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:38.588334 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:38.587587 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:38.588334 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:38.587670 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls podName:4b84b9a6-0934-471d-87ec-203ed1d6e002 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:54.587648915 +0000 UTC m=+83.462310830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5h6q4" (UID: "4b84b9a6-0934-471d-87ec-203ed1d6e002") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:38.588334 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:38.588008 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b84b9a6-0934-471d-87ec-203ed1d6e002-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:38.894186 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:38.894096 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zq7j2" event={"ID":"a4a6247b-81bd-4835-ae81-f0a07a52af12","Type":"ContainerStarted","Data":"5b3b4e08f3d6f3250097fa23c7e6b05f0a4906b071b70c2723ae336b6a65d93a"} Jul 14 15:11:38.895964 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:38.895921 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-228j9" event={"ID":"867d8cf3-1d05-4535-a7fd-54f866b89f96","Type":"ContainerStarted","Data":"b5a8d2c9c734ff0eee66a5381c1fdd47d35b3a33be9b2e2389591581eab8a5d0"} Jul 14 15:11:40.903499 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:40.903446 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-228j9" event={"ID":"867d8cf3-1d05-4535-a7fd-54f866b89f96","Type":"ContainerStarted","Data":"0c61b1b23edad720f98d3fb81b3792ee176c11c5cd21e2ccfcfaf6c9bd94e2d9"} Jul 14 15:11:40.903954 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:40.903609 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:11:40.920120 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:40.920069 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-228j9" podStartSLOduration=66.091651148 podStartE2EDuration="1m8.92005147s" totalImagesPullingTime="2.828400322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:40.919268231 +0000 UTC m=+69.793930156" watchObservedRunningTime="2026-07-14 15:11:40.92005147 +0000 UTC m=+69.794713391" Jul 14 15:11:42.909837 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:42.909750 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zq7j2" event={"ID":"a4a6247b-81bd-4835-ae81-f0a07a52af12","Type":"ContainerStarted","Data":"57bc07d346841717a1ae6c358a7b769bbe3c96cbd8f2c2013c09df9671d40133"} Jul 14 15:11:42.926000 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:42.925947 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zq7j2" podStartSLOduration=66.244191471 podStartE2EDuration="1m10.92593043s" totalImagesPullingTime="4.681738959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:42.925475115 +0000 UTC m=+71.800137048" watchObservedRunningTime="2026-07-14 15:11:42.92593043 +0000 UTC m=+71.800592352" Jul 14 15:11:48.263709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:48.263655 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:48.263709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:48.263718 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:48.264155 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:48.263836 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle podName:2b004017-332e-4387-9412-3a85c4fd503b nodeName:}" failed. No retries permitted until 2026-07-14 15:12:20.263817523 +0000 UTC m=+109.138479422 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle") pod "router-default-6f6bcfb954-zx7cm" (UID: "2b004017-332e-4387-9412-3a85c4fd503b") : configmap references non-existent config key: service-ca.crt Jul 14 15:11:48.266142 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:48.266114 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b004017-332e-4387-9412-3a85c4fd503b-metrics-certs\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:11:48.466245 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:48.466206 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:11:48.466411 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:48.466348 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:48.466457 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:11:48.466417 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls podName:ab6c4c34-acab-4cf2-b1df-d81dcda1124b nodeName:}" failed. No retries permitted until 2026-07-14 15:12:20.466403329 +0000 UTC m=+109.341065230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-p54tz" (UID: "ab6c4c34-acab-4cf2-b1df-d81dcda1124b") : secret "cluster-monitoring-operator-tls" not found Jul 14 15:11:54.613763 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:54.613635 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:54.615926 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:54.615905 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b84b9a6-0934-471d-87ec-203ed1d6e002-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h6q4\" (UID: \"4b84b9a6-0934-471d-87ec-203ed1d6e002\") " pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:54.851868 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:54.851831 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmzk8\"" Jul 14 15:11:54.860030 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:54.860012 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5h6q4" Jul 14 15:11:54.984343 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:54.984312 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5h6q4"] Jul 14 15:11:54.984623 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:11:54.984597 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b84b9a6_0934_471d_87ec_203ed1d6e002.slice/crio-27cda9205c34613ab44cd2183ef0d1dca625905585b391185e4f9c0b6036d435 WatchSource:0}: Error finding container 27cda9205c34613ab44cd2183ef0d1dca625905585b391185e4f9c0b6036d435: Status 404 returned error can't find the container with id 27cda9205c34613ab44cd2183ef0d1dca625905585b391185e4f9c0b6036d435 Jul 14 15:11:55.947894 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:55.947857 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5h6q4" event={"ID":"4b84b9a6-0934-471d-87ec-203ed1d6e002","Type":"ContainerStarted","Data":"27cda9205c34613ab44cd2183ef0d1dca625905585b391185e4f9c0b6036d435"} Jul 14 15:11:56.548260 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.548229 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z"] Jul 14 15:11:56.551959 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.551940 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.555230 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.555174 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 15:11:56.555336 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.555289 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 15:11:56.556275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.556257 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 14 15:11:56.556370 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.556259 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 15:11:56.586782 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.586760 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z"] Jul 14 15:11:56.627230 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.627203 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9fd80631-1235-49e7-bb14-44a5d80585f2-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdd8cdd76-kdh7z\" (UID: \"9fd80631-1235-49e7-bb14-44a5d80585f2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.627366 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.627238 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db6bw\" (UniqueName: \"kubernetes.io/projected/9fd80631-1235-49e7-bb14-44a5d80585f2-kube-api-access-db6bw\") pod \"klusterlet-addon-workmgr-7cdd8cdd76-kdh7z\" (UID: \"9fd80631-1235-49e7-bb14-44a5d80585f2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.627366 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.627276 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fd80631-1235-49e7-bb14-44a5d80585f2-tmp\") pod \"klusterlet-addon-workmgr-7cdd8cdd76-kdh7z\" (UID: \"9fd80631-1235-49e7-bb14-44a5d80585f2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.728257 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.728222 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fd80631-1235-49e7-bb14-44a5d80585f2-tmp\") pod \"klusterlet-addon-workmgr-7cdd8cdd76-kdh7z\" (UID: \"9fd80631-1235-49e7-bb14-44a5d80585f2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.728438 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.728296 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9fd80631-1235-49e7-bb14-44a5d80585f2-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdd8cdd76-kdh7z\" (UID: \"9fd80631-1235-49e7-bb14-44a5d80585f2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.728438 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.728321 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db6bw\" (UniqueName: \"kubernetes.io/projected/9fd80631-1235-49e7-bb14-44a5d80585f2-kube-api-access-db6bw\") pod \"klusterlet-addon-workmgr-7cdd8cdd76-kdh7z\" (UID: \"9fd80631-1235-49e7-bb14-44a5d80585f2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.728695 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.728673 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fd80631-1235-49e7-bb14-44a5d80585f2-tmp\") pod \"klusterlet-addon-workmgr-7cdd8cdd76-kdh7z\" (UID: \"9fd80631-1235-49e7-bb14-44a5d80585f2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.730675 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.730656 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9fd80631-1235-49e7-bb14-44a5d80585f2-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdd8cdd76-kdh7z\" (UID: \"9fd80631-1235-49e7-bb14-44a5d80585f2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.741157 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.741129 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db6bw\" (UniqueName: \"kubernetes.io/projected/9fd80631-1235-49e7-bb14-44a5d80585f2-kube-api-access-db6bw\") pod \"klusterlet-addon-workmgr-7cdd8cdd76-kdh7z\" (UID: \"9fd80631-1235-49e7-bb14-44a5d80585f2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.861054 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.860968 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:11:56.987900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:56.987869 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z"] Jul 14 15:11:56.990425 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:11:56.990400 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd80631_1235_49e7_bb14_44a5d80585f2.slice/crio-2c4804906370ba370c27145bba96d350edc280f13a1a4543e4aa5ccd6df698c9 WatchSource:0}: Error finding container 2c4804906370ba370c27145bba96d350edc280f13a1a4543e4aa5ccd6df698c9: Status 404 returned error can't find the container with id 2c4804906370ba370c27145bba96d350edc280f13a1a4543e4aa5ccd6df698c9 Jul 14 15:11:57.956845 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:11:57.956799 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" event={"ID":"9fd80631-1235-49e7-bb14-44a5d80585f2","Type":"ContainerStarted","Data":"2c4804906370ba370c27145bba96d350edc280f13a1a4543e4aa5ccd6df698c9"} Jul 14 15:12:02.974432 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:02.974397 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5h6q4" event={"ID":"4b84b9a6-0934-471d-87ec-203ed1d6e002","Type":"ContainerStarted","Data":"213f08a1c33aead3dc21b3572e4cba83ac3f8e6f15c5c39ad8861f64a82264b2"} Jul 14 15:12:02.975772 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:02.975743 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" event={"ID":"9fd80631-1235-49e7-bb14-44a5d80585f2","Type":"ContainerStarted","Data":"e2cbe4e98453a08be08a8ff062abfe1c16d0dee56804b9e3411db13e8b36e618"} Jul 14 15:12:02.976043 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:02.976017 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:12:02.977691 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:02.977670 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" Jul 14 15:12:02.994668 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:02.994618 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdd8cdd76-kdh7z" podStartSLOduration=1.471603167 podStartE2EDuration="6.994605817s" totalImagesPullingTime="5.52300265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:02.99332119 +0000 UTC m=+91.867983112" watchObservedRunningTime="2026-07-14 15:12:02.994605817 +0000 UTC m=+91.869267737" Jul 14 15:12:03.980692 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:03.980649 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5h6q4" event={"ID":"4b84b9a6-0934-471d-87ec-203ed1d6e002","Type":"ContainerStarted","Data":"523c05cc6a62824df8b47b904b0148988cdda0503095c26773929644a0fc819b"} Jul 14 15:12:06.991488 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:06.991452 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5h6q4" event={"ID":"4b84b9a6-0934-471d-87ec-203ed1d6e002","Type":"ContainerStarted","Data":"ae4542db5d358ab42fad3357c5bc2baf191b8af3ddca23b2045e0f08b0d6b419"} Jul 14 15:12:07.011747 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:07.011703 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5h6q4" podStartSLOduration=34.139447633 podStartE2EDuration="45.011688347s" totalImagesPullingTime="10.872240714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:11:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:07.010216646 +0000 UTC m=+95.884878569" watchObservedRunningTime="2026-07-14 15:12:07.011688347 +0000 UTC m=+95.886350267" Jul 14 15:12:09.430637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.430580 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:12:09.430637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.430648 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:12:09.432970 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.432937 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daf0970a-8472-44cc-b652-63d930a8314a-metrics-tls\") pod \"dns-default-2r877\" (UID: \"daf0970a-8472-44cc-b652-63d930a8314a\") " pod="openshift-dns/dns-default-2r877" Jul 14 15:12:09.433059 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.433015 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"image-registry-5557d8bc88-nkb57\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:12:09.442214 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.442193 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlfph\"" Jul 14 15:12:09.450391 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.450373 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2r877" Jul 14 15:12:09.571126 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.571005 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2r877"] Jul 14 15:12:09.573613 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:09.573587 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf0970a_8472_44cc_b652_63d930a8314a.slice/crio-cdedf1e49ef994c365a4ca88265cffabf3b1e1e671aefe52bf0b02f010fd4826 WatchSource:0}: Error finding container cdedf1e49ef994c365a4ca88265cffabf3b1e1e671aefe52bf0b02f010fd4826: Status 404 returned error can't find the container with id cdedf1e49ef994c365a4ca88265cffabf3b1e1e671aefe52bf0b02f010fd4826 Jul 14 15:12:09.714743 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.714652 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-flhw9\"" Jul 14 15:12:09.723086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.723064 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:12:09.848279 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:09.848252 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5557d8bc88-nkb57"] Jul 14 15:12:09.851038 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:09.851012 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc48fd8_7a4a_4e46_93f6_c5a2484dfc07.slice/crio-1101f5ed571df511513821ffb3d09c8219b273ac2b5efdc0583193ca0cc4746c WatchSource:0}: Error finding container 1101f5ed571df511513821ffb3d09c8219b273ac2b5efdc0583193ca0cc4746c: Status 404 returned error can't find the container with id 1101f5ed571df511513821ffb3d09c8219b273ac2b5efdc0583193ca0cc4746c Jul 14 15:12:10.002450 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:10.002347 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" event={"ID":"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07","Type":"ContainerStarted","Data":"afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054"} Jul 14 15:12:10.002450 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:10.002404 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" event={"ID":"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07","Type":"ContainerStarted","Data":"1101f5ed571df511513821ffb3d09c8219b273ac2b5efdc0583193ca0cc4746c"} Jul 14 15:12:10.002667 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:10.002463 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:12:10.003460 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:10.003443 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2r877" event={"ID":"daf0970a-8472-44cc-b652-63d930a8314a","Type":"ContainerStarted","Data":"cdedf1e49ef994c365a4ca88265cffabf3b1e1e671aefe52bf0b02f010fd4826"} Jul 14 15:12:10.024132 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:10.024078 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" podStartSLOduration=98.024060651 podStartE2EDuration="1m38.024060651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:10.023772915 +0000 UTC m=+98.898434839" watchObservedRunningTime="2026-07-14 15:12:10.024060651 +0000 UTC m=+98.898722571" Jul 14 15:12:11.909192 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:11.909163 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-228j9" Jul 14 15:12:12.012333 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:12.012295 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2r877" event={"ID":"daf0970a-8472-44cc-b652-63d930a8314a","Type":"ContainerStarted","Data":"36616fab4247fa6751cacb67a93152d40758f33ef9a7b5061bdd947be76ce528"} Jul 14 15:12:12.012550 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:12.012384 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2r877" event={"ID":"daf0970a-8472-44cc-b652-63d930a8314a","Type":"ContainerStarted","Data":"ab41fc647826e27b20efa4ab6269e0e1a25d82cfe6072120980a53fd523467ee"} Jul 14 15:12:12.012550 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:12.012435 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2r877" Jul 14 15:12:12.035237 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:12.035188 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2r877" podStartSLOduration=65.193561214 podStartE2EDuration="1m7.03517528s" totalImagesPullingTime="1.841614066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:12.034007588 +0000 UTC m=+100.908669508" watchObservedRunningTime="2026-07-14 15:12:12.03517528 +0000 UTC m=+100.909837242" Jul 14 15:12:19.571166 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:19.571127 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5557d8bc88-nkb57"] Jul 14 15:12:20.320180 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.320138 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:12:20.320823 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.320802 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b004017-332e-4387-9412-3a85c4fd503b-service-ca-bundle\") pod \"router-default-6f6bcfb954-zx7cm\" (UID: \"2b004017-332e-4387-9412-3a85c4fd503b\") " pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:12:20.375829 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.375801 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jm4q5\"" Jul 14 15:12:20.384065 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.384049 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:12:20.510999 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.510966 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f6bcfb954-zx7cm"] Jul 14 15:12:20.512927 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:20.512897 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b004017_332e_4387_9412_3a85c4fd503b.slice/crio-1fcdaec1ce5a728db260ea0759494f69482fe2087e5efdd060d7ac530b5614fe WatchSource:0}: Error finding container 1fcdaec1ce5a728db260ea0759494f69482fe2087e5efdd060d7ac530b5614fe: Status 404 returned error can't find the container with id 1fcdaec1ce5a728db260ea0759494f69482fe2087e5efdd060d7ac530b5614fe Jul 14 15:12:20.523208 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.523173 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:12:20.525877 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.525852 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4c34-acab-4cf2-b1df-d81dcda1124b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-p54tz\" (UID: \"ab6c4c34-acab-4cf2-b1df-d81dcda1124b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:12:20.784957 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.784928 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zhk8b\"" Jul 14 15:12:20.793363 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.793322 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" Jul 14 15:12:20.834828 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.834797 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f8948cbdc-65t56"] Jul 14 15:12:20.837425 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.837398 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:20.840762 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.840456 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 15:12:20.840762 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.840540 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 15:12:20.840900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.840838 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 15:12:20.840950 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.840915 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 15:12:20.840998 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.840843 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 15:12:20.841137 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.841104 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 15:12:20.841375 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.841333 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6zpvk\"" Jul 14 15:12:20.842374 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.842221 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 15:12:20.852366 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.852262 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8948cbdc-65t56"] Jul 14 15:12:20.917426 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.917391 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz"] Jul 14 15:12:20.920083 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:20.920053 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6c4c34_acab_4cf2_b1df_d81dcda1124b.slice/crio-497ca682fddf22b48347fdeb18e28bfdae09309673b3a7c02118c6f312d691e9 WatchSource:0}: Error finding container 497ca682fddf22b48347fdeb18e28bfdae09309673b3a7c02118c6f312d691e9: Status 404 returned error can't find the container with id 497ca682fddf22b48347fdeb18e28bfdae09309673b3a7c02118c6f312d691e9 Jul 14 15:12:20.926239 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.926220 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-serving-cert\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:20.926346 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.926257 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-console-config\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:20.926346 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.926278 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-oauth-serving-cert\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:20.926346 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.926300 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vnrb\" (UniqueName: \"kubernetes.io/projected/8045f4b2-bb38-439d-b1bf-af5440285794-kube-api-access-9vnrb\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:20.926346 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.926335 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-oauth-config\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:20.926529 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:20.926366 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-service-ca\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.027117 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.027078 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-oauth-config\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.027117 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.027120 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-service-ca\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.027381 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.027213 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-serving-cert\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.027381 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.027254 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-console-config\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.027381 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.027291 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-oauth-serving-cert\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.027381 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.027328 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vnrb\" (UniqueName: \"kubernetes.io/projected/8045f4b2-bb38-439d-b1bf-af5440285794-kube-api-access-9vnrb\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.027997 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.027969 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-oauth-serving-cert\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.027997 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.027992 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-service-ca\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.028140 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.027975 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-console-config\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.029695 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.029670 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-oauth-config\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.029788 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.029769 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-serving-cert\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.035233 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.035191 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vnrb\" (UniqueName: \"kubernetes.io/projected/8045f4b2-bb38-439d-b1bf-af5440285794-kube-api-access-9vnrb\") pod \"console-7f8948cbdc-65t56\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.041086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.041062 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" event={"ID":"2b004017-332e-4387-9412-3a85c4fd503b","Type":"ContainerStarted","Data":"fd383e84f395f6a8436ddceca7aa270cdc9d061fd6c0858985bc1c1b63a50a8e"} Jul 14 15:12:21.041172 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.041115 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" event={"ID":"2b004017-332e-4387-9412-3a85c4fd503b","Type":"ContainerStarted","Data":"1fcdaec1ce5a728db260ea0759494f69482fe2087e5efdd060d7ac530b5614fe"} Jul 14 15:12:21.042191 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.042171 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" event={"ID":"ab6c4c34-acab-4cf2-b1df-d81dcda1124b","Type":"ContainerStarted","Data":"497ca682fddf22b48347fdeb18e28bfdae09309673b3a7c02118c6f312d691e9"} Jul 14 15:12:21.062038 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.061987 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" podStartSLOduration=65.061972226 podStartE2EDuration="1m5.061972226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:21.06085684 +0000 UTC m=+109.935518772" watchObservedRunningTime="2026-07-14 15:12:21.061972226 +0000 UTC m=+109.936634148" Jul 14 15:12:21.148030 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.147993 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:21.276552 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.276522 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8948cbdc-65t56"] Jul 14 15:12:21.279463 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:21.279434 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8045f4b2_bb38_439d_b1bf_af5440285794.slice/crio-03640b57927cd0624b733c781bd584132b54ff79ed2e3d41ff9edd02cbb9d508 WatchSource:0}: Error finding container 03640b57927cd0624b733c781bd584132b54ff79ed2e3d41ff9edd02cbb9d508: Status 404 returned error can't find the container with id 03640b57927cd0624b733c781bd584132b54ff79ed2e3d41ff9edd02cbb9d508 Jul 14 15:12:21.385350 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.385258 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:12:21.388050 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:21.388030 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:12:22.017899 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:22.017863 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2r877" Jul 14 15:12:22.055068 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:22.055032 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8948cbdc-65t56" event={"ID":"8045f4b2-bb38-439d-b1bf-af5440285794","Type":"ContainerStarted","Data":"03640b57927cd0624b733c781bd584132b54ff79ed2e3d41ff9edd02cbb9d508"} Jul 14 15:12:22.055282 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:22.055263 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:12:22.056636 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:22.056615 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f6bcfb954-zx7cm" Jul 14 15:12:23.061781 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.061694 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" event={"ID":"ab6c4c34-acab-4cf2-b1df-d81dcda1124b","Type":"ContainerStarted","Data":"a697cd8775098425a62475186acd0adca441f92e4057837a154d34aee95feb53"} Jul 14 15:12:23.092153 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.092098 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-p54tz" podStartSLOduration=65.255196958 podStartE2EDuration="1m7.092080762s" totalImagesPullingTime="1.836883804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:23.091160923 +0000 UTC m=+111.965822846" watchObservedRunningTime="2026-07-14 15:12:23.092080762 +0000 UTC m=+111.966742684" Jul 14 15:12:23.299492 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.299441 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs"] Jul 14 15:12:23.301701 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.301679 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" Jul 14 15:12:23.305361 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.305271 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dw6df\"" Jul 14 15:12:23.305361 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.305288 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 15:12:23.315460 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.315390 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs"] Jul 14 15:12:23.349177 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.349148 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54c0f3c2-f2e9-40ab-a4fd-26b3dd9e4c24-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-rczqs\" (UID: \"54c0f3c2-f2e9-40ab-a4fd-26b3dd9e4c24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" Jul 14 15:12:23.449988 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.449944 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54c0f3c2-f2e9-40ab-a4fd-26b3dd9e4c24-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-rczqs\" (UID: \"54c0f3c2-f2e9-40ab-a4fd-26b3dd9e4c24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" Jul 14 15:12:23.452652 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.452626 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54c0f3c2-f2e9-40ab-a4fd-26b3dd9e4c24-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-rczqs\" (UID: \"54c0f3c2-f2e9-40ab-a4fd-26b3dd9e4c24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" Jul 14 15:12:23.614030 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:23.613944 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" Jul 14 15:12:24.543472 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:24.543441 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs"] Jul 14 15:12:24.546656 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:24.546466 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c0f3c2_f2e9_40ab_a4fd_26b3dd9e4c24.slice/crio-1268a0661d8315faaba22536c5eadf70a529c2256f0edae715eeac55d2779e68 WatchSource:0}: Error finding container 1268a0661d8315faaba22536c5eadf70a529c2256f0edae715eeac55d2779e68: Status 404 returned error can't find the container with id 1268a0661d8315faaba22536c5eadf70a529c2256f0edae715eeac55d2779e68 Jul 14 15:12:25.070112 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:25.070061 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" event={"ID":"54c0f3c2-f2e9-40ab-a4fd-26b3dd9e4c24","Type":"ContainerStarted","Data":"1268a0661d8315faaba22536c5eadf70a529c2256f0edae715eeac55d2779e68"} Jul 14 15:12:25.071505 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:25.071474 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8948cbdc-65t56" event={"ID":"8045f4b2-bb38-439d-b1bf-af5440285794","Type":"ContainerStarted","Data":"d57ab99802cc628de00774ae57c3758c5e47772fd657536714fb9d3cc4d4a8eb"} Jul 14 15:12:25.090511 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:25.090451 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f8948cbdc-65t56" podStartSLOduration=1.9274141249999999 podStartE2EDuration="5.090437514s" totalImagesPullingTime="3.163023389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:25.090312548 +0000 UTC m=+113.964974468" watchObservedRunningTime="2026-07-14 15:12:25.090437514 +0000 UTC m=+113.965099435" Jul 14 15:12:26.079458 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:26.079381 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" event={"ID":"54c0f3c2-f2e9-40ab-a4fd-26b3dd9e4c24","Type":"ContainerStarted","Data":"75419fffdc7d9a6ae9b68132bf05d9c8daafe0824ad8525f5d89a2a244304060"} Jul 14 15:12:26.095286 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:26.095242 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" podStartSLOduration=1.9222749879999999 podStartE2EDuration="3.095228472s" totalImagesPullingTime="1.172953484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:26.094065732 +0000 UTC m=+114.968727652" watchObservedRunningTime="2026-07-14 15:12:26.095228472 +0000 UTC m=+114.969890392" Jul 14 15:12:27.082440 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.082408 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" Jul 14 15:12:27.087240 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.087220 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rczqs" Jul 14 15:12:27.353718 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.353639 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-zl5dn"] Jul 14 15:12:27.355925 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.355909 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.358396 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.358374 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9rmgp\"" Jul 14 15:12:27.358552 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.358500 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 14 15:12:27.358872 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.358853 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 14 15:12:27.359725 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.359707 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 15:12:27.370220 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.370198 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-zl5dn"] Jul 14 15:12:27.483690 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.483655 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.483891 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.483731 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.483891 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.483815 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.483891 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.483868 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6btzt\" (UniqueName: \"kubernetes.io/projected/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-kube-api-access-6btzt\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.584606 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.584568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.584859 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.584628 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.584859 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.584670 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6btzt\" (UniqueName: \"kubernetes.io/projected/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-kube-api-access-6btzt\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.584859 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.584700 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.585641 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.585613 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.586977 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.586956 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.587119 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.587101 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.593223 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.593196 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6btzt\" (UniqueName: \"kubernetes.io/projected/957c4103-1af0-4a2b-b6c3-ee047c4d96c9-kube-api-access-6btzt\") pod \"prometheus-operator-64785b6675-zl5dn\" (UID: \"957c4103-1af0-4a2b-b6c3-ee047c4d96c9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.665101 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.665011 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" Jul 14 15:12:27.790925 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:27.790894 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-zl5dn"] Jul 14 15:12:27.796565 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:27.796540 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957c4103_1af0_4a2b_b6c3_ee047c4d96c9.slice/crio-6714daba43e605feb91a549658467488eccfa9909ef4e12d96525311ded2395f WatchSource:0}: Error finding container 6714daba43e605feb91a549658467488eccfa9909ef4e12d96525311ded2395f: Status 404 returned error can't find the container with id 6714daba43e605feb91a549658467488eccfa9909ef4e12d96525311ded2395f Jul 14 15:12:28.086614 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:28.086577 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" event={"ID":"957c4103-1af0-4a2b-b6c3-ee047c4d96c9","Type":"ContainerStarted","Data":"6714daba43e605feb91a549658467488eccfa9909ef4e12d96525311ded2395f"} Jul 14 15:12:29.577352 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:29.577321 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:12:30.096133 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:30.096100 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" event={"ID":"957c4103-1af0-4a2b-b6c3-ee047c4d96c9","Type":"ContainerStarted","Data":"5f1cacccb9d23beb419175aed7c7a94dcfa3a4aec1355d4e7cf3636e4ba29844"} Jul 14 15:12:30.096309 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:30.096159 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" event={"ID":"957c4103-1af0-4a2b-b6c3-ee047c4d96c9","Type":"ContainerStarted","Data":"553a20a6baafdece02895cdc6807368629eb9529c45d72002b2655a73133fb7a"} Jul 14 15:12:30.116554 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:30.116501 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-zl5dn" podStartSLOduration=1.8314958749999999 podStartE2EDuration="3.116470738s" totalImagesPullingTime="1.284974863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:30.114429163 +0000 UTC m=+118.989091083" watchObservedRunningTime="2026-07-14 15:12:30.116470738 +0000 UTC m=+118.991132659" Jul 14 15:12:31.148835 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.148800 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:31.149294 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.148870 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:31.153716 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.153694 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:31.716900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.716865 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq"] Jul 14 15:12:31.736975 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.736940 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pcbvr"] Jul 14 15:12:31.737123 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.737057 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.739458 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.739432 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 14 15:12:31.739618 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.739436 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 14 15:12:31.739771 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.739754 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bgrrp\"" Jul 14 15:12:31.748604 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.748580 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq"] Jul 14 15:12:31.749278 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.748830 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.751332 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.751311 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vkczp\"" Jul 14 15:12:31.751332 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.751325 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 15:12:31.751618 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.751599 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 15:12:31.751714 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.751648 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 15:12:31.815070 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815039 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4xxh\" (UniqueName: \"kubernetes.io/projected/30beda90-6df6-4ab6-bccc-9b0a81ba676e-kube-api-access-j4xxh\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.815070 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815074 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcdc436c-fba2-43f1-a937-9a946e14a191-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.815260 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815093 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-textfile\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.815260 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815116 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch22z\" (UniqueName: \"kubernetes.io/projected/fcdc436c-fba2-43f1-a937-9a946e14a191-kube-api-access-ch22z\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.815260 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815138 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30beda90-6df6-4ab6-bccc-9b0a81ba676e-sys\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.815260 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815186 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-wtmp\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.815260 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815206 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30beda90-6df6-4ab6-bccc-9b0a81ba676e-metrics-client-ca\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.815260 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815244 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.815502 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815283 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30beda90-6df6-4ab6-bccc-9b0a81ba676e-root\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.815502 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815306 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcdc436c-fba2-43f1-a937-9a946e14a191-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.815502 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815327 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcdc436c-fba2-43f1-a937-9a946e14a191-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.815502 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815353 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.815502 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.815394 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-tls\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.916466 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916430 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcdc436c-fba2-43f1-a937-9a946e14a191-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.916644 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916473 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.916644 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916525 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-tls\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.916644 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916571 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4xxh\" (UniqueName: \"kubernetes.io/projected/30beda90-6df6-4ab6-bccc-9b0a81ba676e-kube-api-access-j4xxh\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.916644 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916598 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcdc436c-fba2-43f1-a937-9a946e14a191-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.916644 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916621 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-textfile\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.916908 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916648 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch22z\" (UniqueName: \"kubernetes.io/projected/fcdc436c-fba2-43f1-a937-9a946e14a191-kube-api-access-ch22z\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.916908 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:12:31.916661 2585 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 15:12:31.916908 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916705 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30beda90-6df6-4ab6-bccc-9b0a81ba676e-sys\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.916908 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:12:31.916732 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-tls podName:30beda90-6df6-4ab6-bccc-9b0a81ba676e nodeName:}" failed. No retries permitted until 2026-07-14 15:12:32.416711979 +0000 UTC m=+121.291373878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-tls") pod "node-exporter-pcbvr" (UID: "30beda90-6df6-4ab6-bccc-9b0a81ba676e") : secret "node-exporter-tls" not found Jul 14 15:12:31.916908 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916761 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30beda90-6df6-4ab6-bccc-9b0a81ba676e-sys\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.916908 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916786 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-wtmp\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.916908 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916815 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30beda90-6df6-4ab6-bccc-9b0a81ba676e-metrics-client-ca\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.916908 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916856 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.917294 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916924 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30beda90-6df6-4ab6-bccc-9b0a81ba676e-root\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.917294 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916946 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-textfile\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.917294 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.916957 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcdc436c-fba2-43f1-a937-9a946e14a191-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.917294 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.917165 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-wtmp\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.917294 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.917236 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30beda90-6df6-4ab6-bccc-9b0a81ba676e-root\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.917544 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.917461 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30beda90-6df6-4ab6-bccc-9b0a81ba676e-metrics-client-ca\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.917667 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.917648 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcdc436c-fba2-43f1-a937-9a946e14a191-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.917722 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.917690 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.918978 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.918957 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcdc436c-fba2-43f1-a937-9a946e14a191-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.919709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.919689 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.919872 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.919856 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcdc436c-fba2-43f1-a937-9a946e14a191-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:31.926336 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.926312 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4xxh\" (UniqueName: \"kubernetes.io/projected/30beda90-6df6-4ab6-bccc-9b0a81ba676e-kube-api-access-j4xxh\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:31.926680 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:31.926658 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch22z\" (UniqueName: \"kubernetes.io/projected/fcdc436c-fba2-43f1-a937-9a946e14a191-kube-api-access-ch22z\") pod \"openshift-state-metrics-84bd68b896-bxkcq\" (UID: \"fcdc436c-fba2-43f1-a937-9a946e14a191\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:32.048191 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:32.048117 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" Jul 14 15:12:32.106361 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:32.106329 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:32.219171 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:32.219144 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq"] Jul 14 15:12:32.221323 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:32.221300 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdc436c_fba2_43f1_a937_9a946e14a191.slice/crio-ed8fe97435f999a40c9788ff06d8257cec6d72f343e5263054303a7a6ed41f3d WatchSource:0}: Error finding container ed8fe97435f999a40c9788ff06d8257cec6d72f343e5263054303a7a6ed41f3d: Status 404 returned error can't find the container with id ed8fe97435f999a40c9788ff06d8257cec6d72f343e5263054303a7a6ed41f3d Jul 14 15:12:32.421499 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:32.421455 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-tls\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:32.423625 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:32.423601 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30beda90-6df6-4ab6-bccc-9b0a81ba676e-node-exporter-tls\") pod \"node-exporter-pcbvr\" (UID: \"30beda90-6df6-4ab6-bccc-9b0a81ba676e\") " pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:32.658570 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:32.658463 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcbvr" Jul 14 15:12:33.107067 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.107035 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcbvr" event={"ID":"30beda90-6df6-4ab6-bccc-9b0a81ba676e","Type":"ContainerStarted","Data":"7af5ad63946e046b3a549ca24e4854ab60ca5d81bbc02e59e0a29111a028b972"} Jul 14 15:12:33.108832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.108802 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" event={"ID":"fcdc436c-fba2-43f1-a937-9a946e14a191","Type":"ContainerStarted","Data":"8822dc6ac38f26cf17bcf225485142d12ee1ce77bbe95fcdf1244c67ba3b3c1f"} Jul 14 15:12:33.108927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.108869 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" event={"ID":"fcdc436c-fba2-43f1-a937-9a946e14a191","Type":"ContainerStarted","Data":"d6bed6320806ee411628cdea757a52e0f3a5b40af08362c76db34188676543a3"} Jul 14 15:12:33.108927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.108900 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" event={"ID":"fcdc436c-fba2-43f1-a937-9a946e14a191","Type":"ContainerStarted","Data":"ed8fe97435f999a40c9788ff06d8257cec6d72f343e5263054303a7a6ed41f3d"} Jul 14 15:12:33.733168 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.733137 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8948cbdc-65t56"] Jul 14 15:12:33.855080 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.853044 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d9b574688-p69th"] Jul 14 15:12:33.871813 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.871781 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:33.874449 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.874412 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qcsw6\"" Jul 14 15:12:33.874588 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.874450 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 14 15:12:33.875377 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.875356 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 14 15:12:33.875513 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.875358 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 14 15:12:33.875513 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.875407 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 14 15:12:33.875985 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.875954 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fmickvrrs115a\"" Jul 14 15:12:33.876473 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.876430 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d9b574688-p69th"] Jul 14 15:12:33.876603 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:33.876549 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 14 15:12:34.036043 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.035969 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9t45\" (UniqueName: \"kubernetes.io/projected/904cf864-9048-47bd-aa34-212fd7370086-kube-api-access-v9t45\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.036043 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.036013 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.036043 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.036045 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.036249 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.036081 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-tls\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.036249 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.036143 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.036249 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.036170 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.036249 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.036191 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904cf864-9048-47bd-aa34-212fd7370086-metrics-client-ca\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.036249 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.036218 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-grpc-tls\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.137166 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.137137 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.137316 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.137176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.137316 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.137193 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904cf864-9048-47bd-aa34-212fd7370086-metrics-client-ca\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.137316 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.137258 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-grpc-tls\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.137498 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.137318 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9t45\" (UniqueName: \"kubernetes.io/projected/904cf864-9048-47bd-aa34-212fd7370086-kube-api-access-v9t45\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.137498 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.137372 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.137498 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.137412 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.137638 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.137548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-tls\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.138218 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.138051 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904cf864-9048-47bd-aa34-212fd7370086-metrics-client-ca\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.140264 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.140238 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.140428 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.140402 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-grpc-tls\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.140794 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.140764 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.140896 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.140872 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.140960 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.140872 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-tls\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.141280 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.141260 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/904cf864-9048-47bd-aa34-212fd7370086-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.146346 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.146327 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9t45\" (UniqueName: \"kubernetes.io/projected/904cf864-9048-47bd-aa34-212fd7370086-kube-api-access-v9t45\") pod \"thanos-querier-6d9b574688-p69th\" (UID: \"904cf864-9048-47bd-aa34-212fd7370086\") " pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.183453 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.183425 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:34.611114 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:34.611081 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d9b574688-p69th"] Jul 14 15:12:34.751436 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:34.751402 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904cf864_9048_47bd_aa34_212fd7370086.slice/crio-3a824ff718c84e28c5cabdf2fc57b5cd0bdb957b6098f8700430da197b48292e WatchSource:0}: Error finding container 3a824ff718c84e28c5cabdf2fc57b5cd0bdb957b6098f8700430da197b48292e: Status 404 returned error can't find the container with id 3a824ff718c84e28c5cabdf2fc57b5cd0bdb957b6098f8700430da197b48292e Jul 14 15:12:35.118116 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:35.118027 2585 generic.go:356] "Generic (PLEG): container finished" podID="30beda90-6df6-4ab6-bccc-9b0a81ba676e" containerID="f45dd266c4e53a2333ef1050d1fc25b62d05296fd0958f2c6859db76cd891681" exitCode=0 Jul 14 15:12:35.118268 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:35.118121 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcbvr" event={"ID":"30beda90-6df6-4ab6-bccc-9b0a81ba676e","Type":"ContainerDied","Data":"f45dd266c4e53a2333ef1050d1fc25b62d05296fd0958f2c6859db76cd891681"} Jul 14 15:12:35.120544 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:35.120504 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" event={"ID":"fcdc436c-fba2-43f1-a937-9a946e14a191","Type":"ContainerStarted","Data":"b33a21392505c2787c99a81515be39290bf4ee210a10d0701577867169e9923a"} Jul 14 15:12:35.122109 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:35.122083 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" event={"ID":"904cf864-9048-47bd-aa34-212fd7370086","Type":"ContainerStarted","Data":"3a824ff718c84e28c5cabdf2fc57b5cd0bdb957b6098f8700430da197b48292e"} Jul 14 15:12:35.167336 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:35.167291 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bxkcq" podStartSLOduration=1.860367755 podStartE2EDuration="4.167275945s" totalImagesPullingTime="2.30690819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:35.165705009 +0000 UTC m=+124.040366931" watchObservedRunningTime="2026-07-14 15:12:35.167275945 +0000 UTC m=+124.041937866" Jul 14 15:12:36.133040 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.132997 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcbvr" event={"ID":"30beda90-6df6-4ab6-bccc-9b0a81ba676e","Type":"ContainerStarted","Data":"9eedabeb343768691dc21c3b1214d1924fc5905a627264def87fccec5665eeab"} Jul 14 15:12:36.133636 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.133134 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcbvr" event={"ID":"30beda90-6df6-4ab6-bccc-9b0a81ba676e","Type":"ContainerStarted","Data":"53f9d519a041f7dfb61715af8aaaafcf7acc07da45ef3609c7a7be87236aacfd"} Jul 14 15:12:36.161775 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.161709 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pcbvr" podStartSLOduration=3.6912527 podStartE2EDuration="5.161688596s" totalImagesPullingTime="1.383283192s" totalInitContainerRuntime="87.152704ms" isStatefulPod=true podCreationTimestamp="2026-07-14 15:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:36.160848447 +0000 UTC m=+125.035510593" watchObservedRunningTime="2026-07-14 15:12:36.161688596 +0000 UTC m=+125.036350518" Jul 14 15:12:36.500585 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.500548 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8489d95878-qr5sz"] Jul 14 15:12:36.518620 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.518588 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv"] Jul 14 15:12:36.518776 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.518693 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.526097 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.526068 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 15:12:36.531840 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.531814 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv"] Jul 14 15:12:36.531960 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.531910 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:36.531960 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.531937 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8489d95878-qr5sz"] Jul 14 15:12:36.534289 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.534266 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 15:12:36.534289 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.534285 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kdg2j\"" Jul 14 15:12:36.663046 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.663014 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-oauth-serving-cert\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.663237 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.663057 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-service-ca\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.663237 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.663076 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-console-config\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.663237 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.663180 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-oauth-config\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.663402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.663238 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d95850d-30bf-4f9f-86ad-eb6656945648-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cqtvv\" (UID: \"7d95850d-30bf-4f9f-86ad-eb6656945648\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:36.663402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.663264 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-serving-cert\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.663402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.663296 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtbbb\" (UniqueName: \"kubernetes.io/projected/e967b1ac-87c3-4595-943e-4270366f4dfe-kube-api-access-xtbbb\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.663402 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.663380 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-trusted-ca-bundle\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.663603 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.663406 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4sbb\" (UniqueName: \"kubernetes.io/projected/7d95850d-30bf-4f9f-86ad-eb6656945648-kube-api-access-m4sbb\") pod \"monitoring-plugin-5f68df7f58-cqtvv\" (UID: \"7d95850d-30bf-4f9f-86ad-eb6656945648\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:36.764610 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.764522 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-oauth-config\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.764610 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.764583 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d95850d-30bf-4f9f-86ad-eb6656945648-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cqtvv\" (UID: \"7d95850d-30bf-4f9f-86ad-eb6656945648\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:36.764610 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.764608 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-serving-cert\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.764900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.764628 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtbbb\" (UniqueName: \"kubernetes.io/projected/e967b1ac-87c3-4595-943e-4270366f4dfe-kube-api-access-xtbbb\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.764900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.764678 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-trusted-ca-bundle\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.764900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.764693 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4sbb\" (UniqueName: \"kubernetes.io/projected/7d95850d-30bf-4f9f-86ad-eb6656945648-kube-api-access-m4sbb\") pod \"monitoring-plugin-5f68df7f58-cqtvv\" (UID: \"7d95850d-30bf-4f9f-86ad-eb6656945648\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:36.764900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.764718 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-oauth-serving-cert\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.764900 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:12:36.764744 2585 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 14 15:12:36.764900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.764761 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-service-ca\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.764900 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.764787 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-console-config\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.764900 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:12:36.764828 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d95850d-30bf-4f9f-86ad-eb6656945648-monitoring-plugin-cert podName:7d95850d-30bf-4f9f-86ad-eb6656945648 nodeName:}" failed. No retries permitted until 2026-07-14 15:12:37.26480495 +0000 UTC m=+126.139466879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7d95850d-30bf-4f9f-86ad-eb6656945648-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-cqtvv" (UID: "7d95850d-30bf-4f9f-86ad-eb6656945648") : secret "monitoring-plugin-cert" not found Jul 14 15:12:36.765641 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.765569 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-console-config\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.765764 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.765662 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-trusted-ca-bundle\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.765827 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.765779 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-oauth-serving-cert\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.765881 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.765856 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-service-ca\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.767162 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.767144 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-serving-cert\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.767240 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.767188 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-oauth-config\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.774019 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.773996 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtbbb\" (UniqueName: \"kubernetes.io/projected/e967b1ac-87c3-4595-943e-4270366f4dfe-kube-api-access-xtbbb\") pod \"console-8489d95878-qr5sz\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.774244 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.774224 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4sbb\" (UniqueName: \"kubernetes.io/projected/7d95850d-30bf-4f9f-86ad-eb6656945648-kube-api-access-m4sbb\") pod \"monitoring-plugin-5f68df7f58-cqtvv\" (UID: \"7d95850d-30bf-4f9f-86ad-eb6656945648\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:36.830371 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.830334 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:36.990491 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:36.990449 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8489d95878-qr5sz"] Jul 14 15:12:37.272151 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:37.272119 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d95850d-30bf-4f9f-86ad-eb6656945648-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cqtvv\" (UID: \"7d95850d-30bf-4f9f-86ad-eb6656945648\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:37.274800 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:37.274774 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d95850d-30bf-4f9f-86ad-eb6656945648-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cqtvv\" (UID: \"7d95850d-30bf-4f9f-86ad-eb6656945648\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:37.434151 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:37.434117 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode967b1ac_87c3_4595_943e_4270366f4dfe.slice/crio-2acafb16cc7d83d2426b29546bf237b8271cc07bec3755bc0b56e148e15be40a WatchSource:0}: Error finding container 2acafb16cc7d83d2426b29546bf237b8271cc07bec3755bc0b56e148e15be40a: Status 404 returned error can't find the container with id 2acafb16cc7d83d2426b29546bf237b8271cc07bec3755bc0b56e148e15be40a Jul 14 15:12:37.441163 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:37.441141 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:37.607470 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:37.604508 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv"] Jul 14 15:12:37.608028 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:37.607998 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d95850d_30bf_4f9f_86ad_eb6656945648.slice/crio-3308487354afb7bb71d27e872de9db76364c401344a652e286f82b33988c56ad WatchSource:0}: Error finding container 3308487354afb7bb71d27e872de9db76364c401344a652e286f82b33988c56ad: Status 404 returned error can't find the container with id 3308487354afb7bb71d27e872de9db76364c401344a652e286f82b33988c56ad Jul 14 15:12:38.144556 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:38.144514 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8489d95878-qr5sz" event={"ID":"e967b1ac-87c3-4595-943e-4270366f4dfe","Type":"ContainerStarted","Data":"c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8"} Jul 14 15:12:38.144759 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:38.144582 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8489d95878-qr5sz" event={"ID":"e967b1ac-87c3-4595-943e-4270366f4dfe","Type":"ContainerStarted","Data":"2acafb16cc7d83d2426b29546bf237b8271cc07bec3755bc0b56e148e15be40a"} Jul 14 15:12:38.146746 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:38.146717 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" event={"ID":"904cf864-9048-47bd-aa34-212fd7370086","Type":"ContainerStarted","Data":"698f244ff758e45281e6454e2127f6c5a40157bc304d79541a88184970922efb"} Jul 14 15:12:38.146865 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:38.146784 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" event={"ID":"904cf864-9048-47bd-aa34-212fd7370086","Type":"ContainerStarted","Data":"2da989da286072e9983ee6163c926b7ab4432f0f5563f619bfb4b060e174e576"} Jul 14 15:12:38.146865 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:38.146826 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" event={"ID":"904cf864-9048-47bd-aa34-212fd7370086","Type":"ContainerStarted","Data":"98fd837dcd3947258a912bd5bd61e3b74d15e2b5be9f91ba517a152e4cbdd333"} Jul 14 15:12:38.147729 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:38.147708 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" event={"ID":"7d95850d-30bf-4f9f-86ad-eb6656945648","Type":"ContainerStarted","Data":"3308487354afb7bb71d27e872de9db76364c401344a652e286f82b33988c56ad"} Jul 14 15:12:38.172914 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:38.172849 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8489d95878-qr5sz" podStartSLOduration=2.172824535 podStartE2EDuration="2.172824535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:38.170810543 +0000 UTC m=+127.045472465" watchObservedRunningTime="2026-07-14 15:12:38.172824535 +0000 UTC m=+127.047486453" Jul 14 15:12:40.158740 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:40.158695 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" event={"ID":"904cf864-9048-47bd-aa34-212fd7370086","Type":"ContainerStarted","Data":"4b91c53e00349837cad992433368e63bc312819aec582e76432906e32fac8b22"} Jul 14 15:12:40.159207 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:40.158787 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" event={"ID":"904cf864-9048-47bd-aa34-212fd7370086","Type":"ContainerStarted","Data":"a2021e94d90f46a6f8e5614da42cd2273685dcd003c193702bec8bcf06901b01"} Jul 14 15:12:40.159207 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:40.158832 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" event={"ID":"904cf864-9048-47bd-aa34-212fd7370086","Type":"ContainerStarted","Data":"5ff0611ffc9604229ac876ab8220d98e537a62e1595db8eec4c44c6c9b8b1bf3"} Jul 14 15:12:40.159207 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:40.158877 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:40.160139 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:40.160113 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" event={"ID":"7d95850d-30bf-4f9f-86ad-eb6656945648","Type":"ContainerStarted","Data":"a6bdc5ca4c95968a340b1dd44bed27b16590b9cce13cbf0f85ad21e057238a18"} Jul 14 15:12:40.160275 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:40.160249 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:40.165229 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:40.165206 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" Jul 14 15:12:40.188131 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:40.188081 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" podStartSLOduration=3.0609748469999998 podStartE2EDuration="7.188066619s" totalImagesPullingTime="4.127091772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:40.187136785 +0000 UTC m=+129.061798706" watchObservedRunningTime="2026-07-14 15:12:40.188066619 +0000 UTC m=+129.062728539" Jul 14 15:12:40.213230 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:40.213179 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cqtvv" podStartSLOduration=2.710896124 podStartE2EDuration="4.213163071s" totalImagesPullingTime="1.502266947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:40.212762464 +0000 UTC m=+129.087424409" watchObservedRunningTime="2026-07-14 15:12:40.213163071 +0000 UTC m=+129.087824991" Jul 14 15:12:41.415914 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:41.415880 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:12:41.418301 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:41.418270 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10fc53e3-505f-404c-a379-c96f6c1e0ef4-metrics-certs\") pod \"network-metrics-daemon-6qjr4\" (UID: \"10fc53e3-505f-404c-a379-c96f6c1e0ef4\") " pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:12:41.667525 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:41.667428 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pkcw\"" Jul 14 15:12:41.675131 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:41.675108 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qjr4" Jul 14 15:12:41.820593 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:41.820571 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qjr4"] Jul 14 15:12:41.822936 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:41.822906 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fc53e3_505f_404c_a379_c96f6c1e0ef4.slice/crio-4e418202d4b6530c25c80d3cb25efdefe22cc2d02b331b4137ae0da17271fd84 WatchSource:0}: Error finding container 4e418202d4b6530c25c80d3cb25efdefe22cc2d02b331b4137ae0da17271fd84: Status 404 returned error can't find the container with id 4e418202d4b6530c25c80d3cb25efdefe22cc2d02b331b4137ae0da17271fd84 Jul 14 15:12:42.168684 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.168641 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qjr4" event={"ID":"10fc53e3-505f-404c-a379-c96f6c1e0ef4","Type":"ContainerStarted","Data":"4e418202d4b6530c25c80d3cb25efdefe22cc2d02b331b4137ae0da17271fd84"} Jul 14 15:12:42.756770 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.756729 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8489d95878-qr5sz"] Jul 14 15:12:42.793958 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.793925 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d78cf4ccf-cwwxx"] Jul 14 15:12:42.799603 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.799573 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:42.812033 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.812005 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d78cf4ccf-cwwxx"] Jul 14 15:12:42.931864 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.931754 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-oauth-config\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:42.931864 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.931801 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-oauth-serving-cert\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:42.931864 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.931866 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-trusted-ca-bundle\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:42.932158 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.931890 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2xn\" (UniqueName: \"kubernetes.io/projected/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-kube-api-access-fx2xn\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:42.932158 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.931940 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-serving-cert\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:42.932158 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.931980 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-service-ca\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:42.932158 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:42.932026 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-config\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.032927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.032827 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-config\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.032927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.032868 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-oauth-config\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.032927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.032890 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-oauth-serving-cert\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.032927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.032930 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-trusted-ca-bundle\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.033220 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.032945 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2xn\" (UniqueName: \"kubernetes.io/projected/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-kube-api-access-fx2xn\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.033220 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.032976 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-serving-cert\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.033220 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.033000 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-service-ca\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.033874 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.033843 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-oauth-serving-cert\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.034002 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.033921 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-service-ca\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.034002 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.033932 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-trusted-ca-bundle\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.034002 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.033988 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-config\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.035292 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.035262 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-oauth-config\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.035548 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.035527 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-serving-cert\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.044166 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.044143 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2xn\" (UniqueName: \"kubernetes.io/projected/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-kube-api-access-fx2xn\") pod \"console-d78cf4ccf-cwwxx\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.110092 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.110054 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:43.269011 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:43.268965 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d78cf4ccf-cwwxx"] Jul 14 15:12:43.273500 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:12:43.273455 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e16a2b1_68e3_4e08_ba18_04dc9f76ef13.slice/crio-b8c5dd66556fb73fd88c4863a0fc0fa3eeff20e5a08974b3fc2e1b0ff74fa31d WatchSource:0}: Error finding container b8c5dd66556fb73fd88c4863a0fc0fa3eeff20e5a08974b3fc2e1b0ff74fa31d: Status 404 returned error can't find the container with id b8c5dd66556fb73fd88c4863a0fc0fa3eeff20e5a08974b3fc2e1b0ff74fa31d Jul 14 15:12:44.181909 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.181866 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d78cf4ccf-cwwxx" event={"ID":"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13","Type":"ContainerStarted","Data":"e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae"} Jul 14 15:12:44.182320 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.181919 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d78cf4ccf-cwwxx" event={"ID":"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13","Type":"ContainerStarted","Data":"b8c5dd66556fb73fd88c4863a0fc0fa3eeff20e5a08974b3fc2e1b0ff74fa31d"} Jul 14 15:12:44.199938 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.199891 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d78cf4ccf-cwwxx" podStartSLOduration=2.199878763 podStartE2EDuration="2.199878763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:44.199678744 +0000 UTC m=+133.074340666" watchObservedRunningTime="2026-07-14 15:12:44.199878763 +0000 UTC m=+133.074540684" Jul 14 15:12:44.591372 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.591286 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" podUID="ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" containerName="registry" containerID="cri-o://afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054" gracePeriod=30 Jul 14 15:12:44.848396 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.848335 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:12:44.950295 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950254 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-image-registry-private-configuration\") pod \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " Jul 14 15:12:44.950295 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950303 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-bound-sa-token\") pod \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " Jul 14 15:12:44.950524 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950323 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-certificates\") pod \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " Jul 14 15:12:44.950524 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950387 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") pod \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " Jul 14 15:12:44.950524 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950410 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-ca-trust-extracted\") pod \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " Jul 14 15:12:44.950524 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950438 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-trusted-ca\") pod \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " Jul 14 15:12:44.950524 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950466 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpqpw\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-kube-api-access-qpqpw\") pod \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " Jul 14 15:12:44.950524 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950519 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-installation-pull-secrets\") pod \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\" (UID: \"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07\") " Jul 14 15:12:44.950921 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950868 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:12:44.951016 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.950924 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:12:44.953008 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.952955 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:12:44.953116 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.953000 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:12:44.953189 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.953139 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:12:44.953257 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.953233 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:12:44.953357 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.953338 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-kube-api-access-qpqpw" (OuterVolumeSpecName: "kube-api-access-qpqpw") pod "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07"). InnerVolumeSpecName "kube-api-access-qpqpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:12:44.958946 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:44.958922 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" (UID: "ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:12:45.051969 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.051929 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpqpw\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-kube-api-access-qpqpw\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:45.051969 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.051965 2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-installation-pull-secrets\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:45.051969 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.051975 2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-image-registry-private-configuration\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:45.052187 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.051985 2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-bound-sa-token\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:45.052187 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.051995 2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-certificates\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:45.052187 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.052003 2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-registry-tls\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:45.052187 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.052013 2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-ca-trust-extracted\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:45.052187 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.052021 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07-trusted-ca\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:45.187125 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.187089 2585 generic.go:356] "Generic (PLEG): container finished" podID="ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" containerID="afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054" exitCode=0 Jul 14 15:12:45.187601 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.187125 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" event={"ID":"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07","Type":"ContainerDied","Data":"afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054"} Jul 14 15:12:45.187601 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.187149 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" Jul 14 15:12:45.187601 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.187188 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5557d8bc88-nkb57" event={"ID":"ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07","Type":"ContainerDied","Data":"1101f5ed571df511513821ffb3d09c8219b273ac2b5efdc0583193ca0cc4746c"} Jul 14 15:12:45.187601 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.187210 2585 scope.go:117] "RemoveContainer" containerID="afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054" Jul 14 15:12:45.195600 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.195580 2585 scope.go:117] "RemoveContainer" containerID="afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054" Jul 14 15:12:45.195871 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:12:45.195850 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054\": container with ID starting with afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054 not found: ID does not exist" containerID="afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054" Jul 14 15:12:45.195942 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.195879 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054"} err="failed to get container status \"afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054\": rpc error: code = NotFound desc = could not find container \"afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054\": container with ID starting with afe609280bdf0361394a6bade6adfa647c81ea21bbbea09ab3aa234ef9f2c054 not found: ID does not exist" Jul 14 15:12:45.209976 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.209950 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5557d8bc88-nkb57"] Jul 14 15:12:45.214831 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.214810 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5557d8bc88-nkb57"] Jul 14 15:12:45.650209 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:45.650129 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" path="/var/lib/kubelet/pods/ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07/volumes" Jul 14 15:12:46.172314 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:46.172285 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d9b574688-p69th" Jul 14 15:12:46.830728 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:46.830647 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:12:47.197882 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:47.197845 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qjr4" event={"ID":"10fc53e3-505f-404c-a379-c96f6c1e0ef4","Type":"ContainerStarted","Data":"90220084cfdbe6f1387989decb8b131f904e67ccf02a10cd7354abcf23ddefb2"} Jul 14 15:12:47.198064 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:47.197931 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qjr4" event={"ID":"10fc53e3-505f-404c-a379-c96f6c1e0ef4","Type":"ContainerStarted","Data":"0b42fe7fe52e7752c91a5b65a2c206ddbc63c57c212ecb2cd3d4d87d310d8e06"} Jul 14 15:12:47.282326 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:47.282273 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6qjr4" podStartSLOduration=131.717820285 podStartE2EDuration="2m16.282258951s" totalImagesPullingTime="4.564438666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:47.280068836 +0000 UTC m=+136.154730758" watchObservedRunningTime="2026-07-14 15:12:47.282258951 +0000 UTC m=+136.156920872" Jul 14 15:12:52.218209 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:52.218173 2585 generic.go:356] "Generic (PLEG): container finished" podID="fa0b72a7-399a-4de4-9383-3b1735d30641" containerID="c50fff29f40ff47f998557ef1ae0c31a3f99ddd566898992b33c74925bb10918" exitCode=0 Jul 14 15:12:52.218680 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:52.218246 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" event={"ID":"fa0b72a7-399a-4de4-9383-3b1735d30641","Type":"ContainerDied","Data":"c50fff29f40ff47f998557ef1ae0c31a3f99ddd566898992b33c74925bb10918"} Jul 14 15:12:52.218680 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:52.218657 2585 scope.go:117] "RemoveContainer" containerID="c50fff29f40ff47f998557ef1ae0c31a3f99ddd566898992b33c74925bb10918" Jul 14 15:12:53.077175 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:53.077146 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f6bcfb954-zx7cm_2b004017-332e-4387-9412-3a85c4fd503b/router/0.log" Jul 14 15:12:53.084390 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:53.084367 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6mltn_247a017f-af9c-4894-ac46-1eb4c984514c/serve-healthcheck-canary/0.log" Jul 14 15:12:53.110597 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:53.110566 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:53.110755 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:53.110626 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:53.115226 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:53.115205 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:53.224265 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:53.224231 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8g5z7" event={"ID":"fa0b72a7-399a-4de4-9383-3b1735d30641","Type":"ContainerStarted","Data":"f17305dc8e99127fcf752f34304bdc68c20468625721bc4bd1cb092eeed63edb"} Jul 14 15:12:53.228295 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:53.228273 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:12:59.133239 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.133191 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f8948cbdc-65t56" podUID="8045f4b2-bb38-439d-b1bf-af5440285794" containerName="console" containerID="cri-o://d57ab99802cc628de00774ae57c3758c5e47772fd657536714fb9d3cc4d4a8eb" gracePeriod=15 Jul 14 15:12:59.249195 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.249169 2585 generic.go:356] "Generic (PLEG): container finished" podID="8045f4b2-bb38-439d-b1bf-af5440285794" containerID="d57ab99802cc628de00774ae57c3758c5e47772fd657536714fb9d3cc4d4a8eb" exitCode=0 Jul 14 15:12:59.249303 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.249230 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8948cbdc-65t56" event={"ID":"8045f4b2-bb38-439d-b1bf-af5440285794","Type":"ContainerDied","Data":"d57ab99802cc628de00774ae57c3758c5e47772fd657536714fb9d3cc4d4a8eb"} Jul 14 15:12:59.372090 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.372058 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:12:59.478492 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.478451 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-service-ca\") pod \"8045f4b2-bb38-439d-b1bf-af5440285794\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " Jul 14 15:12:59.478680 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.478531 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-oauth-serving-cert\") pod \"8045f4b2-bb38-439d-b1bf-af5440285794\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " Jul 14 15:12:59.478680 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.478565 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-serving-cert\") pod \"8045f4b2-bb38-439d-b1bf-af5440285794\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " Jul 14 15:12:59.478680 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.478582 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vnrb\" (UniqueName: \"kubernetes.io/projected/8045f4b2-bb38-439d-b1bf-af5440285794-kube-api-access-9vnrb\") pod \"8045f4b2-bb38-439d-b1bf-af5440285794\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " Jul 14 15:12:59.478680 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.478611 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-oauth-config\") pod \"8045f4b2-bb38-439d-b1bf-af5440285794\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " Jul 14 15:12:59.479050 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.478698 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-console-config\") pod \"8045f4b2-bb38-439d-b1bf-af5440285794\" (UID: \"8045f4b2-bb38-439d-b1bf-af5440285794\") " Jul 14 15:12:59.479050 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.479002 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-service-ca" (OuterVolumeSpecName: "service-ca") pod "8045f4b2-bb38-439d-b1bf-af5440285794" (UID: "8045f4b2-bb38-439d-b1bf-af5440285794"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:12:59.479050 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.479028 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8045f4b2-bb38-439d-b1bf-af5440285794" (UID: "8045f4b2-bb38-439d-b1bf-af5440285794"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:12:59.479273 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.479113 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-console-config" (OuterVolumeSpecName: "console-config") pod "8045f4b2-bb38-439d-b1bf-af5440285794" (UID: "8045f4b2-bb38-439d-b1bf-af5440285794"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:12:59.479273 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.479223 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-oauth-serving-cert\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:59.479273 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.479236 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-console-config\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:59.479273 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.479244 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8045f4b2-bb38-439d-b1bf-af5440285794-service-ca\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:59.481018 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.480998 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8045f4b2-bb38-439d-b1bf-af5440285794" (UID: "8045f4b2-bb38-439d-b1bf-af5440285794"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:12:59.481226 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.481201 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8045f4b2-bb38-439d-b1bf-af5440285794" (UID: "8045f4b2-bb38-439d-b1bf-af5440285794"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:12:59.481226 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.481219 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8045f4b2-bb38-439d-b1bf-af5440285794-kube-api-access-9vnrb" (OuterVolumeSpecName: "kube-api-access-9vnrb") pod "8045f4b2-bb38-439d-b1bf-af5440285794" (UID: "8045f4b2-bb38-439d-b1bf-af5440285794"). InnerVolumeSpecName "kube-api-access-9vnrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:12:59.579730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.579686 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-serving-cert\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:59.579730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.579722 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vnrb\" (UniqueName: \"kubernetes.io/projected/8045f4b2-bb38-439d-b1bf-af5440285794-kube-api-access-9vnrb\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:12:59.579730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:12:59.579732 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8045f4b2-bb38-439d-b1bf-af5440285794-console-oauth-config\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:13:00.254591 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:00.254553 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8948cbdc-65t56" event={"ID":"8045f4b2-bb38-439d-b1bf-af5440285794","Type":"ContainerDied","Data":"03640b57927cd0624b733c781bd584132b54ff79ed2e3d41ff9edd02cbb9d508"} Jul 14 15:13:00.254591 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:00.254586 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8948cbdc-65t56" Jul 14 15:13:00.255027 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:00.254617 2585 scope.go:117] "RemoveContainer" containerID="d57ab99802cc628de00774ae57c3758c5e47772fd657536714fb9d3cc4d4a8eb" Jul 14 15:13:00.271244 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:00.271216 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8948cbdc-65t56"] Jul 14 15:13:00.276325 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:00.276293 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f8948cbdc-65t56"] Jul 14 15:13:01.650140 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:01.650104 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8045f4b2-bb38-439d-b1bf-af5440285794" path="/var/lib/kubelet/pods/8045f4b2-bb38-439d-b1bf-af5440285794/volumes" Jul 14 15:13:07.778752 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:07.778685 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8489d95878-qr5sz" podUID="e967b1ac-87c3-4595-943e-4270366f4dfe" containerName="console" containerID="cri-o://c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8" gracePeriod=15 Jul 14 15:13:08.019644 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.019618 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:13:08.149434 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.149346 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtbbb\" (UniqueName: \"kubernetes.io/projected/e967b1ac-87c3-4595-943e-4270366f4dfe-kube-api-access-xtbbb\") pod \"e967b1ac-87c3-4595-943e-4270366f4dfe\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " Jul 14 15:13:08.149434 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.149392 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-oauth-serving-cert\") pod \"e967b1ac-87c3-4595-943e-4270366f4dfe\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " Jul 14 15:13:08.149434 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.149416 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-serving-cert\") pod \"e967b1ac-87c3-4595-943e-4270366f4dfe\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " Jul 14 15:13:08.149727 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.149444 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-oauth-config\") pod \"e967b1ac-87c3-4595-943e-4270366f4dfe\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " Jul 14 15:13:08.149727 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.149522 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-console-config\") pod \"e967b1ac-87c3-4595-943e-4270366f4dfe\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " Jul 14 15:13:08.149727 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.149548 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-trusted-ca-bundle\") pod \"e967b1ac-87c3-4595-943e-4270366f4dfe\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " Jul 14 15:13:08.149727 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.149597 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-service-ca\") pod \"e967b1ac-87c3-4595-943e-4270366f4dfe\" (UID: \"e967b1ac-87c3-4595-943e-4270366f4dfe\") " Jul 14 15:13:08.149927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.149896 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e967b1ac-87c3-4595-943e-4270366f4dfe" (UID: "e967b1ac-87c3-4595-943e-4270366f4dfe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:13:08.150072 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.150042 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-console-config" (OuterVolumeSpecName: "console-config") pod "e967b1ac-87c3-4595-943e-4270366f4dfe" (UID: "e967b1ac-87c3-4595-943e-4270366f4dfe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:13:08.150159 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.150073 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e967b1ac-87c3-4595-943e-4270366f4dfe" (UID: "e967b1ac-87c3-4595-943e-4270366f4dfe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:13:08.150159 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.150115 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-service-ca" (OuterVolumeSpecName: "service-ca") pod "e967b1ac-87c3-4595-943e-4270366f4dfe" (UID: "e967b1ac-87c3-4595-943e-4270366f4dfe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:13:08.151643 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.151615 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e967b1ac-87c3-4595-943e-4270366f4dfe" (UID: "e967b1ac-87c3-4595-943e-4270366f4dfe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:13:08.151643 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.151632 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e967b1ac-87c3-4595-943e-4270366f4dfe" (UID: "e967b1ac-87c3-4595-943e-4270366f4dfe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:13:08.151643 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.151633 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e967b1ac-87c3-4595-943e-4270366f4dfe-kube-api-access-xtbbb" (OuterVolumeSpecName: "kube-api-access-xtbbb") pod "e967b1ac-87c3-4595-943e-4270366f4dfe" (UID: "e967b1ac-87c3-4595-943e-4270366f4dfe"). InnerVolumeSpecName "kube-api-access-xtbbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:13:08.250340 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.250308 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-service-ca\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:13:08.250340 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.250336 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtbbb\" (UniqueName: \"kubernetes.io/projected/e967b1ac-87c3-4595-943e-4270366f4dfe-kube-api-access-xtbbb\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:13:08.250340 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.250345 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-oauth-serving-cert\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:13:08.250598 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.250355 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-serving-cert\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:13:08.250598 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.250364 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e967b1ac-87c3-4595-943e-4270366f4dfe-console-oauth-config\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:13:08.250598 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.250372 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-console-config\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:13:08.250598 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.250381 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967b1ac-87c3-4595-943e-4270366f4dfe-trusted-ca-bundle\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:13:08.287717 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.287681 2585 generic.go:356] "Generic (PLEG): container finished" podID="e967b1ac-87c3-4595-943e-4270366f4dfe" containerID="c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8" exitCode=0 Jul 14 15:13:08.287717 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.287720 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8489d95878-qr5sz" event={"ID":"e967b1ac-87c3-4595-943e-4270366f4dfe","Type":"ContainerDied","Data":"c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8"} Jul 14 15:13:08.287921 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.287725 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8489d95878-qr5sz" Jul 14 15:13:08.287921 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.287763 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8489d95878-qr5sz" event={"ID":"e967b1ac-87c3-4595-943e-4270366f4dfe","Type":"ContainerDied","Data":"2acafb16cc7d83d2426b29546bf237b8271cc07bec3755bc0b56e148e15be40a"} Jul 14 15:13:08.287921 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.287784 2585 scope.go:117] "RemoveContainer" containerID="c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8" Jul 14 15:13:08.296408 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.296390 2585 scope.go:117] "RemoveContainer" containerID="c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8" Jul 14 15:13:08.296678 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:13:08.296660 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8\": container with ID starting with c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8 not found: ID does not exist" containerID="c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8" Jul 14 15:13:08.296729 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.296685 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8"} err="failed to get container status \"c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8\": rpc error: code = NotFound desc = could not find container \"c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8\": container with ID starting with c45fed2301643be3a8c9a4cb90d73f861c389bc7649f6845686aa55e599a7dc8 not found: ID does not exist" Jul 14 15:13:08.308948 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.308920 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8489d95878-qr5sz"] Jul 14 15:13:08.310775 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:08.310752 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8489d95878-qr5sz"] Jul 14 15:13:09.649890 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:13:09.649856 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e967b1ac-87c3-4595-943e-4270366f4dfe" path="/var/lib/kubelet/pods/e967b1ac-87c3-4595-943e-4270366f4dfe/volumes" Jul 14 15:14:00.041447 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:00.041410 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d78cf4ccf-cwwxx"] Jul 14 15:14:25.063929 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.063883 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d78cf4ccf-cwwxx" podUID="9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" containerName="console" containerID="cri-o://e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae" gracePeriod=15 Jul 14 15:14:25.311376 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.311346 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:14:25.468192 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468160 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-config\") pod \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " Jul 14 15:14:25.468396 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468224 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-oauth-config\") pod \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " Jul 14 15:14:25.468396 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468254 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-trusted-ca-bundle\") pod \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " Jul 14 15:14:25.468396 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468281 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-oauth-serving-cert\") pod \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " Jul 14 15:14:25.468396 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468304 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx2xn\" (UniqueName: \"kubernetes.io/projected/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-kube-api-access-fx2xn\") pod \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " Jul 14 15:14:25.468396 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468327 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-serving-cert\") pod \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " Jul 14 15:14:25.468677 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468550 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-service-ca\") pod \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\" (UID: \"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13\") " Jul 14 15:14:25.468732 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468667 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-config" (OuterVolumeSpecName: "console-config") pod "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" (UID: "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:14:25.468732 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468725 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" (UID: "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:14:25.468825 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468734 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" (UID: "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:14:25.468968 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468948 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-config\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:14:25.469005 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468972 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" (UID: "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:14:25.469005 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.468976 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-trusted-ca-bundle\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:14:25.469066 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.469005 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-oauth-serving-cert\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:14:25.470470 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.470445 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" (UID: "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:14:25.471007 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.470991 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" (UID: "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:14:25.471064 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.471039 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-kube-api-access-fx2xn" (OuterVolumeSpecName: "kube-api-access-fx2xn") pod "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" (UID: "9e16a2b1-68e3-4e08-ba18-04dc9f76ef13"). InnerVolumeSpecName "kube-api-access-fx2xn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:14:25.568749 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.568711 2585 generic.go:356] "Generic (PLEG): container finished" podID="9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" containerID="e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae" exitCode=0 Jul 14 15:14:25.568934 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.568768 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d78cf4ccf-cwwxx" Jul 14 15:14:25.568934 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.568790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d78cf4ccf-cwwxx" event={"ID":"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13","Type":"ContainerDied","Data":"e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae"} Jul 14 15:14:25.568934 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.568839 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d78cf4ccf-cwwxx" event={"ID":"9e16a2b1-68e3-4e08-ba18-04dc9f76ef13","Type":"ContainerDied","Data":"b8c5dd66556fb73fd88c4863a0fc0fa3eeff20e5a08974b3fc2e1b0ff74fa31d"} Jul 14 15:14:25.568934 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.568862 2585 scope.go:117] "RemoveContainer" containerID="e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae" Jul 14 15:14:25.569346 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.569324 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-oauth-config\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:14:25.569346 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.569343 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx2xn\" (UniqueName: \"kubernetes.io/projected/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-kube-api-access-fx2xn\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:14:25.569548 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.569353 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-console-serving-cert\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:14:25.569548 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.569362 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13-service-ca\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:14:25.577455 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.577439 2585 scope.go:117] "RemoveContainer" containerID="e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae" Jul 14 15:14:25.577756 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:14:25.577736 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae\": container with ID starting with e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae not found: ID does not exist" containerID="e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae" Jul 14 15:14:25.577820 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.577769 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae"} err="failed to get container status \"e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae\": rpc error: code = NotFound desc = could not find container \"e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae\": container with ID starting with e44a23fb11f359f0d79a4579d2adb41104aed11ee88bcb5a7135a063e4b5e9ae not found: ID does not exist" Jul 14 15:14:25.595204 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.595170 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d78cf4ccf-cwwxx"] Jul 14 15:14:25.601192 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.601168 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d78cf4ccf-cwwxx"] Jul 14 15:14:25.649704 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:25.649667 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" path="/var/lib/kubelet/pods/9e16a2b1-68e3-4e08-ba18-04dc9f76ef13/volumes" Jul 14 15:14:45.244142 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244104 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj"] Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244383 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e967b1ac-87c3-4595-943e-4270366f4dfe" containerName="console" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244393 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e967b1ac-87c3-4595-943e-4270366f4dfe" containerName="console" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244407 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" containerName="registry" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244413 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" containerName="registry" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244419 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" containerName="console" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244425 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" containerName="console" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244432 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8045f4b2-bb38-439d-b1bf-af5440285794" containerName="console" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244437 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8045f4b2-bb38-439d-b1bf-af5440285794" containerName="console" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244496 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e16a2b1-68e3-4e08-ba18-04dc9f76ef13" containerName="console" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244505 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8045f4b2-bb38-439d-b1bf-af5440285794" containerName="console" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244513 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecc48fd8-7a4a-4e46-93f6-c5a2484dfc07" containerName="registry" Jul 14 15:14:45.244637 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.244518 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e967b1ac-87c3-4595-943e-4270366f4dfe" containerName="console" Jul 14 15:14:45.248782 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.248764 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.253528 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.253506 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 15:14:45.254298 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.254275 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 15:14:45.254407 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.254275 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xh5vb\"" Jul 14 15:14:45.265020 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.264997 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj"] Jul 14 15:14:45.321381 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.321345 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.321607 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.321407 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44cbx\" (UniqueName: \"kubernetes.io/projected/94e8fe31-3a85-41d4-8406-cbd63840fa4f-kube-api-access-44cbx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.321607 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.321526 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.422273 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.422229 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.422439 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.422284 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.422507 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.422459 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44cbx\" (UniqueName: \"kubernetes.io/projected/94e8fe31-3a85-41d4-8406-cbd63840fa4f-kube-api-access-44cbx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.422643 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.422629 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.422687 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.422670 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.432069 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.432042 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44cbx\" (UniqueName: \"kubernetes.io/projected/94e8fe31-3a85-41d4-8406-cbd63840fa4f-kube-api-access-44cbx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.558022 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.557918 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:14:45.697941 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:45.697910 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj"] Jul 14 15:14:45.700208 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:14:45.700175 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e8fe31_3a85_41d4_8406_cbd63840fa4f.slice/crio-9e9969b0c047ef1aef068b6c1b5e32eb7a8db1db2ac58227733fb333e421491f WatchSource:0}: Error finding container 9e9969b0c047ef1aef068b6c1b5e32eb7a8db1db2ac58227733fb333e421491f: Status 404 returned error can't find the container with id 9e9969b0c047ef1aef068b6c1b5e32eb7a8db1db2ac58227733fb333e421491f Jul 14 15:14:46.662170 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:46.662128 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" event={"ID":"94e8fe31-3a85-41d4-8406-cbd63840fa4f","Type":"ContainerStarted","Data":"9e9969b0c047ef1aef068b6c1b5e32eb7a8db1db2ac58227733fb333e421491f"} Jul 14 15:14:55.697779 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:55.697746 2585 generic.go:356] "Generic (PLEG): container finished" podID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerID="fe8d7b855bf19365ef2b4fcec7293b9fb681d739d1b10e9f1c375a858ca2cff1" exitCode=0 Jul 14 15:14:55.698206 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:55.697784 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" event={"ID":"94e8fe31-3a85-41d4-8406-cbd63840fa4f","Type":"ContainerDied","Data":"fe8d7b855bf19365ef2b4fcec7293b9fb681d739d1b10e9f1c375a858ca2cff1"} Jul 14 15:14:57.711422 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:57.711380 2585 generic.go:356] "Generic (PLEG): container finished" podID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerID="76985bff6f20664a0611cab17c4e650cdbdc8436d0b85de1128d6beff2e4394d" exitCode=0 Jul 14 15:14:57.711819 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:14:57.711458 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" event={"ID":"94e8fe31-3a85-41d4-8406-cbd63840fa4f","Type":"ContainerDied","Data":"76985bff6f20664a0611cab17c4e650cdbdc8436d0b85de1128d6beff2e4394d"} Jul 14 15:15:07.755645 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:07.755554 2585 generic.go:356] "Generic (PLEG): container finished" podID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerID="71f813ab72de7a3ee1abf5284ba75a5bd83a3a54962312715901382d35d8fde1" exitCode=0 Jul 14 15:15:07.755978 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:07.755635 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" event={"ID":"94e8fe31-3a85-41d4-8406-cbd63840fa4f","Type":"ContainerDied","Data":"71f813ab72de7a3ee1abf5284ba75a5bd83a3a54962312715901382d35d8fde1"} Jul 14 15:15:08.907058 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:08.907023 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:15:09.007629 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.007593 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-bundle\") pod \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " Jul 14 15:15:09.007829 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.007693 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44cbx\" (UniqueName: \"kubernetes.io/projected/94e8fe31-3a85-41d4-8406-cbd63840fa4f-kube-api-access-44cbx\") pod \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " Jul 14 15:15:09.007829 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.007718 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-util\") pod \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\" (UID: \"94e8fe31-3a85-41d4-8406-cbd63840fa4f\") " Jul 14 15:15:09.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.008297 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-bundle" (OuterVolumeSpecName: "bundle") pod "94e8fe31-3a85-41d4-8406-cbd63840fa4f" (UID: "94e8fe31-3a85-41d4-8406-cbd63840fa4f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:15:09.009950 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.009895 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e8fe31-3a85-41d4-8406-cbd63840fa4f-kube-api-access-44cbx" (OuterVolumeSpecName: "kube-api-access-44cbx") pod "94e8fe31-3a85-41d4-8406-cbd63840fa4f" (UID: "94e8fe31-3a85-41d4-8406-cbd63840fa4f"). InnerVolumeSpecName "kube-api-access-44cbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:15:09.013924 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.013899 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-util" (OuterVolumeSpecName: "util") pod "94e8fe31-3a85-41d4-8406-cbd63840fa4f" (UID: "94e8fe31-3a85-41d4-8406-cbd63840fa4f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:15:09.108780 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.108744 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44cbx\" (UniqueName: \"kubernetes.io/projected/94e8fe31-3a85-41d4-8406-cbd63840fa4f-kube-api-access-44cbx\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:15:09.108780 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.108774 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-util\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:15:09.108780 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.108785 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94e8fe31-3a85-41d4-8406-cbd63840fa4f-bundle\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:15:09.764565 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.764529 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" event={"ID":"94e8fe31-3a85-41d4-8406-cbd63840fa4f","Type":"ContainerDied","Data":"9e9969b0c047ef1aef068b6c1b5e32eb7a8db1db2ac58227733fb333e421491f"} Jul 14 15:15:09.764761 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.764587 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e9969b0c047ef1aef068b6c1b5e32eb7a8db1db2ac58227733fb333e421491f" Jul 14 15:15:09.764761 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:09.764545 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m67dj" Jul 14 15:15:18.173086 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.173048 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z"] Jul 14 15:15:18.173579 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.173356 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerName="pull" Jul 14 15:15:18.173579 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.173368 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerName="pull" Jul 14 15:15:18.173579 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.173376 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerName="util" Jul 14 15:15:18.173579 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.173381 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerName="util" Jul 14 15:15:18.173579 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.173391 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerName="extract" Jul 14 15:15:18.173579 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.173397 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerName="extract" Jul 14 15:15:18.173579 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.173445 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="94e8fe31-3a85-41d4-8406-cbd63840fa4f" containerName="extract" Jul 14 15:15:18.176070 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.176051 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.178837 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.178816 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 15:15:18.179081 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.179067 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 15:15:18.179864 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.179848 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xh5vb\"" Jul 14 15:15:18.193365 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.193335 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z"] Jul 14 15:15:18.282635 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.282592 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.282635 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.282643 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rmf8\" (UniqueName: \"kubernetes.io/projected/9b65b425-5c94-4457-a99b-cd6e590c3a7a-kube-api-access-4rmf8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.282856 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.282714 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.383730 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.383690 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.383852 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.383799 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.383852 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.383836 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rmf8\" (UniqueName: \"kubernetes.io/projected/9b65b425-5c94-4457-a99b-cd6e590c3a7a-kube-api-access-4rmf8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.384156 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.384134 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.384202 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.384143 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.397210 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.397180 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rmf8\" (UniqueName: \"kubernetes.io/projected/9b65b425-5c94-4457-a99b-cd6e590c3a7a-kube-api-access-4rmf8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.484498 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.484451 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:18.626278 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.626247 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z"] Jul 14 15:15:18.628815 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:15:18.628789 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b65b425_5c94_4457_a99b_cd6e590c3a7a.slice/crio-d11228b2a065c3ff5563ebcf62dd0a3d16091e659602a15dbdc54ea4a28a7d8a WatchSource:0}: Error finding container d11228b2a065c3ff5563ebcf62dd0a3d16091e659602a15dbdc54ea4a28a7d8a: Status 404 returned error can't find the container with id d11228b2a065c3ff5563ebcf62dd0a3d16091e659602a15dbdc54ea4a28a7d8a Jul 14 15:15:18.797567 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.797460 2585 generic.go:356] "Generic (PLEG): container finished" podID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerID="195b38e56d1927e53f447ebf7dc0175a7e64882af04e4233b0552f3a07f6ba40" exitCode=0 Jul 14 15:15:18.797733 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.797553 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" event={"ID":"9b65b425-5c94-4457-a99b-cd6e590c3a7a","Type":"ContainerDied","Data":"195b38e56d1927e53f447ebf7dc0175a7e64882af04e4233b0552f3a07f6ba40"} Jul 14 15:15:18.797733 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:18.797616 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" event={"ID":"9b65b425-5c94-4457-a99b-cd6e590c3a7a","Type":"ContainerStarted","Data":"d11228b2a065c3ff5563ebcf62dd0a3d16091e659602a15dbdc54ea4a28a7d8a"} Jul 14 15:15:21.811557 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:21.811518 2585 generic.go:356] "Generic (PLEG): container finished" podID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerID="a07e72194986a47800a80fd9e1f215204d940eb3039102a636cec77b65349afe" exitCode=0 Jul 14 15:15:21.812002 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:21.811602 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" event={"ID":"9b65b425-5c94-4457-a99b-cd6e590c3a7a","Type":"ContainerDied","Data":"a07e72194986a47800a80fd9e1f215204d940eb3039102a636cec77b65349afe"} Jul 14 15:15:22.817304 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:22.817268 2585 generic.go:356] "Generic (PLEG): container finished" podID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerID="e586781fd09870df623a5c1e7c20b1e672c001383c141f3bc66ff85f6154bf7e" exitCode=0 Jul 14 15:15:22.817693 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:22.817310 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" event={"ID":"9b65b425-5c94-4457-a99b-cd6e590c3a7a","Type":"ContainerDied","Data":"e586781fd09870df623a5c1e7c20b1e672c001383c141f3bc66ff85f6154bf7e"} Jul 14 15:15:23.944472 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:23.944445 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:24.030150 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.030091 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-bundle\") pod \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " Jul 14 15:15:24.030150 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.030157 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rmf8\" (UniqueName: \"kubernetes.io/projected/9b65b425-5c94-4457-a99b-cd6e590c3a7a-kube-api-access-4rmf8\") pod \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " Jul 14 15:15:24.030411 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.030244 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-util\") pod \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\" (UID: \"9b65b425-5c94-4457-a99b-cd6e590c3a7a\") " Jul 14 15:15:24.030609 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.030585 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-bundle" (OuterVolumeSpecName: "bundle") pod "9b65b425-5c94-4457-a99b-cd6e590c3a7a" (UID: "9b65b425-5c94-4457-a99b-cd6e590c3a7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:15:24.032325 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.032302 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b65b425-5c94-4457-a99b-cd6e590c3a7a-kube-api-access-4rmf8" (OuterVolumeSpecName: "kube-api-access-4rmf8") pod "9b65b425-5c94-4457-a99b-cd6e590c3a7a" (UID: "9b65b425-5c94-4457-a99b-cd6e590c3a7a"). InnerVolumeSpecName "kube-api-access-4rmf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:15:24.035210 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.035188 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-util" (OuterVolumeSpecName: "util") pod "9b65b425-5c94-4457-a99b-cd6e590c3a7a" (UID: "9b65b425-5c94-4457-a99b-cd6e590c3a7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:15:24.131534 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.131411 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-util\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:15:24.131534 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.131455 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b65b425-5c94-4457-a99b-cd6e590c3a7a-bundle\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:15:24.131534 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.131466 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rmf8\" (UniqueName: \"kubernetes.io/projected/9b65b425-5c94-4457-a99b-cd6e590c3a7a-kube-api-access-4rmf8\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:15:24.355042 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.354976 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5"] Jul 14 15:15:24.355316 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.355305 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerName="util" Jul 14 15:15:24.355357 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.355317 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerName="util" Jul 14 15:15:24.355357 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.355337 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerName="extract" Jul 14 15:15:24.355357 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.355342 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerName="extract" Jul 14 15:15:24.355357 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.355350 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerName="pull" Jul 14 15:15:24.355357 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.355356 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerName="pull" Jul 14 15:15:24.355545 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.355394 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b65b425-5c94-4457-a99b-cd6e590c3a7a" containerName="extract" Jul 14 15:15:24.358173 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.358157 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" Jul 14 15:15:24.360862 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.360839 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-whmrh\"" Jul 14 15:15:24.360973 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.360839 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 15:15:24.361035 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.361017 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 15:15:24.367057 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.367027 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5"] Jul 14 15:15:24.434475 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.434441 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56da8ee5-f791-472c-b3e5-e85b15c705ed-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fsbj5\" (UID: \"56da8ee5-f791-472c-b3e5-e85b15c705ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" Jul 14 15:15:24.434669 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.434523 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z56n2\" (UniqueName: \"kubernetes.io/projected/56da8ee5-f791-472c-b3e5-e85b15c705ed-kube-api-access-z56n2\") pod \"cert-manager-cainjector-559cdd8c87-fsbj5\" (UID: \"56da8ee5-f791-472c-b3e5-e85b15c705ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" Jul 14 15:15:24.535620 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.535589 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z56n2\" (UniqueName: \"kubernetes.io/projected/56da8ee5-f791-472c-b3e5-e85b15c705ed-kube-api-access-z56n2\") pod \"cert-manager-cainjector-559cdd8c87-fsbj5\" (UID: \"56da8ee5-f791-472c-b3e5-e85b15c705ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" Jul 14 15:15:24.535744 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.535679 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56da8ee5-f791-472c-b3e5-e85b15c705ed-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fsbj5\" (UID: \"56da8ee5-f791-472c-b3e5-e85b15c705ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" Jul 14 15:15:24.543814 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.543785 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56da8ee5-f791-472c-b3e5-e85b15c705ed-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fsbj5\" (UID: \"56da8ee5-f791-472c-b3e5-e85b15c705ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" Jul 14 15:15:24.543919 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.543866 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z56n2\" (UniqueName: \"kubernetes.io/projected/56da8ee5-f791-472c-b3e5-e85b15c705ed-kube-api-access-z56n2\") pod \"cert-manager-cainjector-559cdd8c87-fsbj5\" (UID: \"56da8ee5-f791-472c-b3e5-e85b15c705ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" Jul 14 15:15:24.676237 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.676181 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" Jul 14 15:15:24.810172 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.810143 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5"] Jul 14 15:15:24.810562 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:15:24.810540 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56da8ee5_f791_472c_b3e5_e85b15c705ed.slice/crio-756b272642396797add3b17ef9a6ec0a22cfa67c2034d91f30dfc2d25633c1f9 WatchSource:0}: Error finding container 756b272642396797add3b17ef9a6ec0a22cfa67c2034d91f30dfc2d25633c1f9: Status 404 returned error can't find the container with id 756b272642396797add3b17ef9a6ec0a22cfa67c2034d91f30dfc2d25633c1f9 Jul 14 15:15:24.826290 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.826264 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" event={"ID":"56da8ee5-f791-472c-b3e5-e85b15c705ed","Type":"ContainerStarted","Data":"756b272642396797add3b17ef9a6ec0a22cfa67c2034d91f30dfc2d25633c1f9"} Jul 14 15:15:24.827927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.827903 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" event={"ID":"9b65b425-5c94-4457-a99b-cd6e590c3a7a","Type":"ContainerDied","Data":"d11228b2a065c3ff5563ebcf62dd0a3d16091e659602a15dbdc54ea4a28a7d8a"} Jul 14 15:15:24.828025 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.827943 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d11228b2a065c3ff5563ebcf62dd0a3d16091e659602a15dbdc54ea4a28a7d8a" Jul 14 15:15:24.828025 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:24.827941 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgzv4z" Jul 14 15:15:28.063250 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.063213 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wzmjc"] Jul 14 15:15:28.066648 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.066624 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wzmjc" Jul 14 15:15:28.069135 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.069113 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wc2pm\"" Jul 14 15:15:28.074798 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.074773 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wzmjc"] Jul 14 15:15:28.167633 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.167540 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a1809ca-5889-4b4f-8542-3d173112f123-bound-sa-token\") pod \"cert-manager-55b4d954d5-wzmjc\" (UID: \"6a1809ca-5889-4b4f-8542-3d173112f123\") " pod="cert-manager/cert-manager-55b4d954d5-wzmjc" Jul 14 15:15:28.167633 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.167583 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4wqf\" (UniqueName: \"kubernetes.io/projected/6a1809ca-5889-4b4f-8542-3d173112f123-kube-api-access-j4wqf\") pod \"cert-manager-55b4d954d5-wzmjc\" (UID: \"6a1809ca-5889-4b4f-8542-3d173112f123\") " pod="cert-manager/cert-manager-55b4d954d5-wzmjc" Jul 14 15:15:28.268018 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.267981 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a1809ca-5889-4b4f-8542-3d173112f123-bound-sa-token\") pod \"cert-manager-55b4d954d5-wzmjc\" (UID: \"6a1809ca-5889-4b4f-8542-3d173112f123\") " pod="cert-manager/cert-manager-55b4d954d5-wzmjc" Jul 14 15:15:28.268183 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.268027 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4wqf\" (UniqueName: \"kubernetes.io/projected/6a1809ca-5889-4b4f-8542-3d173112f123-kube-api-access-j4wqf\") pod \"cert-manager-55b4d954d5-wzmjc\" (UID: \"6a1809ca-5889-4b4f-8542-3d173112f123\") " pod="cert-manager/cert-manager-55b4d954d5-wzmjc" Jul 14 15:15:28.276451 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.276424 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a1809ca-5889-4b4f-8542-3d173112f123-bound-sa-token\") pod \"cert-manager-55b4d954d5-wzmjc\" (UID: \"6a1809ca-5889-4b4f-8542-3d173112f123\") " pod="cert-manager/cert-manager-55b4d954d5-wzmjc" Jul 14 15:15:28.276601 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.276508 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4wqf\" (UniqueName: \"kubernetes.io/projected/6a1809ca-5889-4b4f-8542-3d173112f123-kube-api-access-j4wqf\") pod \"cert-manager-55b4d954d5-wzmjc\" (UID: \"6a1809ca-5889-4b4f-8542-3d173112f123\") " pod="cert-manager/cert-manager-55b4d954d5-wzmjc" Jul 14 15:15:28.376499 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.376446 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wzmjc" Jul 14 15:15:28.515903 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.515875 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wzmjc"] Jul 14 15:15:28.518121 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:15:28.518093 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a1809ca_5889_4b4f_8542_3d173112f123.slice/crio-79a9d836ce954103045c23c5e34014bf835ed2accf3c076d5d5105fdced4b2d6 WatchSource:0}: Error finding container 79a9d836ce954103045c23c5e34014bf835ed2accf3c076d5d5105fdced4b2d6: Status 404 returned error can't find the container with id 79a9d836ce954103045c23c5e34014bf835ed2accf3c076d5d5105fdced4b2d6 Jul 14 15:15:28.845065 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.844979 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" event={"ID":"56da8ee5-f791-472c-b3e5-e85b15c705ed","Type":"ContainerStarted","Data":"a2b2e647d23243a5345da854ce8baf910a6ee3de41cf3bdea5d7b2b77bc26ee0"} Jul 14 15:15:28.846571 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.846546 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wzmjc" event={"ID":"6a1809ca-5889-4b4f-8542-3d173112f123","Type":"ContainerStarted","Data":"b4ff554ad8d0ee928a5e80ca7e1990a715ebe849947dcf68aabb2975789d9249"} Jul 14 15:15:28.846684 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.846577 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wzmjc" event={"ID":"6a1809ca-5889-4b4f-8542-3d173112f123","Type":"ContainerStarted","Data":"79a9d836ce954103045c23c5e34014bf835ed2accf3c076d5d5105fdced4b2d6"} Jul 14 15:15:28.861860 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.861797 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fsbj5" podStartSLOduration=1.779249513 podStartE2EDuration="4.861778471s" totalImagesPullingTime="3.082528958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:15:28.859586037 +0000 UTC m=+297.734247962" watchObservedRunningTime="2026-07-14 15:15:28.861778471 +0000 UTC m=+297.736440397" Jul 14 15:15:28.880251 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:28.880178 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wzmjc" podStartSLOduration=0.88015842 podStartE2EDuration="880.15842ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:15:28.879218373 +0000 UTC m=+297.753880287" watchObservedRunningTime="2026-07-14 15:15:28.88015842 +0000 UTC m=+297.754820342" Jul 14 15:15:31.530199 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:31.530169 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:15:31.530687 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:31.530243 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:15:31.536249 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:31.536231 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 15:15:34.852822 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:34.852787 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx"] Jul 14 15:15:34.856113 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:34.856097 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" Jul 14 15:15:34.859393 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:34.859366 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 15:15:34.859393 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:34.859373 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:15:34.860168 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:34.860151 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jdh2j\"" Jul 14 15:15:34.866561 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:34.866539 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx"] Jul 14 15:15:35.022288 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.022251 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b599a67-7648-4c20-8306-1170caaed7e6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkqnx\" (UID: \"7b599a67-7648-4c20-8306-1170caaed7e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" Jul 14 15:15:35.022453 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.022311 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm47c\" (UniqueName: \"kubernetes.io/projected/7b599a67-7648-4c20-8306-1170caaed7e6-kube-api-access-nm47c\") pod \"openshift-lws-operator-fd8ccff4c-pkqnx\" (UID: \"7b599a67-7648-4c20-8306-1170caaed7e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" Jul 14 15:15:35.123331 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.123238 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b599a67-7648-4c20-8306-1170caaed7e6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkqnx\" (UID: \"7b599a67-7648-4c20-8306-1170caaed7e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" Jul 14 15:15:35.123526 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.123391 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm47c\" (UniqueName: \"kubernetes.io/projected/7b599a67-7648-4c20-8306-1170caaed7e6-kube-api-access-nm47c\") pod \"openshift-lws-operator-fd8ccff4c-pkqnx\" (UID: \"7b599a67-7648-4c20-8306-1170caaed7e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" Jul 14 15:15:35.123659 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.123635 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b599a67-7648-4c20-8306-1170caaed7e6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkqnx\" (UID: \"7b599a67-7648-4c20-8306-1170caaed7e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" Jul 14 15:15:35.132999 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.132972 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm47c\" (UniqueName: \"kubernetes.io/projected/7b599a67-7648-4c20-8306-1170caaed7e6-kube-api-access-nm47c\") pod \"openshift-lws-operator-fd8ccff4c-pkqnx\" (UID: \"7b599a67-7648-4c20-8306-1170caaed7e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" Jul 14 15:15:35.164739 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.164714 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" Jul 14 15:15:35.291092 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.291057 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx"] Jul 14 15:15:35.294969 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:15:35.294940 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b599a67_7648_4c20_8306_1170caaed7e6.slice/crio-6ca8c01f77f9f36664f382cafefd53a26b0fadc80439f62b494eba6808fa2456 WatchSource:0}: Error finding container 6ca8c01f77f9f36664f382cafefd53a26b0fadc80439f62b494eba6808fa2456: Status 404 returned error can't find the container with id 6ca8c01f77f9f36664f382cafefd53a26b0fadc80439f62b494eba6808fa2456 Jul 14 15:15:35.296371 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.296351 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 15:15:35.876236 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:35.876201 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" event={"ID":"7b599a67-7648-4c20-8306-1170caaed7e6","Type":"ContainerStarted","Data":"6ca8c01f77f9f36664f382cafefd53a26b0fadc80439f62b494eba6808fa2456"} Jul 14 15:15:37.891556 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:37.891520 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" event={"ID":"7b599a67-7648-4c20-8306-1170caaed7e6","Type":"ContainerStarted","Data":"7e2ae917ddc8a670e0edd9ade94384b9b693f81d742560132f4c4d09ab932651"} Jul 14 15:15:37.912410 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:37.912359 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkqnx" podStartSLOduration=2.138059858 podStartE2EDuration="3.912345635s" totalImagesPullingTime="1.774285777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:15:37.910696619 +0000 UTC m=+306.785358539" watchObservedRunningTime="2026-07-14 15:15:37.912345635 +0000 UTC m=+306.787007555" Jul 14 15:15:41.521067 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.521030 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475"] Jul 14 15:15:41.523426 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.523407 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.525776 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.525755 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 15:15:41.526842 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.526825 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 15:15:41.526842 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.526833 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xh5vb\"" Jul 14 15:15:41.532861 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.532837 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475"] Jul 14 15:15:41.675051 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.675022 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9m65\" (UniqueName: \"kubernetes.io/projected/de23efa5-682a-4f6e-b7ac-6798ca13e298-kube-api-access-h9m65\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.675242 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.675137 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.675242 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.675191 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.775781 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.775705 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.775781 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.775746 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.775781 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.775779 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9m65\" (UniqueName: \"kubernetes.io/projected/de23efa5-682a-4f6e-b7ac-6798ca13e298-kube-api-access-h9m65\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.776120 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.776100 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.776194 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.776175 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.785683 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.785661 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9m65\" (UniqueName: \"kubernetes.io/projected/de23efa5-682a-4f6e-b7ac-6798ca13e298-kube-api-access-h9m65\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.833163 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.833134 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:41.982431 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:41.982376 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475"] Jul 14 15:15:41.984505 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:15:41.984464 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde23efa5_682a_4f6e_b7ac_6798ca13e298.slice/crio-48b2ec3cef0445795a8b923289ab9df1c56872fb09795b9d35f56954240f010b WatchSource:0}: Error finding container 48b2ec3cef0445795a8b923289ab9df1c56872fb09795b9d35f56954240f010b: Status 404 returned error can't find the container with id 48b2ec3cef0445795a8b923289ab9df1c56872fb09795b9d35f56954240f010b Jul 14 15:15:42.914419 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:42.914386 2585 generic.go:356] "Generic (PLEG): container finished" podID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerID="1d8bfbdc4cc4dee2bb857b197fd8ee1aec2d849ba210850a4e588a555c174139" exitCode=0 Jul 14 15:15:42.914838 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:42.914504 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" event={"ID":"de23efa5-682a-4f6e-b7ac-6798ca13e298","Type":"ContainerDied","Data":"1d8bfbdc4cc4dee2bb857b197fd8ee1aec2d849ba210850a4e588a555c174139"} Jul 14 15:15:42.914838 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:42.914558 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" event={"ID":"de23efa5-682a-4f6e-b7ac-6798ca13e298","Type":"ContainerStarted","Data":"48b2ec3cef0445795a8b923289ab9df1c56872fb09795b9d35f56954240f010b"} Jul 14 15:15:43.920592 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:43.920506 2585 generic.go:356] "Generic (PLEG): container finished" podID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerID="7d85eba366d254d1e8c0440c8cc6e4790e840a14727f3b4fe4c9a30ce559ca08" exitCode=0 Jul 14 15:15:43.920919 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:43.920585 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" event={"ID":"de23efa5-682a-4f6e-b7ac-6798ca13e298","Type":"ContainerDied","Data":"7d85eba366d254d1e8c0440c8cc6e4790e840a14727f3b4fe4c9a30ce559ca08"} Jul 14 15:15:44.926941 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:44.926907 2585 generic.go:356] "Generic (PLEG): container finished" podID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerID="ffa708b93e9f675b3584f889129e46b92a7aa05a6aef626973f52deb208ce35e" exitCode=0 Jul 14 15:15:44.927279 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:44.926988 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" event={"ID":"de23efa5-682a-4f6e-b7ac-6798ca13e298","Type":"ContainerDied","Data":"ffa708b93e9f675b3584f889129e46b92a7aa05a6aef626973f52deb208ce35e"} Jul 14 15:15:46.052756 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.052727 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:46.108909 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.108878 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9m65\" (UniqueName: \"kubernetes.io/projected/de23efa5-682a-4f6e-b7ac-6798ca13e298-kube-api-access-h9m65\") pod \"de23efa5-682a-4f6e-b7ac-6798ca13e298\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " Jul 14 15:15:46.109078 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.108930 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-bundle\") pod \"de23efa5-682a-4f6e-b7ac-6798ca13e298\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " Jul 14 15:15:46.109078 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.108968 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-util\") pod \"de23efa5-682a-4f6e-b7ac-6798ca13e298\" (UID: \"de23efa5-682a-4f6e-b7ac-6798ca13e298\") " Jul 14 15:15:46.109728 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.109701 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-bundle" (OuterVolumeSpecName: "bundle") pod "de23efa5-682a-4f6e-b7ac-6798ca13e298" (UID: "de23efa5-682a-4f6e-b7ac-6798ca13e298"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:15:46.111017 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.110990 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de23efa5-682a-4f6e-b7ac-6798ca13e298-kube-api-access-h9m65" (OuterVolumeSpecName: "kube-api-access-h9m65") pod "de23efa5-682a-4f6e-b7ac-6798ca13e298" (UID: "de23efa5-682a-4f6e-b7ac-6798ca13e298"). InnerVolumeSpecName "kube-api-access-h9m65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:15:46.114710 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.114689 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-util" (OuterVolumeSpecName: "util") pod "de23efa5-682a-4f6e-b7ac-6798ca13e298" (UID: "de23efa5-682a-4f6e-b7ac-6798ca13e298"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:15:46.210211 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.210128 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9m65\" (UniqueName: \"kubernetes.io/projected/de23efa5-682a-4f6e-b7ac-6798ca13e298-kube-api-access-h9m65\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:15:46.210211 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.210158 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-bundle\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:15:46.210211 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.210167 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de23efa5-682a-4f6e-b7ac-6798ca13e298-util\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:15:46.936208 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.936177 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" Jul 14 15:15:46.936208 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.936195 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6x475" event={"ID":"de23efa5-682a-4f6e-b7ac-6798ca13e298","Type":"ContainerDied","Data":"48b2ec3cef0445795a8b923289ab9df1c56872fb09795b9d35f56954240f010b"} Jul 14 15:15:46.936425 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:46.936246 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48b2ec3cef0445795a8b923289ab9df1c56872fb09795b9d35f56954240f010b" Jul 14 15:15:53.804957 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.804920 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv"] Jul 14 15:15:53.805420 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.805219 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerName="extract" Jul 14 15:15:53.805420 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.805230 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerName="extract" Jul 14 15:15:53.805420 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.805242 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerName="pull" Jul 14 15:15:53.805420 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.805247 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerName="pull" Jul 14 15:15:53.805420 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.805263 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerName="util" Jul 14 15:15:53.805420 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.805270 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerName="util" Jul 14 15:15:53.805420 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.805321 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="de23efa5-682a-4f6e-b7ac-6798ca13e298" containerName="extract" Jul 14 15:15:53.811678 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.811659 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.814110 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.814086 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 15:15:53.814466 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.814446 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 15:15:53.814605 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.814577 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 15:15:53.814732 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.814612 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x84bs\"" Jul 14 15:15:53.814732 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.814726 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 15:15:53.828550 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.828519 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv"] Jul 14 15:15:53.858588 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.858557 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee387303-ef55-43c5-8de5-59b9ea46a856-tmp\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.858588 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.858594 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee387303-ef55-43c5-8de5-59b9ea46a856-webhook-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.858810 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.858626 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee387303-ef55-43c5-8de5-59b9ea46a856-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.858810 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.858696 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl45k\" (UniqueName: \"kubernetes.io/projected/ee387303-ef55-43c5-8de5-59b9ea46a856-kube-api-access-hl45k\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.858810 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.858748 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee387303-ef55-43c5-8de5-59b9ea46a856-manifests\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.959985 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.959954 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee387303-ef55-43c5-8de5-59b9ea46a856-tmp\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.960169 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.959993 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee387303-ef55-43c5-8de5-59b9ea46a856-webhook-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.960169 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.960043 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee387303-ef55-43c5-8de5-59b9ea46a856-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.960169 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.960086 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl45k\" (UniqueName: \"kubernetes.io/projected/ee387303-ef55-43c5-8de5-59b9ea46a856-kube-api-access-hl45k\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.960169 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.960130 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee387303-ef55-43c5-8de5-59b9ea46a856-manifests\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.960568 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.960540 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee387303-ef55-43c5-8de5-59b9ea46a856-manifests\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.962589 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.962555 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee387303-ef55-43c5-8de5-59b9ea46a856-tmp\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.962810 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.962785 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee387303-ef55-43c5-8de5-59b9ea46a856-webhook-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.963033 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.963011 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee387303-ef55-43c5-8de5-59b9ea46a856-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:53.971161 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:53.971135 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl45k\" (UniqueName: \"kubernetes.io/projected/ee387303-ef55-43c5-8de5-59b9ea46a856-kube-api-access-hl45k\") pod \"opendatahub-operator-controller-manager-8676d5649d-hjzhv\" (UID: \"ee387303-ef55-43c5-8de5-59b9ea46a856\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:54.121650 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:54.121555 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:15:54.259259 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:54.259233 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv"] Jul 14 15:15:54.261156 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:15:54.261128 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee387303_ef55_43c5_8de5_59b9ea46a856.slice/crio-0cac13c3ae0fc8594fba8c6d212dea8b07960737f319a1616f3f44a09a92ba8a WatchSource:0}: Error finding container 0cac13c3ae0fc8594fba8c6d212dea8b07960737f319a1616f3f44a09a92ba8a: Status 404 returned error can't find the container with id 0cac13c3ae0fc8594fba8c6d212dea8b07960737f319a1616f3f44a09a92ba8a Jul 14 15:15:54.971965 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:54.971931 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" event={"ID":"ee387303-ef55-43c5-8de5-59b9ea46a856","Type":"ContainerStarted","Data":"0cac13c3ae0fc8594fba8c6d212dea8b07960737f319a1616f3f44a09a92ba8a"} Jul 14 15:15:57.987816 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:57.987729 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" event={"ID":"ee387303-ef55-43c5-8de5-59b9ea46a856","Type":"ContainerStarted","Data":"6da71441f2caeab52d8dcbe6c7b68ca0d23316be4dd5f72206043e6a147bc373"} Jul 14 15:15:58.993429 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:58.993389 2585 generic.go:356] "Generic (PLEG): container finished" podID="ee387303-ef55-43c5-8de5-59b9ea46a856" containerID="6da71441f2caeab52d8dcbe6c7b68ca0d23316be4dd5f72206043e6a147bc373" exitCode=0 Jul 14 15:15:58.993851 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:58.993494 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" event={"ID":"ee387303-ef55-43c5-8de5-59b9ea46a856","Type":"ContainerDied","Data":"6da71441f2caeab52d8dcbe6c7b68ca0d23316be4dd5f72206043e6a147bc373"} Jul 14 15:15:59.999960 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:15:59.999931 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" event={"ID":"ee387303-ef55-43c5-8de5-59b9ea46a856","Type":"ContainerStarted","Data":"7514b674cdb1107491d69119cf506797c676193d919f38f87b8d02574cffa76a"} Jul 14 15:16:00.000361 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:00.000001 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:16:00.021468 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:00.021416 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" podStartSLOduration=2.195382718 podStartE2EDuration="7.021400279s" totalImagesPullingTime="3.793151098s" totalInitContainerRuntime="1.032866463s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:00.019893628 +0000 UTC m=+328.894555552" watchObservedRunningTime="2026-07-14 15:16:00.021400279 +0000 UTC m=+328.896062199" Jul 14 15:16:11.006642 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:11.006612 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-hjzhv" Jul 14 15:16:15.829980 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:15.829943 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn"] Jul 14 15:16:15.838594 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:15.838570 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:15.841057 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:15.841035 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 15:16:15.841455 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:15.841437 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 15:16:15.841990 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:15.841977 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cpk2q\"" Jul 14 15:16:15.851746 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:15.851724 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn"] Jul 14 15:16:15.929266 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:15.929229 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lztbq\" (UniqueName: \"kubernetes.io/projected/ce1af933-4f3d-464e-a94d-1155a57c97f6-kube-api-access-lztbq\") pod \"kube-auth-proxy-7754cbb886-rqhhn\" (UID: \"ce1af933-4f3d-464e-a94d-1155a57c97f6\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:15.929462 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:15.929304 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce1af933-4f3d-464e-a94d-1155a57c97f6-tmp\") pod \"kube-auth-proxy-7754cbb886-rqhhn\" (UID: \"ce1af933-4f3d-464e-a94d-1155a57c97f6\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:15.929462 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:15.929352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce1af933-4f3d-464e-a94d-1155a57c97f6-tls-certs\") pod \"kube-auth-proxy-7754cbb886-rqhhn\" (UID: \"ce1af933-4f3d-464e-a94d-1155a57c97f6\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:16.030556 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:16.030520 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce1af933-4f3d-464e-a94d-1155a57c97f6-tls-certs\") pod \"kube-auth-proxy-7754cbb886-rqhhn\" (UID: \"ce1af933-4f3d-464e-a94d-1155a57c97f6\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:16.030761 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:16.030593 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lztbq\" (UniqueName: \"kubernetes.io/projected/ce1af933-4f3d-464e-a94d-1155a57c97f6-kube-api-access-lztbq\") pod \"kube-auth-proxy-7754cbb886-rqhhn\" (UID: \"ce1af933-4f3d-464e-a94d-1155a57c97f6\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:16.030761 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:16.030627 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce1af933-4f3d-464e-a94d-1155a57c97f6-tmp\") pod \"kube-auth-proxy-7754cbb886-rqhhn\" (UID: \"ce1af933-4f3d-464e-a94d-1155a57c97f6\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:16.032885 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:16.032852 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce1af933-4f3d-464e-a94d-1155a57c97f6-tmp\") pod \"kube-auth-proxy-7754cbb886-rqhhn\" (UID: \"ce1af933-4f3d-464e-a94d-1155a57c97f6\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:16.033199 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:16.033173 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce1af933-4f3d-464e-a94d-1155a57c97f6-tls-certs\") pod \"kube-auth-proxy-7754cbb886-rqhhn\" (UID: \"ce1af933-4f3d-464e-a94d-1155a57c97f6\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:16.040581 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:16.040552 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lztbq\" (UniqueName: \"kubernetes.io/projected/ce1af933-4f3d-464e-a94d-1155a57c97f6-kube-api-access-lztbq\") pod \"kube-auth-proxy-7754cbb886-rqhhn\" (UID: \"ce1af933-4f3d-464e-a94d-1155a57c97f6\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:16.147995 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:16.147898 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" Jul 14 15:16:16.315510 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:16.315463 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn"] Jul 14 15:16:16.317072 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:16:16.317049 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1af933_4f3d_464e_a94d_1155a57c97f6.slice/crio-3a88165b739d96c2b67f5aa1e918830f8930c9247dc320cec3e3d78b80c1135d WatchSource:0}: Error finding container 3a88165b739d96c2b67f5aa1e918830f8930c9247dc320cec3e3d78b80c1135d: Status 404 returned error can't find the container with id 3a88165b739d96c2b67f5aa1e918830f8930c9247dc320cec3e3d78b80c1135d Jul 14 15:16:17.078759 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:17.078725 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" event={"ID":"ce1af933-4f3d-464e-a94d-1155a57c97f6","Type":"ContainerStarted","Data":"3a88165b739d96c2b67f5aa1e918830f8930c9247dc320cec3e3d78b80c1135d"} Jul 14 15:16:22.104564 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:22.104512 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" event={"ID":"ce1af933-4f3d-464e-a94d-1155a57c97f6","Type":"ContainerStarted","Data":"b54242ae42864915709a0cabeefc4c066993def63c5e90630159c19100524b66"} Jul 14 15:16:22.151898 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:22.151842 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7754cbb886-rqhhn" podStartSLOduration=2.33863235 podStartE2EDuration="7.151824395s" totalImagesPullingTime="4.813192045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:22.149458679 +0000 UTC m=+351.024120602" watchObservedRunningTime="2026-07-14 15:16:22.151824395 +0000 UTC m=+351.026486316" Jul 14 15:16:23.640782 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.640746 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6"] Jul 14 15:16:23.644152 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.644134 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.647429 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.647409 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 15:16:23.647580 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.647457 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2q266\"" Jul 14 15:16:23.647580 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.647417 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 15:16:23.647580 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.647469 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 15:16:23.647580 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.647417 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 15:16:23.666245 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.666220 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6"] Jul 14 15:16:23.696508 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.696468 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.696669 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.696517 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.696669 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.696537 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzz9m\" (UniqueName: \"kubernetes.io/projected/c6516aa2-53bc-4e7e-94ab-e501a4a97650-kube-api-access-xzz9m\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.696669 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.696563 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6516aa2-53bc-4e7e-94ab-e501a4a97650-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.696669 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.696609 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6516aa2-53bc-4e7e-94ab-e501a4a97650-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.696839 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.696690 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.696839 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.696722 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.797365 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.797331 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6516aa2-53bc-4e7e-94ab-e501a4a97650-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.797568 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.797388 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.797568 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.797411 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.797568 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.797443 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.797568 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.797467 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.797775 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.797630 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzz9m\" (UniqueName: \"kubernetes.io/projected/c6516aa2-53bc-4e7e-94ab-e501a4a97650-kube-api-access-xzz9m\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.797775 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.797689 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6516aa2-53bc-4e7e-94ab-e501a4a97650-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.798291 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.798256 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.799760 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.799734 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6516aa2-53bc-4e7e-94ab-e501a4a97650-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.799936 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.799920 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.800279 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.800259 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.800337 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.800268 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6516aa2-53bc-4e7e-94ab-e501a4a97650-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.810201 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.810163 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzz9m\" (UniqueName: \"kubernetes.io/projected/c6516aa2-53bc-4e7e-94ab-e501a4a97650-kube-api-access-xzz9m\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.810319 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.810246 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6516aa2-53bc-4e7e-94ab-e501a4a97650-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zqlq6\" (UID: \"c6516aa2-53bc-4e7e-94ab-e501a4a97650\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:23.954010 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:23.953975 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:24.108381 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:24.108356 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6"] Jul 14 15:16:24.110500 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:16:24.110449 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6516aa2_53bc_4e7e_94ab_e501a4a97650.slice/crio-e16dce69aa139b5e76244e8104950492003fb043704020c9282b2a92b26557ef WatchSource:0}: Error finding container e16dce69aa139b5e76244e8104950492003fb043704020c9282b2a92b26557ef: Status 404 returned error can't find the container with id e16dce69aa139b5e76244e8104950492003fb043704020c9282b2a92b26557ef Jul 14 15:16:25.121042 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:25.120967 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" event={"ID":"c6516aa2-53bc-4e7e-94ab-e501a4a97650","Type":"ContainerStarted","Data":"e16dce69aa139b5e76244e8104950492003fb043704020c9282b2a92b26557ef"} Jul 14 15:16:26.304267 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:26.304220 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 15:16:26.304534 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:26.304305 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 15:16:26.989932 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:26.989895 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc"] Jul 14 15:16:26.994037 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:26.994012 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:27.000833 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.000812 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 14 15:16:27.001165 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.001146 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vv6n9\"" Jul 14 15:16:27.035108 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.035074 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc"] Jul 14 15:16:27.128217 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.128188 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd83681f-84c7-4423-a8d2-898e722d1303-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-95cfc\" (UID: \"bd83681f-84c7-4423-a8d2-898e722d1303\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:27.128383 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.128228 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmqqp\" (UniqueName: \"kubernetes.io/projected/bd83681f-84c7-4423-a8d2-898e722d1303-kube-api-access-wmqqp\") pod \"llmisvc-controller-manager-777c6bd7d5-95cfc\" (UID: \"bd83681f-84c7-4423-a8d2-898e722d1303\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:27.132762 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.132729 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" event={"ID":"c6516aa2-53bc-4e7e-94ab-e501a4a97650","Type":"ContainerStarted","Data":"ecfbd8ad2d56aa6e5a3fa07c14117ca87da9f736ac9bdd3ba9bfd9f6c6ed197d"} Jul 14 15:16:27.132936 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.132920 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:27.134573 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.134548 2585 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-zqlq6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 15:16:27.134652 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.134593 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" podUID="c6516aa2-53bc-4e7e-94ab-e501a4a97650" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 15:16:27.171961 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.171904 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" podStartSLOduration=1.980799003 podStartE2EDuration="4.171883616s" totalImagesPullingTime="2.191084613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:27.171368779 +0000 UTC m=+356.046030701" watchObservedRunningTime="2026-07-14 15:16:27.171883616 +0000 UTC m=+356.046545538" Jul 14 15:16:27.229135 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.229097 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd83681f-84c7-4423-a8d2-898e722d1303-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-95cfc\" (UID: \"bd83681f-84c7-4423-a8d2-898e722d1303\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:27.229351 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.229206 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmqqp\" (UniqueName: \"kubernetes.io/projected/bd83681f-84c7-4423-a8d2-898e722d1303-kube-api-access-wmqqp\") pod \"llmisvc-controller-manager-777c6bd7d5-95cfc\" (UID: \"bd83681f-84c7-4423-a8d2-898e722d1303\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:27.229351 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:16:27.229267 2585 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 14 15:16:27.229351 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:16:27.229333 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd83681f-84c7-4423-a8d2-898e722d1303-cert podName:bd83681f-84c7-4423-a8d2-898e722d1303 nodeName:}" failed. No retries permitted until 2026-07-14 15:16:27.729319308 +0000 UTC m=+356.603981212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd83681f-84c7-4423-a8d2-898e722d1303-cert") pod "llmisvc-controller-manager-777c6bd7d5-95cfc" (UID: "bd83681f-84c7-4423-a8d2-898e722d1303") : secret "llmisvc-webhook-server-cert" not found Jul 14 15:16:27.242348 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.242255 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmqqp\" (UniqueName: \"kubernetes.io/projected/bd83681f-84c7-4423-a8d2-898e722d1303-kube-api-access-wmqqp\") pod \"llmisvc-controller-manager-777c6bd7d5-95cfc\" (UID: \"bd83681f-84c7-4423-a8d2-898e722d1303\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:27.733350 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.733318 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd83681f-84c7-4423-a8d2-898e722d1303-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-95cfc\" (UID: \"bd83681f-84c7-4423-a8d2-898e722d1303\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:27.736043 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.736019 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd83681f-84c7-4423-a8d2-898e722d1303-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-95cfc\" (UID: \"bd83681f-84c7-4423-a8d2-898e722d1303\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:27.904587 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:27.904553 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:28.045089 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:28.045064 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc"] Jul 14 15:16:28.046817 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:16:28.046789 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd83681f_84c7_4423_a8d2_898e722d1303.slice/crio-b3e4b0414f851738b5763b3446f0757823b23b61d899adcecc3e68522085cb9d WatchSource:0}: Error finding container b3e4b0414f851738b5763b3446f0757823b23b61d899adcecc3e68522085cb9d: Status 404 returned error can't find the container with id b3e4b0414f851738b5763b3446f0757823b23b61d899adcecc3e68522085cb9d Jul 14 15:16:28.138237 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:28.138205 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" event={"ID":"bd83681f-84c7-4423-a8d2-898e722d1303","Type":"ContainerStarted","Data":"b3e4b0414f851738b5763b3446f0757823b23b61d899adcecc3e68522085cb9d"} Jul 14 15:16:28.139076 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:28.139050 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zqlq6" Jul 14 15:16:33.167350 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:33.167307 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" event={"ID":"bd83681f-84c7-4423-a8d2-898e722d1303","Type":"ContainerStarted","Data":"4c2c8a2eb93654f200a47e993d50b8fd22ca42c4b118fecf4cb5ed40dfb79060"} Jul 14 15:16:33.167828 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:33.167468 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:16:33.204216 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:16:33.204170 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" podStartSLOduration=3.087843017 podStartE2EDuration="7.204153603s" totalImagesPullingTime="4.116310586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:33.202938934 +0000 UTC m=+362.077600856" watchObservedRunningTime="2026-07-14 15:16:33.204153603 +0000 UTC m=+362.078815524" Jul 14 15:17:04.173898 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:04.173866 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95cfc" Jul 14 15:17:32.178220 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.178182 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh"] Jul 14 15:17:32.181728 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.181709 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.184190 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.184166 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 15:17:32.184190 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.184183 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 15:17:32.184984 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.184971 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xq8sb\"" Jul 14 15:17:32.190657 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.190634 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh"] Jul 14 15:17:32.260129 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.260098 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq59p\" (UniqueName: \"kubernetes.io/projected/068dd508-692d-4006-9aba-2f9c4f3120cb-kube-api-access-xq59p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.260289 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.260158 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.260289 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.260239 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.361680 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.361643 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.361848 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.361713 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.361848 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.361741 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq59p\" (UniqueName: \"kubernetes.io/projected/068dd508-692d-4006-9aba-2f9c4f3120cb-kube-api-access-xq59p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.362112 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.362088 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.362156 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.362099 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.369544 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.369518 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq59p\" (UniqueName: \"kubernetes.io/projected/068dd508-692d-4006-9aba-2f9c4f3120cb-kube-api-access-xq59p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.491636 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.491547 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:32.619426 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.619402 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh"] Jul 14 15:17:32.621650 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:17:32.621612 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068dd508_692d_4006_9aba_2f9c4f3120cb.slice/crio-2a3b95ff3379519e35e55a4a2a084fcd716953ea20df469b4def68fbb2c92654 WatchSource:0}: Error finding container 2a3b95ff3379519e35e55a4a2a084fcd716953ea20df469b4def68fbb2c92654: Status 404 returned error can't find the container with id 2a3b95ff3379519e35e55a4a2a084fcd716953ea20df469b4def68fbb2c92654 Jul 14 15:17:32.773937 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.773874 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw"] Jul 14 15:17:32.777054 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.777038 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:32.785035 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.785011 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw"] Jul 14 15:17:32.866640 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.866601 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmpwq\" (UniqueName: \"kubernetes.io/projected/3927ae27-5400-4153-ab63-97f6582e3860-kube-api-access-gmpwq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:32.866640 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.866642 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:32.866835 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.866661 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:32.967542 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.967503 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpwq\" (UniqueName: \"kubernetes.io/projected/3927ae27-5400-4153-ab63-97f6582e3860-kube-api-access-gmpwq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:32.967542 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.967544 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:32.967746 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.967564 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:32.967969 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.967949 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:32.967969 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.967962 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:32.975886 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:32.975868 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmpwq\" (UniqueName: \"kubernetes.io/projected/3927ae27-5400-4153-ab63-97f6582e3860-kube-api-access-gmpwq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:33.104731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.104635 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:33.182090 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.182061 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk"] Jul 14 15:17:33.186897 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.186858 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.193786 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.193756 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk"] Jul 14 15:17:33.235700 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.235675 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw"] Jul 14 15:17:33.237514 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:17:33.237473 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3927ae27_5400_4153_ab63_97f6582e3860.slice/crio-e212972a9ce7a372808348e85a2b299f79b692a926b0dc1a20d657fc696bde36 WatchSource:0}: Error finding container e212972a9ce7a372808348e85a2b299f79b692a926b0dc1a20d657fc696bde36: Status 404 returned error can't find the container with id e212972a9ce7a372808348e85a2b299f79b692a926b0dc1a20d657fc696bde36 Jul 14 15:17:33.270562 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.270534 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.270670 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.270636 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.270747 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.270728 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2kcg\" (UniqueName: \"kubernetes.io/projected/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-kube-api-access-h2kcg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.371765 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.371680 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.371765 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.371743 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.371970 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.371787 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2kcg\" (UniqueName: \"kubernetes.io/projected/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-kube-api-access-h2kcg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.372135 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.372112 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.372198 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.372131 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.380142 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.380120 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2kcg\" (UniqueName: \"kubernetes.io/projected/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-kube-api-access-h2kcg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.431731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.431696 2585 generic.go:356] "Generic (PLEG): container finished" podID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerID="3b2207d1e43f7c202d12baf2945bba8d9eac671c466cbdf7d646bfeeff1c2d3e" exitCode=0 Jul 14 15:17:33.431898 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.431782 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" event={"ID":"068dd508-692d-4006-9aba-2f9c4f3120cb","Type":"ContainerDied","Data":"3b2207d1e43f7c202d12baf2945bba8d9eac671c466cbdf7d646bfeeff1c2d3e"} Jul 14 15:17:33.431898 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.431834 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" event={"ID":"068dd508-692d-4006-9aba-2f9c4f3120cb","Type":"ContainerStarted","Data":"2a3b95ff3379519e35e55a4a2a084fcd716953ea20df469b4def68fbb2c92654"} Jul 14 15:17:33.433357 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.433330 2585 generic.go:356] "Generic (PLEG): container finished" podID="3927ae27-5400-4153-ab63-97f6582e3860" containerID="a45eb166c127ebe0fa36518cd0412bbaffdaa6daf5f7374efe1851a44e7a33de" exitCode=0 Jul 14 15:17:33.433457 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.433391 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" event={"ID":"3927ae27-5400-4153-ab63-97f6582e3860","Type":"ContainerDied","Data":"a45eb166c127ebe0fa36518cd0412bbaffdaa6daf5f7374efe1851a44e7a33de"} Jul 14 15:17:33.433457 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.433424 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" event={"ID":"3927ae27-5400-4153-ab63-97f6582e3860","Type":"ContainerStarted","Data":"e212972a9ce7a372808348e85a2b299f79b692a926b0dc1a20d657fc696bde36"} Jul 14 15:17:33.500679 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.500640 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:33.577772 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.577741 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp"] Jul 14 15:17:33.581531 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.581507 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.589675 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.589083 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp"] Jul 14 15:17:33.639223 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.639192 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk"] Jul 14 15:17:33.640789 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:17:33.640762 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe570b5_e0cd_4dfb_b7ca_71906dd3260b.slice/crio-7def420d80434c66fc7c54e99b3739690e60cc93791df04bfd186fc66c22f91e WatchSource:0}: Error finding container 7def420d80434c66fc7c54e99b3739690e60cc93791df04bfd186fc66c22f91e: Status 404 returned error can't find the container with id 7def420d80434c66fc7c54e99b3739690e60cc93791df04bfd186fc66c22f91e Jul 14 15:17:33.676528 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.676500 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.676631 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.676544 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.676631 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.676571 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nlpx\" (UniqueName: \"kubernetes.io/projected/c3992806-9cf1-4eac-a803-c2dbb7261bf6-kube-api-access-2nlpx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.778009 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.777980 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.778147 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.778014 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.778147 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.778040 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nlpx\" (UniqueName: \"kubernetes.io/projected/c3992806-9cf1-4eac-a803-c2dbb7261bf6-kube-api-access-2nlpx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.778360 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.778341 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.778416 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.778396 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.786826 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.786807 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nlpx\" (UniqueName: \"kubernetes.io/projected/c3992806-9cf1-4eac-a803-c2dbb7261bf6-kube-api-access-2nlpx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:33.893851 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:33.893766 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:34.017799 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.017777 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp"] Jul 14 15:17:34.019397 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:17:34.019369 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3992806_9cf1_4eac_a803_c2dbb7261bf6.slice/crio-e546037561436f608cd2a774c6a305e16916ec458ce2673bb469e2446fb36f8f WatchSource:0}: Error finding container e546037561436f608cd2a774c6a305e16916ec458ce2673bb469e2446fb36f8f: Status 404 returned error can't find the container with id e546037561436f608cd2a774c6a305e16916ec458ce2673bb469e2446fb36f8f Jul 14 15:17:34.439830 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.439798 2585 generic.go:356] "Generic (PLEG): container finished" podID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerID="7d339fe756a53c77b92b3ff810d2ceffe3e4529fecc03fb84b0f269c8622d812" exitCode=0 Jul 14 15:17:34.440210 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.439882 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" event={"ID":"068dd508-692d-4006-9aba-2f9c4f3120cb","Type":"ContainerDied","Data":"7d339fe756a53c77b92b3ff810d2ceffe3e4529fecc03fb84b0f269c8622d812"} Jul 14 15:17:34.441871 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.441845 2585 generic.go:356] "Generic (PLEG): container finished" podID="3927ae27-5400-4153-ab63-97f6582e3860" containerID="041f34ff85cc6985b51d82de185c4a508c98f42c3de9752d983eeea886a72ce9" exitCode=0 Jul 14 15:17:34.441959 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.441922 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" event={"ID":"3927ae27-5400-4153-ab63-97f6582e3860","Type":"ContainerDied","Data":"041f34ff85cc6985b51d82de185c4a508c98f42c3de9752d983eeea886a72ce9"} Jul 14 15:17:34.443530 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.443507 2585 generic.go:356] "Generic (PLEG): container finished" podID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerID="0c8e2c2afa617dd944a375a012b3d5562c1fdae73abd0d70df9cb60fa7d3629d" exitCode=0 Jul 14 15:17:34.443664 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.443631 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" event={"ID":"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b","Type":"ContainerDied","Data":"0c8e2c2afa617dd944a375a012b3d5562c1fdae73abd0d70df9cb60fa7d3629d"} Jul 14 15:17:34.443729 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.443668 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" event={"ID":"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b","Type":"ContainerStarted","Data":"7def420d80434c66fc7c54e99b3739690e60cc93791df04bfd186fc66c22f91e"} Jul 14 15:17:34.445341 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.445315 2585 generic.go:356] "Generic (PLEG): container finished" podID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerID="beb349713298d2ad9b1bc502bf3545ca305e8f3bdaac82003bfe9a1dd9cdbe52" exitCode=0 Jul 14 15:17:34.445444 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.445340 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" event={"ID":"c3992806-9cf1-4eac-a803-c2dbb7261bf6","Type":"ContainerDied","Data":"beb349713298d2ad9b1bc502bf3545ca305e8f3bdaac82003bfe9a1dd9cdbe52"} Jul 14 15:17:34.445444 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:34.445420 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" event={"ID":"c3992806-9cf1-4eac-a803-c2dbb7261bf6","Type":"ContainerStarted","Data":"e546037561436f608cd2a774c6a305e16916ec458ce2673bb469e2446fb36f8f"} Jul 14 15:17:35.452818 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:35.452779 2585 generic.go:356] "Generic (PLEG): container finished" podID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerID="75955e53195d8bcd41ed0a06bb2b883ec21538a917a607c3abfd3ba4404c213d" exitCode=0 Jul 14 15:17:35.453254 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:35.452859 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" event={"ID":"068dd508-692d-4006-9aba-2f9c4f3120cb","Type":"ContainerDied","Data":"75955e53195d8bcd41ed0a06bb2b883ec21538a917a607c3abfd3ba4404c213d"} Jul 14 15:17:35.454981 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:35.454959 2585 generic.go:356] "Generic (PLEG): container finished" podID="3927ae27-5400-4153-ab63-97f6582e3860" containerID="8a4053f633c736e002bcf0736221d733ad16b93e1659f6d54985984711943efb" exitCode=0 Jul 14 15:17:35.455072 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:35.455001 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" event={"ID":"3927ae27-5400-4153-ab63-97f6582e3860","Type":"ContainerDied","Data":"8a4053f633c736e002bcf0736221d733ad16b93e1659f6d54985984711943efb"} Jul 14 15:17:36.592356 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.592330 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:36.617864 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.617838 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:36.701825 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.701791 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-bundle\") pod \"068dd508-692d-4006-9aba-2f9c4f3120cb\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " Jul 14 15:17:36.702014 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.701836 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq59p\" (UniqueName: \"kubernetes.io/projected/068dd508-692d-4006-9aba-2f9c4f3120cb-kube-api-access-xq59p\") pod \"068dd508-692d-4006-9aba-2f9c4f3120cb\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " Jul 14 15:17:36.702014 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.701886 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-util\") pod \"068dd508-692d-4006-9aba-2f9c4f3120cb\" (UID: \"068dd508-692d-4006-9aba-2f9c4f3120cb\") " Jul 14 15:17:36.702014 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.701911 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmpwq\" (UniqueName: \"kubernetes.io/projected/3927ae27-5400-4153-ab63-97f6582e3860-kube-api-access-gmpwq\") pod \"3927ae27-5400-4153-ab63-97f6582e3860\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " Jul 14 15:17:36.702014 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.701927 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-bundle\") pod \"3927ae27-5400-4153-ab63-97f6582e3860\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " Jul 14 15:17:36.702014 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.701945 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-util\") pod \"3927ae27-5400-4153-ab63-97f6582e3860\" (UID: \"3927ae27-5400-4153-ab63-97f6582e3860\") " Jul 14 15:17:36.702607 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.702540 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-bundle" (OuterVolumeSpecName: "bundle") pod "3927ae27-5400-4153-ab63-97f6582e3860" (UID: "3927ae27-5400-4153-ab63-97f6582e3860"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:17:36.702607 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.702554 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-bundle" (OuterVolumeSpecName: "bundle") pod "068dd508-692d-4006-9aba-2f9c4f3120cb" (UID: "068dd508-692d-4006-9aba-2f9c4f3120cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:17:36.704690 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.704661 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3927ae27-5400-4153-ab63-97f6582e3860-kube-api-access-gmpwq" (OuterVolumeSpecName: "kube-api-access-gmpwq") pod "3927ae27-5400-4153-ab63-97f6582e3860" (UID: "3927ae27-5400-4153-ab63-97f6582e3860"). InnerVolumeSpecName "kube-api-access-gmpwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:17:36.704792 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.704672 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068dd508-692d-4006-9aba-2f9c4f3120cb-kube-api-access-xq59p" (OuterVolumeSpecName: "kube-api-access-xq59p") pod "068dd508-692d-4006-9aba-2f9c4f3120cb" (UID: "068dd508-692d-4006-9aba-2f9c4f3120cb"). InnerVolumeSpecName "kube-api-access-xq59p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:17:36.707430 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.707393 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-util" (OuterVolumeSpecName: "util") pod "3927ae27-5400-4153-ab63-97f6582e3860" (UID: "3927ae27-5400-4153-ab63-97f6582e3860"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:17:36.708020 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.708001 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-util" (OuterVolumeSpecName: "util") pod "068dd508-692d-4006-9aba-2f9c4f3120cb" (UID: "068dd508-692d-4006-9aba-2f9c4f3120cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:17:36.803338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.803246 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq59p\" (UniqueName: \"kubernetes.io/projected/068dd508-692d-4006-9aba-2f9c4f3120cb-kube-api-access-xq59p\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:36.803338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.803282 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-util\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:36.803338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.803292 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmpwq\" (UniqueName: \"kubernetes.io/projected/3927ae27-5400-4153-ab63-97f6582e3860-kube-api-access-gmpwq\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:36.803338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.803301 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-bundle\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:36.803338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.803309 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3927ae27-5400-4153-ab63-97f6582e3860-util\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:36.803338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:36.803317 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068dd508-692d-4006-9aba-2f9c4f3120cb-bundle\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:37.467105 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:37.467063 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" event={"ID":"3927ae27-5400-4153-ab63-97f6582e3860","Type":"ContainerDied","Data":"e212972a9ce7a372808348e85a2b299f79b692a926b0dc1a20d657fc696bde36"} Jul 14 15:17:37.467291 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:37.467118 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e212972a9ce7a372808348e85a2b299f79b692a926b0dc1a20d657fc696bde36" Jul 14 15:17:37.467291 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:37.467077 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw" Jul 14 15:17:37.470123 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:37.470089 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" event={"ID":"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b","Type":"ContainerStarted","Data":"34152b9a49e89839f9cc85295e5b88f66d16e72ea29843c7fc07416e0a66961f"} Jul 14 15:17:37.472518 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:37.472471 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" event={"ID":"068dd508-692d-4006-9aba-2f9c4f3120cb","Type":"ContainerDied","Data":"2a3b95ff3379519e35e55a4a2a084fcd716953ea20df469b4def68fbb2c92654"} Jul 14 15:17:37.472518 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:37.472507 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh" Jul 14 15:17:37.472688 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:37.472536 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a3b95ff3379519e35e55a4a2a084fcd716953ea20df469b4def68fbb2c92654" Jul 14 15:17:38.478828 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:38.478793 2585 generic.go:356] "Generic (PLEG): container finished" podID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerID="34152b9a49e89839f9cc85295e5b88f66d16e72ea29843c7fc07416e0a66961f" exitCode=0 Jul 14 15:17:38.479257 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:38.478878 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" event={"ID":"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b","Type":"ContainerDied","Data":"34152b9a49e89839f9cc85295e5b88f66d16e72ea29843c7fc07416e0a66961f"} Jul 14 15:17:38.480765 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:38.480741 2585 generic.go:356] "Generic (PLEG): container finished" podID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerID="a0ea7f42b666e212c3a933a0e48e40bf970869cd01ba7da3b74cbd12fe4f74ae" exitCode=0 Jul 14 15:17:38.480861 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:38.480802 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" event={"ID":"c3992806-9cf1-4eac-a803-c2dbb7261bf6","Type":"ContainerDied","Data":"a0ea7f42b666e212c3a933a0e48e40bf970869cd01ba7da3b74cbd12fe4f74ae"} Jul 14 15:17:39.490940 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:39.490904 2585 generic.go:356] "Generic (PLEG): container finished" podID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerID="f3fb79d2b740d6f76a30d16fcefde3fbc66c913abe5a718bf388906f99a41d6c" exitCode=0 Jul 14 15:17:39.491344 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:39.490979 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" event={"ID":"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b","Type":"ContainerDied","Data":"f3fb79d2b740d6f76a30d16fcefde3fbc66c913abe5a718bf388906f99a41d6c"} Jul 14 15:17:39.492950 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:39.492926 2585 generic.go:356] "Generic (PLEG): container finished" podID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerID="465eaea73d9f18552a2e3a90b591ff5ea385afac9f5c1395b3e71afc1c021dc3" exitCode=0 Jul 14 15:17:39.493064 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:39.493005 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" event={"ID":"c3992806-9cf1-4eac-a803-c2dbb7261bf6","Type":"ContainerDied","Data":"465eaea73d9f18552a2e3a90b591ff5ea385afac9f5c1395b3e71afc1c021dc3"} Jul 14 15:17:40.650974 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.650951 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:40.653809 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.653788 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:40.735887 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.735855 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2kcg\" (UniqueName: \"kubernetes.io/projected/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-kube-api-access-h2kcg\") pod \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " Jul 14 15:17:40.736060 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.735917 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-bundle\") pod \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " Jul 14 15:17:40.736060 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.735947 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-bundle\") pod \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " Jul 14 15:17:40.736060 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.735978 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-util\") pod \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\" (UID: \"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b\") " Jul 14 15:17:40.736060 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.736001 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nlpx\" (UniqueName: \"kubernetes.io/projected/c3992806-9cf1-4eac-a803-c2dbb7261bf6-kube-api-access-2nlpx\") pod \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " Jul 14 15:17:40.736274 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.736121 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-util\") pod \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\" (UID: \"c3992806-9cf1-4eac-a803-c2dbb7261bf6\") " Jul 14 15:17:40.736565 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.736536 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-bundle" (OuterVolumeSpecName: "bundle") pod "c3992806-9cf1-4eac-a803-c2dbb7261bf6" (UID: "c3992806-9cf1-4eac-a803-c2dbb7261bf6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:17:40.736701 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.736656 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-bundle" (OuterVolumeSpecName: "bundle") pod "5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" (UID: "5fe570b5-e0cd-4dfb-b7ca-71906dd3260b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:17:40.738077 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.738054 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-kube-api-access-h2kcg" (OuterVolumeSpecName: "kube-api-access-h2kcg") pod "5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" (UID: "5fe570b5-e0cd-4dfb-b7ca-71906dd3260b"). InnerVolumeSpecName "kube-api-access-h2kcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:17:40.738186 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.738134 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3992806-9cf1-4eac-a803-c2dbb7261bf6-kube-api-access-2nlpx" (OuterVolumeSpecName: "kube-api-access-2nlpx") pod "c3992806-9cf1-4eac-a803-c2dbb7261bf6" (UID: "c3992806-9cf1-4eac-a803-c2dbb7261bf6"). InnerVolumeSpecName "kube-api-access-2nlpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:17:40.741185 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.741145 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-util" (OuterVolumeSpecName: "util") pod "c3992806-9cf1-4eac-a803-c2dbb7261bf6" (UID: "c3992806-9cf1-4eac-a803-c2dbb7261bf6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:17:40.741555 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.741532 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-util" (OuterVolumeSpecName: "util") pod "5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" (UID: "5fe570b5-e0cd-4dfb-b7ca-71906dd3260b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:17:40.836966 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.836876 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2kcg\" (UniqueName: \"kubernetes.io/projected/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-kube-api-access-h2kcg\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:40.836966 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.836909 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-bundle\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:40.836966 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.836919 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-bundle\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:40.836966 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.836926 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fe570b5-e0cd-4dfb-b7ca-71906dd3260b-util\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:40.836966 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.836935 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nlpx\" (UniqueName: \"kubernetes.io/projected/c3992806-9cf1-4eac-a803-c2dbb7261bf6-kube-api-access-2nlpx\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:40.836966 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:40.836943 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3992806-9cf1-4eac-a803-c2dbb7261bf6-util\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:17:41.505611 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:41.505580 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" Jul 14 15:17:41.505784 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:41.505605 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp" event={"ID":"c3992806-9cf1-4eac-a803-c2dbb7261bf6","Type":"ContainerDied","Data":"e546037561436f608cd2a774c6a305e16916ec458ce2673bb469e2446fb36f8f"} Jul 14 15:17:41.505784 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:41.505663 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e546037561436f608cd2a774c6a305e16916ec458ce2673bb469e2446fb36f8f" Jul 14 15:17:41.507460 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:41.507437 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" event={"ID":"5fe570b5-e0cd-4dfb-b7ca-71906dd3260b","Type":"ContainerDied","Data":"7def420d80434c66fc7c54e99b3739690e60cc93791df04bfd186fc66c22f91e"} Jul 14 15:17:41.507581 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:41.507464 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk" Jul 14 15:17:41.507581 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:41.507472 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7def420d80434c66fc7c54e99b3739690e60cc93791df04bfd186fc66c22f91e" Jul 14 15:17:45.007512 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007462 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fd7786c7b-xq48m"] Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007793 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerName="util" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007804 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerName="util" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007813 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerName="extract" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007818 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerName="extract" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007826 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3927ae27-5400-4153-ab63-97f6582e3860" containerName="extract" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007832 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3927ae27-5400-4153-ab63-97f6582e3860" containerName="extract" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007839 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerName="util" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007846 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerName="util" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007853 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3927ae27-5400-4153-ab63-97f6582e3860" containerName="pull" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007858 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3927ae27-5400-4153-ab63-97f6582e3860" containerName="pull" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007864 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerName="pull" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007869 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerName="pull" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007881 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerName="pull" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007886 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerName="pull" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007892 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerName="pull" Jul 14 15:17:45.007892 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007897 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerName="pull" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007903 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerName="util" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007908 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerName="util" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007917 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3927ae27-5400-4153-ab63-97f6582e3860" containerName="util" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007922 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3927ae27-5400-4153-ab63-97f6582e3860" containerName="util" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007929 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerName="extract" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007934 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerName="extract" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007940 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerName="extract" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007945 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerName="extract" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.007996 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe570b5-e0cd-4dfb-b7ca-71906dd3260b" containerName="extract" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.008004 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="068dd508-692d-4006-9aba-2f9c4f3120cb" containerName="extract" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.008013 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="3927ae27-5400-4153-ab63-97f6582e3860" containerName="extract" Jul 14 15:17:45.008338 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.008019 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3992806-9cf1-4eac-a803-c2dbb7261bf6" containerName="extract" Jul 14 15:17:45.012950 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.012930 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.015707 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.015676 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 15:17:45.015832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.015718 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 15:17:45.015832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.015718 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 15:17:45.015832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.015762 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 15:17:45.015832 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.015786 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 15:17:45.016821 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.016803 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 15:17:45.017116 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.017098 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6zpvk\"" Jul 14 15:17:45.017207 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.017189 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 15:17:45.023018 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.022995 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 15:17:45.023362 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.023340 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd7786c7b-xq48m"] Jul 14 15:17:45.174949 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.174903 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-oauth-serving-cert\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.174949 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.174946 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-console-config\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.175217 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.174976 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-trusted-ca-bundle\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.175217 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.175052 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-console-oauth-config\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.175217 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.175086 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvsnj\" (UniqueName: \"kubernetes.io/projected/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-kube-api-access-bvsnj\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.175217 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.175125 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-service-ca\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.175217 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.175152 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-console-serving-cert\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.275709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.275624 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-oauth-serving-cert\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.275709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.275668 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-console-config\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.275709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.275684 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-trusted-ca-bundle\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.275709 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.275708 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-console-oauth-config\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.276067 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.275731 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvsnj\" (UniqueName: \"kubernetes.io/projected/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-kube-api-access-bvsnj\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.276067 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.275763 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-service-ca\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.276067 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.275790 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-console-serving-cert\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.276501 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.276461 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-console-config\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.276608 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.276520 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-oauth-serving-cert\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.276608 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.276572 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-trusted-ca-bundle\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.276720 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.276620 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-service-ca\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.278254 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.278232 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-console-oauth-config\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.278358 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.278339 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-console-serving-cert\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.299574 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.299548 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvsnj\" (UniqueName: \"kubernetes.io/projected/7f859b7d-b39b-41f5-b1fd-57337e2f47d5-kube-api-access-bvsnj\") pod \"console-7fd7786c7b-xq48m\" (UID: \"7f859b7d-b39b-41f5-b1fd-57337e2f47d5\") " pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.323615 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.323586 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:45.481284 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.481252 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd7786c7b-xq48m"] Jul 14 15:17:45.482993 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:17:45.482973 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f859b7d_b39b_41f5_b1fd_57337e2f47d5.slice/crio-77a30a251843163483611e5c5b56887d064406870473b02841b45702abf62c50 WatchSource:0}: Error finding container 77a30a251843163483611e5c5b56887d064406870473b02841b45702abf62c50: Status 404 returned error can't find the container with id 77a30a251843163483611e5c5b56887d064406870473b02841b45702abf62c50 Jul 14 15:17:45.526975 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:45.526923 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd7786c7b-xq48m" event={"ID":"7f859b7d-b39b-41f5-b1fd-57337e2f47d5","Type":"ContainerStarted","Data":"77a30a251843163483611e5c5b56887d064406870473b02841b45702abf62c50"} Jul 14 15:17:46.533872 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:46.533839 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd7786c7b-xq48m" event={"ID":"7f859b7d-b39b-41f5-b1fd-57337e2f47d5","Type":"ContainerStarted","Data":"b8566f3d67d37debaf83016e262ce9b1ab8bafb495113ab40972af2248a3c8a6"} Jul 14 15:17:46.555690 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:46.555640 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fd7786c7b-xq48m" podStartSLOduration=2.555625709 podStartE2EDuration="2.555625709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:17:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:17:46.553842899 +0000 UTC m=+435.428504821" watchObservedRunningTime="2026-07-14 15:17:46.555625709 +0000 UTC m=+435.430287629" Jul 14 15:17:53.116260 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.116221 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w"] Jul 14 15:17:53.119648 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.119630 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:17:53.124437 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.124414 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 15:17:53.124810 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.124792 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-79glg\"" Jul 14 15:17:53.125066 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.125049 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 15:17:53.142705 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.142675 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w"] Jul 14 15:17:53.241542 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.241504 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6196e33-b275-4ca8-8f7b-4236a1742ccf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" (UID: \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:17:53.241542 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.241547 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h694w\" (UniqueName: \"kubernetes.io/projected/e6196e33-b275-4ca8-8f7b-4236a1742ccf-kube-api-access-h694w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" (UID: \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:17:53.342340 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.342301 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6196e33-b275-4ca8-8f7b-4236a1742ccf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" (UID: \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:17:53.342563 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.342347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h694w\" (UniqueName: \"kubernetes.io/projected/e6196e33-b275-4ca8-8f7b-4236a1742ccf-kube-api-access-h694w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" (UID: \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:17:53.342725 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.342702 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6196e33-b275-4ca8-8f7b-4236a1742ccf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" (UID: \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:17:53.356520 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.356469 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h694w\" (UniqueName: \"kubernetes.io/projected/e6196e33-b275-4ca8-8f7b-4236a1742ccf-kube-api-access-h694w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" (UID: \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:17:53.430345 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.430312 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:17:53.565756 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:53.565732 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w"] Jul 14 15:17:53.568140 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:17:53.568113 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6196e33_b275_4ca8_8f7b_4236a1742ccf.slice/crio-06e958cb3770707715db114028f86bb83810eb66e7200c9f1328b43c2e57703a WatchSource:0}: Error finding container 06e958cb3770707715db114028f86bb83810eb66e7200c9f1328b43c2e57703a: Status 404 returned error can't find the container with id 06e958cb3770707715db114028f86bb83810eb66e7200c9f1328b43c2e57703a Jul 14 15:17:54.581778 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:54.581699 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" event={"ID":"e6196e33-b275-4ca8-8f7b-4236a1742ccf","Type":"ContainerStarted","Data":"06e958cb3770707715db114028f86bb83810eb66e7200c9f1328b43c2e57703a"} Jul 14 15:17:55.324669 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:55.324632 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:55.324848 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:55.324687 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:55.329788 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:55.329767 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:55.591104 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:55.591025 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fd7786c7b-xq48m" Jul 14 15:17:59.825994 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:59.825946 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4"] Jul 14 15:17:59.829702 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:59.829679 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" Jul 14 15:17:59.832154 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:59.832122 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zkbfq\"" Jul 14 15:17:59.840802 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:59.840774 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4"] Jul 14 15:17:59.903206 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:17:59.903169 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdhxn\" (UniqueName: \"kubernetes.io/projected/bb185cb9-bd74-45ab-a983-8add4afe685d-kube-api-access-qdhxn\") pod \"authorino-operator-75cc8d5cb7-mnhl4\" (UID: \"bb185cb9-bd74-45ab-a983-8add4afe685d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" Jul 14 15:18:00.004106 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:00.004069 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdhxn\" (UniqueName: \"kubernetes.io/projected/bb185cb9-bd74-45ab-a983-8add4afe685d-kube-api-access-qdhxn\") pod \"authorino-operator-75cc8d5cb7-mnhl4\" (UID: \"bb185cb9-bd74-45ab-a983-8add4afe685d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" Jul 14 15:18:00.013285 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:00.013228 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdhxn\" (UniqueName: \"kubernetes.io/projected/bb185cb9-bd74-45ab-a983-8add4afe685d-kube-api-access-qdhxn\") pod \"authorino-operator-75cc8d5cb7-mnhl4\" (UID: \"bb185cb9-bd74-45ab-a983-8add4afe685d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" Jul 14 15:18:00.143973 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:00.143881 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" Jul 14 15:18:00.985388 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:00.985357 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4"] Jul 14 15:18:00.987037 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:18:00.987018 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb185cb9_bd74_45ab_a983_8add4afe685d.slice/crio-906337d43d80ec9ef7c3cfad8ec46a9c1f1f2b677795fe7a10c85345a84273e0 WatchSource:0}: Error finding container 906337d43d80ec9ef7c3cfad8ec46a9c1f1f2b677795fe7a10c85345a84273e0: Status 404 returned error can't find the container with id 906337d43d80ec9ef7c3cfad8ec46a9c1f1f2b677795fe7a10c85345a84273e0 Jul 14 15:18:01.619236 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:01.619198 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" event={"ID":"e6196e33-b275-4ca8-8f7b-4236a1742ccf","Type":"ContainerStarted","Data":"2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e"} Jul 14 15:18:01.619426 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:01.619367 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:18:01.620750 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:01.620722 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" event={"ID":"bb185cb9-bd74-45ab-a983-8add4afe685d","Type":"ContainerStarted","Data":"906337d43d80ec9ef7c3cfad8ec46a9c1f1f2b677795fe7a10c85345a84273e0"} Jul 14 15:18:01.641036 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:01.640980 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" podStartSLOduration=1.297411071 podStartE2EDuration="8.640962697s" totalImagesPullingTime="7.343551626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:18:01.639239785 +0000 UTC m=+450.513901706" watchObservedRunningTime="2026-07-14 15:18:01.640962697 +0000 UTC m=+450.515624617" Jul 14 15:18:03.635798 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:03.635764 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" event={"ID":"bb185cb9-bd74-45ab-a983-8add4afe685d","Type":"ContainerStarted","Data":"94f62679816e51970fa9401487316667d6acc33e567f54f3955d72f9821f34fc"} Jul 14 15:18:03.636169 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:03.635876 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" Jul 14 15:18:03.651663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:03.651621 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" podStartSLOduration=2.084106727 podStartE2EDuration="4.651607058s" totalImagesPullingTime="2.567500331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:18:03.650379582 +0000 UTC m=+452.525041506" watchObservedRunningTime="2026-07-14 15:18:03.651607058 +0000 UTC m=+452.526268979" Jul 14 15:18:12.630084 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:12.630054 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:18:13.875981 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:13.875948 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb"] Jul 14 15:18:13.880810 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:13.880789 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:13.897027 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:13.896997 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb"] Jul 14 15:18:13.915971 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:13.915941 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffd53223-0d47-4231-97b4-d5f77971137a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" (UID: \"ffd53223-0d47-4231-97b4-d5f77971137a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:13.916122 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:13.916042 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-557fc\" (UniqueName: \"kubernetes.io/projected/ffd53223-0d47-4231-97b4-d5f77971137a-kube-api-access-557fc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" (UID: \"ffd53223-0d47-4231-97b4-d5f77971137a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:14.016962 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.016918 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffd53223-0d47-4231-97b4-d5f77971137a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" (UID: \"ffd53223-0d47-4231-97b4-d5f77971137a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:14.017159 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.016983 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-557fc\" (UniqueName: \"kubernetes.io/projected/ffd53223-0d47-4231-97b4-d5f77971137a-kube-api-access-557fc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" (UID: \"ffd53223-0d47-4231-97b4-d5f77971137a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:14.017395 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.017370 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffd53223-0d47-4231-97b4-d5f77971137a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" (UID: \"ffd53223-0d47-4231-97b4-d5f77971137a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:14.028578 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.028550 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-557fc\" (UniqueName: \"kubernetes.io/projected/ffd53223-0d47-4231-97b4-d5f77971137a-kube-api-access-557fc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" (UID: \"ffd53223-0d47-4231-97b4-d5f77971137a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:14.191388 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.191363 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:14.331776 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.331750 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb"] Jul 14 15:18:14.333326 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:18:14.333298 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd53223_0d47_4231_97b4_d5f77971137a.slice/crio-90b2741cc2fcbb2dab1711e67bacc2509a65f03b340232f3db7e7afa38e352d8 WatchSource:0}: Error finding container 90b2741cc2fcbb2dab1711e67bacc2509a65f03b340232f3db7e7afa38e352d8: Status 404 returned error can't find the container with id 90b2741cc2fcbb2dab1711e67bacc2509a65f03b340232f3db7e7afa38e352d8 Jul 14 15:18:14.588913 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.588832 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb"] Jul 14 15:18:14.593527 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.593492 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb"] Jul 14 15:18:14.605166 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.605138 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w"] Jul 14 15:18:14.605376 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.605351 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" podUID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" containerName="manager" containerID="cri-o://2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e" gracePeriod=2 Jul 14 15:18:14.615951 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.615924 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w"] Jul 14 15:18:14.621111 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.620956 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8"] Jul 14 15:18:14.621424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.621407 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" containerName="manager" Jul 14 15:18:14.621424 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.621424 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" containerName="manager" Jul 14 15:18:14.621608 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.621439 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" containerName="manager" Jul 14 15:18:14.621608 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.621444 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" containerName="manager" Jul 14 15:18:14.621608 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.621572 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" containerName="manager" Jul 14 15:18:14.621608 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.621586 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" containerName="manager" Jul 14 15:18:14.622934 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:14.622903 2585 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e6196e33-b275-4ca8-8f7b-4236a1742ccf\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\": pods \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:18:14.624618 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.624602 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:14.627145 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:14.627116 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" is forbidden: User \"system:node:ip-10-0-137-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-89.ec2.internal' and this object" podUID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:18:14.634764 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.634742 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z"] Jul 14 15:18:14.638083 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.638063 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:14.643344 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.643321 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8"] Jul 14 15:18:14.643436 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.643396 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mnhl4" Jul 14 15:18:14.664851 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.664816 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z"] Jul 14 15:18:14.689608 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:14.689582 2585 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" container="manager" Jul 14 15:18:14.689902 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:14.689869 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" is forbidden: User \"system:node:ip-10-0-137-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-89.ec2.internal' and this object" podUID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:18:14.711152 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:14.711115 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" is forbidden: User \"system:node:ip-10-0-137-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-89.ec2.internal' and this object" podUID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:18:14.712958 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:14.712933 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" is forbidden: User \"system:node:ip-10-0-137-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-89.ec2.internal' and this object" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:14.724643 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.724621 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpjn8\" (UniqueName: \"kubernetes.io/projected/3dc60331-c431-4053-a81f-1d8aaa93273e-kube-api-access-bpjn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gv42z\" (UID: \"3dc60331-c431-4053-a81f-1d8aaa93273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:14.724745 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.724706 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3dc60331-c431-4053-a81f-1d8aaa93273e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gv42z\" (UID: \"3dc60331-c431-4053-a81f-1d8aaa93273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:14.724913 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.724894 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0669d1f9-4583-4d47-a583-d2768b3d48c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-khvm8\" (UID: \"0669d1f9-4583-4d47-a583-d2768b3d48c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:14.724989 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.724933 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqp57\" (UniqueName: \"kubernetes.io/projected/0669d1f9-4583-4d47-a583-d2768b3d48c6-kube-api-access-tqp57\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-khvm8\" (UID: \"0669d1f9-4583-4d47-a583-d2768b3d48c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:14.826232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.826200 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqp57\" (UniqueName: \"kubernetes.io/projected/0669d1f9-4583-4d47-a583-d2768b3d48c6-kube-api-access-tqp57\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-khvm8\" (UID: \"0669d1f9-4583-4d47-a583-d2768b3d48c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:14.826232 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.826245 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpjn8\" (UniqueName: \"kubernetes.io/projected/3dc60331-c431-4053-a81f-1d8aaa93273e-kube-api-access-bpjn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gv42z\" (UID: \"3dc60331-c431-4053-a81f-1d8aaa93273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:14.826458 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.826275 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3dc60331-c431-4053-a81f-1d8aaa93273e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gv42z\" (UID: \"3dc60331-c431-4053-a81f-1d8aaa93273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:14.826458 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.826335 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0669d1f9-4583-4d47-a583-d2768b3d48c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-khvm8\" (UID: \"0669d1f9-4583-4d47-a583-d2768b3d48c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:14.826670 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.826650 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3dc60331-c431-4053-a81f-1d8aaa93273e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gv42z\" (UID: \"3dc60331-c431-4053-a81f-1d8aaa93273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:14.826765 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.826742 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0669d1f9-4583-4d47-a583-d2768b3d48c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-khvm8\" (UID: \"0669d1f9-4583-4d47-a583-d2768b3d48c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:14.835987 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.835959 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqp57\" (UniqueName: \"kubernetes.io/projected/0669d1f9-4583-4d47-a583-d2768b3d48c6-kube-api-access-tqp57\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-khvm8\" (UID: \"0669d1f9-4583-4d47-a583-d2768b3d48c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:14.836092 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.835959 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpjn8\" (UniqueName: \"kubernetes.io/projected/3dc60331-c431-4053-a81f-1d8aaa93273e-kube-api-access-bpjn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gv42z\" (UID: \"3dc60331-c431-4053-a81f-1d8aaa93273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:14.840423 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.840374 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:18:14.842599 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:14.842574 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" is forbidden: User \"system:node:ip-10-0-137-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-89.ec2.internal' and this object" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:14.844208 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:14.844184 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8kg8w\" is forbidden: User \"system:node:ip-10-0-137-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-89.ec2.internal' and this object" podUID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:18:14.926977 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.926944 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h694w\" (UniqueName: \"kubernetes.io/projected/e6196e33-b275-4ca8-8f7b-4236a1742ccf-kube-api-access-h694w\") pod \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\" (UID: \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\") " Jul 14 15:18:14.927347 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.927047 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6196e33-b275-4ca8-8f7b-4236a1742ccf-extensions-socket-volume\") pod \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\" (UID: \"e6196e33-b275-4ca8-8f7b-4236a1742ccf\") " Jul 14 15:18:14.927588 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.927563 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6196e33-b275-4ca8-8f7b-4236a1742ccf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e6196e33-b275-4ca8-8f7b-4236a1742ccf" (UID: "e6196e33-b275-4ca8-8f7b-4236a1742ccf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:18:14.928964 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.928943 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6196e33-b275-4ca8-8f7b-4236a1742ccf-kube-api-access-h694w" (OuterVolumeSpecName: "kube-api-access-h694w") pod "e6196e33-b275-4ca8-8f7b-4236a1742ccf" (UID: "e6196e33-b275-4ca8-8f7b-4236a1742ccf"). InnerVolumeSpecName "kube-api-access-h694w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:18:14.978917 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.978883 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:14.987893 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:14.987873 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:15.028373 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.028341 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6196e33-b275-4ca8-8f7b-4236a1742ccf-extensions-socket-volume\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:18:15.028373 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.028372 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h694w\" (UniqueName: \"kubernetes.io/projected/e6196e33-b275-4ca8-8f7b-4236a1742ccf-kube-api-access-h694w\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:18:15.130985 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:18:15.130943 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0669d1f9_4583_4d47_a583_d2768b3d48c6.slice/crio-0e66cbcbbe2afbf3ab4da2b0895ed3c1f72021f33e2130283de31a83ae3dd7bc WatchSource:0}: Error finding container 0e66cbcbbe2afbf3ab4da2b0895ed3c1f72021f33e2130283de31a83ae3dd7bc: Status 404 returned error can't find the container with id 0e66cbcbbe2afbf3ab4da2b0895ed3c1f72021f33e2130283de31a83ae3dd7bc Jul 14 15:18:15.130985 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.130952 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8"] Jul 14 15:18:15.165009 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.164986 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z"] Jul 14 15:18:15.172703 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:18:15.172670 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc60331_c431_4053_a81f_1d8aaa93273e.slice/crio-94b47be2e66928debed0a0c2c076f8ea1a9662d88fdcd612729cbacb8878a005 WatchSource:0}: Error finding container 94b47be2e66928debed0a0c2c076f8ea1a9662d88fdcd612729cbacb8878a005: Status 404 returned error can't find the container with id 94b47be2e66928debed0a0c2c076f8ea1a9662d88fdcd612729cbacb8878a005 Jul 14 15:18:15.651432 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.651397 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" path="/var/lib/kubelet/pods/e6196e33-b275-4ca8-8f7b-4236a1742ccf/volumes" Jul 14 15:18:15.696209 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.696173 2585 generic.go:356] "Generic (PLEG): container finished" podID="e6196e33-b275-4ca8-8f7b-4236a1742ccf" containerID="2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e" exitCode=0 Jul 14 15:18:15.696361 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.696213 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kg8w" Jul 14 15:18:15.696361 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.696268 2585 scope.go:117] "RemoveContainer" containerID="2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e" Jul 14 15:18:15.698107 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.698054 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" event={"ID":"0669d1f9-4583-4d47-a583-d2768b3d48c6","Type":"ContainerStarted","Data":"37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74"} Jul 14 15:18:15.698211 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.698126 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" event={"ID":"0669d1f9-4583-4d47-a583-d2768b3d48c6","Type":"ContainerStarted","Data":"0e66cbcbbe2afbf3ab4da2b0895ed3c1f72021f33e2130283de31a83ae3dd7bc"} Jul 14 15:18:15.698211 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.698160 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:15.699893 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.699868 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" event={"ID":"3dc60331-c431-4053-a81f-1d8aaa93273e","Type":"ContainerStarted","Data":"325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6"} Jul 14 15:18:15.700016 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.699912 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" event={"ID":"3dc60331-c431-4053-a81f-1d8aaa93273e","Type":"ContainerStarted","Data":"94b47be2e66928debed0a0c2c076f8ea1a9662d88fdcd612729cbacb8878a005"} Jul 14 15:18:15.700016 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.699963 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:15.701663 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.701635 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" containerName="manager" containerID="cri-o://51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e" gracePeriod=2 Jul 14 15:18:15.706004 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.705989 2585 scope.go:117] "RemoveContainer" containerID="2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e" Jul 14 15:18:15.706221 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:15.706203 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e\": container with ID starting with 2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e not found: ID does not exist" containerID="2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e" Jul 14 15:18:15.706274 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.706228 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e"} err="failed to get container status \"2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e\": rpc error: code = NotFound desc = could not find container \"2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e\": container with ID starting with 2a6389b1a718ebf527c9fe13bcdfebff66c094cb88820970d0e0ff6b866c901e not found: ID does not exist" Jul 14 15:18:15.723887 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.723844 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" podStartSLOduration=1.723830875 podStartE2EDuration="1.723830875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:18:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:18:15.721718191 +0000 UTC m=+464.596380112" watchObservedRunningTime="2026-07-14 15:18:15.723830875 +0000 UTC m=+464.598492866" Jul 14 15:18:15.743593 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.743544 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" podStartSLOduration=1.743530083 podStartE2EDuration="1.743530083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:18:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:18:15.741114365 +0000 UTC m=+464.615776298" watchObservedRunningTime="2026-07-14 15:18:15.743530083 +0000 UTC m=+464.618192004" Jul 14 15:18:15.941530 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:15.941501 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:15.943694 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:15.943669 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" is forbidden: User \"system:node:ip-10-0-137-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-89.ec2.internal' and this object" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:16.037984 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.037956 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffd53223-0d47-4231-97b4-d5f77971137a-extensions-socket-volume\") pod \"ffd53223-0d47-4231-97b4-d5f77971137a\" (UID: \"ffd53223-0d47-4231-97b4-d5f77971137a\") " Jul 14 15:18:16.038106 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.038051 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-557fc\" (UniqueName: \"kubernetes.io/projected/ffd53223-0d47-4231-97b4-d5f77971137a-kube-api-access-557fc\") pod \"ffd53223-0d47-4231-97b4-d5f77971137a\" (UID: \"ffd53223-0d47-4231-97b4-d5f77971137a\") " Jul 14 15:18:16.038245 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.038222 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffd53223-0d47-4231-97b4-d5f77971137a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ffd53223-0d47-4231-97b4-d5f77971137a" (UID: "ffd53223-0d47-4231-97b4-d5f77971137a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:18:16.040186 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.040159 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffd53223-0d47-4231-97b4-d5f77971137a-kube-api-access-557fc" (OuterVolumeSpecName: "kube-api-access-557fc") pod "ffd53223-0d47-4231-97b4-d5f77971137a" (UID: "ffd53223-0d47-4231-97b4-d5f77971137a"). InnerVolumeSpecName "kube-api-access-557fc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:18:16.139015 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.138981 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-557fc\" (UniqueName: \"kubernetes.io/projected/ffd53223-0d47-4231-97b4-d5f77971137a-kube-api-access-557fc\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:18:16.139015 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.139009 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffd53223-0d47-4231-97b4-d5f77971137a-extensions-socket-volume\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:18:16.707745 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.707710 2585 generic.go:356] "Generic (PLEG): container finished" podID="ffd53223-0d47-4231-97b4-d5f77971137a" containerID="51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e" exitCode=2 Jul 14 15:18:16.707921 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.707752 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:16.707921 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.707814 2585 scope.go:117] "RemoveContainer" containerID="51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e" Jul 14 15:18:16.710394 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:16.710363 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" is forbidden: User \"system:node:ip-10-0-137-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-89.ec2.internal' and this object" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:16.717778 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.717762 2585 scope.go:117] "RemoveContainer" containerID="51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e" Jul 14 15:18:16.718015 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:16.717997 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e\": container with ID starting with 51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e not found: ID does not exist" containerID="51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e" Jul 14 15:18:16.718080 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:16.718027 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e"} err="failed to get container status \"51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e\": rpc error: code = NotFound desc = could not find container \"51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e\": container with ID starting with 51fdcce8553b62e95bc074d2dff72d8871346940eb3052779e4ef3eb59c3cb0e not found: ID does not exist" Jul 14 15:18:16.719395 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:16.719377 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kdnzb\" is forbidden: User \"system:node:ip-10-0-137-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-89.ec2.internal' and this object" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kdnzb" Jul 14 15:18:17.651279 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:17.651238 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffd53223-0d47-4231-97b4-d5f77971137a" path="/var/lib/kubelet/pods/ffd53223-0d47-4231-97b4-d5f77971137a/volumes" Jul 14 15:18:26.711123 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:26.711087 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:26.711551 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:26.711162 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:26.788845 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:26.788813 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z"] Jul 14 15:18:26.789044 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:26.788994 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" podUID="3dc60331-c431-4053-a81f-1d8aaa93273e" containerName="manager" containerID="cri-o://325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6" gracePeriod=10 Jul 14 15:18:26.994574 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:26.994502 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9"] Jul 14 15:18:26.998182 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:26.998162 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:27.018293 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.018269 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9"] Jul 14 15:18:27.036566 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.036540 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:27.133981 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.133949 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpjn8\" (UniqueName: \"kubernetes.io/projected/3dc60331-c431-4053-a81f-1d8aaa93273e-kube-api-access-bpjn8\") pod \"3dc60331-c431-4053-a81f-1d8aaa93273e\" (UID: \"3dc60331-c431-4053-a81f-1d8aaa93273e\") " Jul 14 15:18:27.134143 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.134032 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3dc60331-c431-4053-a81f-1d8aaa93273e-extensions-socket-volume\") pod \"3dc60331-c431-4053-a81f-1d8aaa93273e\" (UID: \"3dc60331-c431-4053-a81f-1d8aaa93273e\") " Jul 14 15:18:27.134143 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.134132 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncw4s\" (UniqueName: \"kubernetes.io/projected/60878942-9a8b-4dfd-b343-a3fcd2b6b950-kube-api-access-ncw4s\") pod \"kuadrant-operator-controller-manager-86878c769f-mr8z9\" (UID: \"60878942-9a8b-4dfd-b343-a3fcd2b6b950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:27.134244 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.134204 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60878942-9a8b-4dfd-b343-a3fcd2b6b950-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mr8z9\" (UID: \"60878942-9a8b-4dfd-b343-a3fcd2b6b950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:27.134406 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.134384 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc60331-c431-4053-a81f-1d8aaa93273e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3dc60331-c431-4053-a81f-1d8aaa93273e" (UID: "3dc60331-c431-4053-a81f-1d8aaa93273e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:18:27.136020 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.135996 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc60331-c431-4053-a81f-1d8aaa93273e-kube-api-access-bpjn8" (OuterVolumeSpecName: "kube-api-access-bpjn8") pod "3dc60331-c431-4053-a81f-1d8aaa93273e" (UID: "3dc60331-c431-4053-a81f-1d8aaa93273e"). InnerVolumeSpecName "kube-api-access-bpjn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:18:27.234811 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.234775 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60878942-9a8b-4dfd-b343-a3fcd2b6b950-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mr8z9\" (UID: \"60878942-9a8b-4dfd-b343-a3fcd2b6b950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:27.234954 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.234830 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncw4s\" (UniqueName: \"kubernetes.io/projected/60878942-9a8b-4dfd-b343-a3fcd2b6b950-kube-api-access-ncw4s\") pod \"kuadrant-operator-controller-manager-86878c769f-mr8z9\" (UID: \"60878942-9a8b-4dfd-b343-a3fcd2b6b950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:27.234954 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.234897 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpjn8\" (UniqueName: \"kubernetes.io/projected/3dc60331-c431-4053-a81f-1d8aaa93273e-kube-api-access-bpjn8\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:18:27.234954 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.234907 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3dc60331-c431-4053-a81f-1d8aaa93273e-extensions-socket-volume\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:18:27.235201 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.235175 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60878942-9a8b-4dfd-b343-a3fcd2b6b950-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mr8z9\" (UID: \"60878942-9a8b-4dfd-b343-a3fcd2b6b950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:27.248848 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.248787 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncw4s\" (UniqueName: \"kubernetes.io/projected/60878942-9a8b-4dfd-b343-a3fcd2b6b950-kube-api-access-ncw4s\") pod \"kuadrant-operator-controller-manager-86878c769f-mr8z9\" (UID: \"60878942-9a8b-4dfd-b343-a3fcd2b6b950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:27.308229 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.308196 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:27.442258 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.442227 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9"] Jul 14 15:18:27.443944 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:18:27.443919 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60878942_9a8b_4dfd_b343_a3fcd2b6b950.slice/crio-407a7f7a8e9fa3b3a739a6a58926c10bb62dfb9e3ec5526b7c775149b5deebf0 WatchSource:0}: Error finding container 407a7f7a8e9fa3b3a739a6a58926c10bb62dfb9e3ec5526b7c775149b5deebf0: Status 404 returned error can't find the container with id 407a7f7a8e9fa3b3a739a6a58926c10bb62dfb9e3ec5526b7c775149b5deebf0 Jul 14 15:18:27.773754 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.773721 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" event={"ID":"60878942-9a8b-4dfd-b343-a3fcd2b6b950","Type":"ContainerStarted","Data":"b03f52b4ccaa15b53feccf550cd2c12d9f0c15ad83364e91d87ccb0aa516b4fb"} Jul 14 15:18:27.774134 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.773873 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:27.774134 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.773918 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" event={"ID":"60878942-9a8b-4dfd-b343-a3fcd2b6b950","Type":"ContainerStarted","Data":"407a7f7a8e9fa3b3a739a6a58926c10bb62dfb9e3ec5526b7c775149b5deebf0"} Jul 14 15:18:27.774996 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.774973 2585 generic.go:356] "Generic (PLEG): container finished" podID="3dc60331-c431-4053-a81f-1d8aaa93273e" containerID="325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6" exitCode=0 Jul 14 15:18:27.775111 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.775005 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" event={"ID":"3dc60331-c431-4053-a81f-1d8aaa93273e","Type":"ContainerDied","Data":"325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6"} Jul 14 15:18:27.775111 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.775011 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" Jul 14 15:18:27.775111 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.775045 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z" event={"ID":"3dc60331-c431-4053-a81f-1d8aaa93273e","Type":"ContainerDied","Data":"94b47be2e66928debed0a0c2c076f8ea1a9662d88fdcd612729cbacb8878a005"} Jul 14 15:18:27.775111 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.775077 2585 scope.go:117] "RemoveContainer" containerID="325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6" Jul 14 15:18:27.783646 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.783631 2585 scope.go:117] "RemoveContainer" containerID="325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6" Jul 14 15:18:27.783866 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:27.783846 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6\": container with ID starting with 325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6 not found: ID does not exist" containerID="325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6" Jul 14 15:18:27.783906 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.783874 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6"} err="failed to get container status \"325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6\": rpc error: code = NotFound desc = could not find container \"325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6\": container with ID starting with 325dec3171bef3cf6e958922ece42d6e5602fc97013b6cd05a135b7cc55ec9e6 not found: ID does not exist" Jul 14 15:18:27.794470 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.794429 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" podStartSLOduration=1.794416135 podStartE2EDuration="1.794416135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:18:27.791948702 +0000 UTC m=+476.666610622" watchObservedRunningTime="2026-07-14 15:18:27.794416135 +0000 UTC m=+476.669078060" Jul 14 15:18:27.808221 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.808197 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z"] Jul 14 15:18:27.811651 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:27.811631 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gv42z"] Jul 14 15:18:29.650431 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:29.650393 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dc60331-c431-4053-a81f-1d8aaa93273e" path="/var/lib/kubelet/pods/3dc60331-c431-4053-a81f-1d8aaa93273e/volumes" Jul 14 15:18:38.783404 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:38.783372 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mr8z9" Jul 14 15:18:38.832731 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:38.832699 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8"] Jul 14 15:18:38.832997 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:38.832948 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" podUID="0669d1f9-4583-4d47-a583-d2768b3d48c6" containerName="manager" containerID="cri-o://37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74" gracePeriod=10 Jul 14 15:18:39.079856 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.079832 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:39.235806 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.235770 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0669d1f9-4583-4d47-a583-d2768b3d48c6-extensions-socket-volume\") pod \"0669d1f9-4583-4d47-a583-d2768b3d48c6\" (UID: \"0669d1f9-4583-4d47-a583-d2768b3d48c6\") " Jul 14 15:18:39.235965 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.235861 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqp57\" (UniqueName: \"kubernetes.io/projected/0669d1f9-4583-4d47-a583-d2768b3d48c6-kube-api-access-tqp57\") pod \"0669d1f9-4583-4d47-a583-d2768b3d48c6\" (UID: \"0669d1f9-4583-4d47-a583-d2768b3d48c6\") " Jul 14 15:18:39.236181 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.236159 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0669d1f9-4583-4d47-a583-d2768b3d48c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0669d1f9-4583-4d47-a583-d2768b3d48c6" (UID: "0669d1f9-4583-4d47-a583-d2768b3d48c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:18:39.237904 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.237876 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0669d1f9-4583-4d47-a583-d2768b3d48c6-kube-api-access-tqp57" (OuterVolumeSpecName: "kube-api-access-tqp57") pod "0669d1f9-4583-4d47-a583-d2768b3d48c6" (UID: "0669d1f9-4583-4d47-a583-d2768b3d48c6"). InnerVolumeSpecName "kube-api-access-tqp57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:18:39.336609 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.336517 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqp57\" (UniqueName: \"kubernetes.io/projected/0669d1f9-4583-4d47-a583-d2768b3d48c6-kube-api-access-tqp57\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:18:39.336609 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.336556 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0669d1f9-4583-4d47-a583-d2768b3d48c6-extensions-socket-volume\") on node \"ip-10-0-137-89.ec2.internal\" DevicePath \"\"" Jul 14 15:18:39.841098 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.841067 2585 generic.go:356] "Generic (PLEG): container finished" podID="0669d1f9-4583-4d47-a583-d2768b3d48c6" containerID="37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74" exitCode=0 Jul 14 15:18:39.841530 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.841124 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" Jul 14 15:18:39.841530 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.841129 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" event={"ID":"0669d1f9-4583-4d47-a583-d2768b3d48c6","Type":"ContainerDied","Data":"37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74"} Jul 14 15:18:39.841530 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.841172 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8" event={"ID":"0669d1f9-4583-4d47-a583-d2768b3d48c6","Type":"ContainerDied","Data":"0e66cbcbbe2afbf3ab4da2b0895ed3c1f72021f33e2130283de31a83ae3dd7bc"} Jul 14 15:18:39.841530 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.841194 2585 scope.go:117] "RemoveContainer" containerID="37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74" Jul 14 15:18:39.850356 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.850325 2585 scope.go:117] "RemoveContainer" containerID="37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74" Jul 14 15:18:39.850674 ip-10-0-137-89 kubenswrapper[2585]: E0714 15:18:39.850653 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74\": container with ID starting with 37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74 not found: ID does not exist" containerID="37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74" Jul 14 15:18:39.850756 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.850686 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74"} err="failed to get container status \"37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74\": rpc error: code = NotFound desc = could not find container \"37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74\": container with ID starting with 37d4aac44586d066deb96920ba1b19a7269af41832a5939a187789e071b2cc74 not found: ID does not exist" Jul 14 15:18:39.863822 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.863794 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8"] Jul 14 15:18:39.865901 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:39.865882 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-khvm8"] Jul 14 15:18:41.651993 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:41.651946 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0669d1f9-4583-4d47-a583-d2768b3d48c6" path="/var/lib/kubelet/pods/0669d1f9-4583-4d47-a583-d2768b3d48c6/volumes" Jul 14 15:18:58.361557 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.361518 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:18:58.361927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.361860 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0669d1f9-4583-4d47-a583-d2768b3d48c6" containerName="manager" Jul 14 15:18:58.361927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.361871 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0669d1f9-4583-4d47-a583-d2768b3d48c6" containerName="manager" Jul 14 15:18:58.361927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.361900 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc60331-c431-4053-a81f-1d8aaa93273e" containerName="manager" Jul 14 15:18:58.361927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.361905 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc60331-c431-4053-a81f-1d8aaa93273e" containerName="manager" Jul 14 15:18:58.362053 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.361958 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0669d1f9-4583-4d47-a583-d2768b3d48c6" containerName="manager" Jul 14 15:18:58.362053 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.361967 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc60331-c431-4053-a81f-1d8aaa93273e" containerName="manager" Jul 14 15:18:58.364021 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.364003 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:18:58.366448 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.366423 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 15:18:58.366448 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.366438 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xq8sb\"" Jul 14 15:18:58.372555 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.372534 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:18:58.397368 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.397337 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:18:58.399559 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.399539 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71de2c13-b09c-4278-bae0-45930af23e15-config-file\") pod \"limitador-limitador-54d6d988d5-mxb4k\" (UID: \"71de2c13-b09c-4278-bae0-45930af23e15\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:18:58.399649 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.399584 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2rlb\" (UniqueName: \"kubernetes.io/projected/71de2c13-b09c-4278-bae0-45930af23e15-kube-api-access-n2rlb\") pod \"limitador-limitador-54d6d988d5-mxb4k\" (UID: \"71de2c13-b09c-4278-bae0-45930af23e15\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:18:58.500431 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.500396 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71de2c13-b09c-4278-bae0-45930af23e15-config-file\") pod \"limitador-limitador-54d6d988d5-mxb4k\" (UID: \"71de2c13-b09c-4278-bae0-45930af23e15\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:18:58.500618 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.500447 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2rlb\" (UniqueName: \"kubernetes.io/projected/71de2c13-b09c-4278-bae0-45930af23e15-kube-api-access-n2rlb\") pod \"limitador-limitador-54d6d988d5-mxb4k\" (UID: \"71de2c13-b09c-4278-bae0-45930af23e15\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:18:58.501147 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.501126 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71de2c13-b09c-4278-bae0-45930af23e15-config-file\") pod \"limitador-limitador-54d6d988d5-mxb4k\" (UID: \"71de2c13-b09c-4278-bae0-45930af23e15\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:18:58.508264 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.508214 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2rlb\" (UniqueName: \"kubernetes.io/projected/71de2c13-b09c-4278-bae0-45930af23e15-kube-api-access-n2rlb\") pod \"limitador-limitador-54d6d988d5-mxb4k\" (UID: \"71de2c13-b09c-4278-bae0-45930af23e15\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:18:58.675214 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.675131 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:18:58.808237 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.808213 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:18:58.810114 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:18:58.810078 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71de2c13_b09c_4278_bae0_45930af23e15.slice/crio-bdcebea9a3d5c994d3fed8bce5a4b97e53dede40417a3d57a2edf718f5c4a441 WatchSource:0}: Error finding container bdcebea9a3d5c994d3fed8bce5a4b97e53dede40417a3d57a2edf718f5c4a441: Status 404 returned error can't find the container with id bdcebea9a3d5c994d3fed8bce5a4b97e53dede40417a3d57a2edf718f5c4a441 Jul 14 15:18:58.940009 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:18:58.939980 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" event={"ID":"71de2c13-b09c-4278-bae0-45930af23e15","Type":"ContainerStarted","Data":"bdcebea9a3d5c994d3fed8bce5a4b97e53dede40417a3d57a2edf718f5c4a441"} Jul 14 15:19:02.962032 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:19:02.961992 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" event={"ID":"71de2c13-b09c-4278-bae0-45930af23e15","Type":"ContainerStarted","Data":"9209f0db1ef0a0ed901d603beebd6a47ff4fbca38501de48559b8a70fa5fb0ec"} Jul 14 15:19:02.962408 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:19:02.962123 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:19:02.980469 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:19:02.980424 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" podStartSLOduration=0.988682338 podStartE2EDuration="4.980410516s" totalImagesPullingTime="3.991728178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:19:02.978511227 +0000 UTC m=+511.853173141" watchObservedRunningTime="2026-07-14 15:19:02.980410516 +0000 UTC m=+511.855072437" Jul 14 15:19:13.968640 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:19:13.968608 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxb4k" Jul 14 15:20:20.088038 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:20:20.088002 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:20:31.565802 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:20:31.565776 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:20:31.567114 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:20:31.567082 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:20:36.198850 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:20:36.198811 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:20:50.885736 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:20:50.885642 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:20:56.298133 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:20:56.298045 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:21:03.093674 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:03.093636 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:21:06.910781 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.910734 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9"] Jul 14 15:21:06.913474 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.913447 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:06.917755 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.917729 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 15:21:06.917886 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.917729 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dxjjb\"" Jul 14 15:21:06.917886 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.917809 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 15:21:06.918353 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.918339 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 15:21:06.946132 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.946098 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9"] Jul 14 15:21:06.991533 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.991474 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mg7b\" (UniqueName: \"kubernetes.io/projected/f290f17d-4adf-4f6b-92fc-94e103848f0c-kube-api-access-6mg7b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:06.991694 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.991578 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:06.991694 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.991612 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:06.991694 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.991642 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f290f17d-4adf-4f6b-92fc-94e103848f0c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:06.991694 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.991687 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:06.991841 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:06.991743 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.092554 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.092521 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.092740 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.092572 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.092740 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.092599 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mg7b\" (UniqueName: \"kubernetes.io/projected/f290f17d-4adf-4f6b-92fc-94e103848f0c-kube-api-access-6mg7b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.092740 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.092628 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.092740 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.092647 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.092740 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.092665 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f290f17d-4adf-4f6b-92fc-94e103848f0c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.092993 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.092967 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.093053 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.093011 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.093104 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.093056 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.094893 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.094867 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f290f17d-4adf-4f6b-92fc-94e103848f0c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.095144 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.095129 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f290f17d-4adf-4f6b-92fc-94e103848f0c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.101409 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.101385 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mg7b\" (UniqueName: \"kubernetes.io/projected/f290f17d-4adf-4f6b-92fc-94e103848f0c-kube-api-access-6mg7b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6bnl9\" (UID: \"f290f17d-4adf-4f6b-92fc-94e103848f0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.223813 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.223782 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:07.361994 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.361970 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9"] Jul 14 15:21:07.363637 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:21:07.363610 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf290f17d_4adf_4f6b_92fc_94e103848f0c.slice/crio-217e56f773ca2709e986955ca0f60d856457b708a8c3fbbffcb3fa3a04e08117 WatchSource:0}: Error finding container 217e56f773ca2709e986955ca0f60d856457b708a8c3fbbffcb3fa3a04e08117: Status 404 returned error can't find the container with id 217e56f773ca2709e986955ca0f60d856457b708a8c3fbbffcb3fa3a04e08117 Jul 14 15:21:07.365127 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.365111 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 15:21:07.607348 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:07.607259 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" event={"ID":"f290f17d-4adf-4f6b-92fc-94e103848f0c","Type":"ContainerStarted","Data":"217e56f773ca2709e986955ca0f60d856457b708a8c3fbbffcb3fa3a04e08117"} Jul 14 15:21:09.191789 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:09.191748 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:21:09.619786 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:09.619695 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" event={"ID":"f290f17d-4adf-4f6b-92fc-94e103848f0c","Type":"ContainerStarted","Data":"22de37ed9493bd596a0f8fe6589a0925465f7d2f0ea2f7ae32e9431a80435828"} Jul 14 15:21:09.639167 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:09.639115 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" podStartSLOduration=2.359734153 podStartE2EDuration="3.639098979s" totalImagesPullingTime="1.279364826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:21:09.63785276 +0000 UTC m=+638.512514672" watchObservedRunningTime="2026-07-14 15:21:09.639098979 +0000 UTC m=+638.513760900" Jul 14 15:21:17.224209 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:17.224173 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:17.224673 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:17.224237 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:17.238290 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:17.238261 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:17.673451 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:17.673373 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6bnl9" Jul 14 15:21:20.996874 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:21:20.996836 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:25:08.691278 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:25:08.691238 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:25:18.689675 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:25:18.689637 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:25:29.484105 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:25:29.484067 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:25:31.600042 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:25:31.600015 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:25:31.602404 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:25:31.602372 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:25:39.592669 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:25:39.592630 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:25:49.485898 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:25:49.485857 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:26:19.192836 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:26:19.192799 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:26:31.890796 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:26:31.890760 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxb4k"] Jul 14 15:27:13.136717 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:13.136681 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-95cfc_bd83681f-84c7-4423-a8d2-898e722d1303/manager/0.log" Jul 14 15:27:13.652665 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:13.652633 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8676d5649d-hjzhv_ee387303-ef55-43c5-8de5-59b9ea46a856/copy-manifests/0.log" Jul 14 15:27:13.665057 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:13.665031 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8676d5649d-hjzhv_ee387303-ef55-43c5-8de5-59b9ea46a856/manager/0.log" Jul 14 15:27:15.417740 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.417707 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp_c3992806-9cf1-4eac-a803-c2dbb7261bf6/util/0.log" Jul 14 15:27:15.423859 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.423837 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp_c3992806-9cf1-4eac-a803-c2dbb7261bf6/pull/0.log" Jul 14 15:27:15.430244 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.430224 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp_c3992806-9cf1-4eac-a803-c2dbb7261bf6/extract/0.log" Jul 14 15:27:15.561047 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.561009 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw_3927ae27-5400-4153-ab63-97f6582e3860/util/0.log" Jul 14 15:27:15.567701 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.567681 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw_3927ae27-5400-4153-ab63-97f6582e3860/pull/0.log" Jul 14 15:27:15.574215 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.574195 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw_3927ae27-5400-4153-ab63-97f6582e3860/extract/0.log" Jul 14 15:27:15.714770 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.714735 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh_068dd508-692d-4006-9aba-2f9c4f3120cb/util/0.log" Jul 14 15:27:15.720566 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.720545 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh_068dd508-692d-4006-9aba-2f9c4f3120cb/pull/0.log" Jul 14 15:27:15.726016 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.725998 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh_068dd508-692d-4006-9aba-2f9c4f3120cb/extract/0.log" Jul 14 15:27:15.848783 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.848751 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk_5fe570b5-e0cd-4dfb-b7ca-71906dd3260b/util/0.log" Jul 14 15:27:15.854609 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.854589 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk_5fe570b5-e0cd-4dfb-b7ca-71906dd3260b/pull/0.log" Jul 14 15:27:15.862879 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:15.862863 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk_5fe570b5-e0cd-4dfb-b7ca-71906dd3260b/extract/0.log" Jul 14 15:27:16.137928 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:16.137846 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mnhl4_bb185cb9-bd74-45ab-a983-8add4afe685d/manager/0.log" Jul 14 15:27:16.698633 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:16.698603 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mr8z9_60878942-9a8b-4dfd-b343-a3fcd2b6b950/manager/0.log" Jul 14 15:27:16.866405 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:16.866378 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mxb4k_71de2c13-b09c-4278-bae0-45930af23e15/limitador/0.log" Jul 14 15:27:17.554004 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:17.553976 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zqlq6_c6516aa2-53bc-4e7e-94ab-e501a4a97650/discovery/0.log" Jul 14 15:27:17.817330 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:17.817230 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754cbb886-rqhhn_ce1af933-4f3d-464e-a94d-1155a57c97f6/kube-auth-proxy/0.log" Jul 14 15:27:18.362172 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:18.362137 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f6bcfb954-zx7cm_2b004017-332e-4387-9412-3a85c4fd503b/router/0.log" Jul 14 15:27:19.318964 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:19.318930 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-6bnl9_f290f17d-4adf-4f6b-92fc-94e103848f0c/main/0.log" Jul 14 15:27:24.160027 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.159988 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6pw6b/must-gather-6mzw7"] Jul 14 15:27:24.163597 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.163566 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pw6b/must-gather-6mzw7" Jul 14 15:27:24.166121 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.166094 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6pw6b\"/\"default-dockercfg-5zgz8\"" Jul 14 15:27:24.166875 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.166858 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6pw6b\"/\"openshift-service-ca.crt\"" Jul 14 15:27:24.166976 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.166895 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6pw6b\"/\"kube-root-ca.crt\"" Jul 14 15:27:24.179061 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.179038 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6pw6b/must-gather-6mzw7"] Jul 14 15:27:24.206626 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.206592 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjqvv\" (UniqueName: \"kubernetes.io/projected/62993cb9-9fa5-49f0-a8e5-858d393dc320-kube-api-access-xjqvv\") pod \"must-gather-6mzw7\" (UID: \"62993cb9-9fa5-49f0-a8e5-858d393dc320\") " pod="openshift-must-gather-6pw6b/must-gather-6mzw7" Jul 14 15:27:24.206763 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.206701 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/62993cb9-9fa5-49f0-a8e5-858d393dc320-must-gather-output\") pod \"must-gather-6mzw7\" (UID: \"62993cb9-9fa5-49f0-a8e5-858d393dc320\") " pod="openshift-must-gather-6pw6b/must-gather-6mzw7" Jul 14 15:27:24.307817 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.307779 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/62993cb9-9fa5-49f0-a8e5-858d393dc320-must-gather-output\") pod \"must-gather-6mzw7\" (UID: \"62993cb9-9fa5-49f0-a8e5-858d393dc320\") " pod="openshift-must-gather-6pw6b/must-gather-6mzw7" Jul 14 15:27:24.307992 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.307835 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjqvv\" (UniqueName: \"kubernetes.io/projected/62993cb9-9fa5-49f0-a8e5-858d393dc320-kube-api-access-xjqvv\") pod \"must-gather-6mzw7\" (UID: \"62993cb9-9fa5-49f0-a8e5-858d393dc320\") " pod="openshift-must-gather-6pw6b/must-gather-6mzw7" Jul 14 15:27:24.308204 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.308183 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/62993cb9-9fa5-49f0-a8e5-858d393dc320-must-gather-output\") pod \"must-gather-6mzw7\" (UID: \"62993cb9-9fa5-49f0-a8e5-858d393dc320\") " pod="openshift-must-gather-6pw6b/must-gather-6mzw7" Jul 14 15:27:24.316937 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.316907 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjqvv\" (UniqueName: \"kubernetes.io/projected/62993cb9-9fa5-49f0-a8e5-858d393dc320-kube-api-access-xjqvv\") pod \"must-gather-6mzw7\" (UID: \"62993cb9-9fa5-49f0-a8e5-858d393dc320\") " pod="openshift-must-gather-6pw6b/must-gather-6mzw7" Jul 14 15:27:24.473453 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.473423 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pw6b/must-gather-6mzw7" Jul 14 15:27:24.606848 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.606819 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6pw6b/must-gather-6mzw7"] Jul 14 15:27:24.608709 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:27:24.608683 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62993cb9_9fa5_49f0_a8e5_858d393dc320.slice/crio-d4532456c30e8ff9a2c8ebf3bad3344a0214ab0a67973182a5e9cb04ba5395cd WatchSource:0}: Error finding container d4532456c30e8ff9a2c8ebf3bad3344a0214ab0a67973182a5e9cb04ba5395cd: Status 404 returned error can't find the container with id d4532456c30e8ff9a2c8ebf3bad3344a0214ab0a67973182a5e9cb04ba5395cd Jul 14 15:27:24.610528 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:24.610508 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 15:27:25.548657 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:25.548578 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pw6b/must-gather-6mzw7" event={"ID":"62993cb9-9fa5-49f0-a8e5-858d393dc320","Type":"ContainerStarted","Data":"7fd586ab3d0f41ee82f5da97be0eb901178813691a0b10451660d7192094a2d9"} Jul 14 15:27:25.548657 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:25.548626 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pw6b/must-gather-6mzw7" event={"ID":"62993cb9-9fa5-49f0-a8e5-858d393dc320","Type":"ContainerStarted","Data":"d4532456c30e8ff9a2c8ebf3bad3344a0214ab0a67973182a5e9cb04ba5395cd"} Jul 14 15:27:26.560324 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:26.559500 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pw6b/must-gather-6mzw7" event={"ID":"62993cb9-9fa5-49f0-a8e5-858d393dc320","Type":"ContainerStarted","Data":"33dee8e6049cf1142e772ead5994816ba3f9a346b52633211f6c6e9228a2c925"} Jul 14 15:27:26.578705 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:26.578654 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6pw6b/must-gather-6mzw7" podStartSLOduration=1.7461821610000001 podStartE2EDuration="2.578636824s" totalImagesPullingTime="832.454663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:27:26.577205402 +0000 UTC m=+1015.451867324" watchObservedRunningTime="2026-07-14 15:27:26.578636824 +0000 UTC m=+1015.453298745" Jul 14 15:27:27.124957 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:27.124923 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zq7j2_a4a6247b-81bd-4835-ae81-f0a07a52af12/global-pull-secret-syncer/0.log" Jul 14 15:27:27.221460 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:27.221419 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hvgvs_9f012efc-dc5c-4bfd-8c7e-fd87bb0acbb8/konnectivity-agent/0.log" Jul 14 15:27:27.245214 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:27.245188 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-89.ec2.internal_337d027ddbda42a4cd3b3abf536a25de/haproxy/0.log" Jul 14 15:27:31.790954 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:31.790922 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp_c3992806-9cf1-4eac-a803-c2dbb7261bf6/extract/0.log" Jul 14 15:27:31.815444 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:31.815414 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp_c3992806-9cf1-4eac-a803-c2dbb7261bf6/util/0.log" Jul 14 15:27:31.838335 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:31.838289 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h5vjp_c3992806-9cf1-4eac-a803-c2dbb7261bf6/pull/0.log" Jul 14 15:27:31.867551 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:31.867518 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw_3927ae27-5400-4153-ab63-97f6582e3860/extract/0.log" Jul 14 15:27:31.902535 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:31.902505 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw_3927ae27-5400-4153-ab63-97f6582e3860/util/0.log" Jul 14 15:27:31.925822 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:31.925795 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k2ctw_3927ae27-5400-4153-ab63-97f6582e3860/pull/0.log" Jul 14 15:27:31.951966 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:31.951937 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh_068dd508-692d-4006-9aba-2f9c4f3120cb/extract/0.log" Jul 14 15:27:31.974096 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:31.974065 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh_068dd508-692d-4006-9aba-2f9c4f3120cb/util/0.log" Jul 14 15:27:32.000060 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:32.000032 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v56sh_068dd508-692d-4006-9aba-2f9c4f3120cb/pull/0.log" Jul 14 15:27:32.030150 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:32.030123 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk_5fe570b5-e0cd-4dfb-b7ca-71906dd3260b/extract/0.log" Jul 14 15:27:32.052213 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:32.052122 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk_5fe570b5-e0cd-4dfb-b7ca-71906dd3260b/util/0.log" Jul 14 15:27:32.085860 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:32.085808 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12d2wk_5fe570b5-e0cd-4dfb-b7ca-71906dd3260b/pull/0.log" Jul 14 15:27:32.189652 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:32.189613 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mnhl4_bb185cb9-bd74-45ab-a983-8add4afe685d/manager/0.log" Jul 14 15:27:32.359946 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:32.359829 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mr8z9_60878942-9a8b-4dfd-b343-a3fcd2b6b950/manager/0.log" Jul 14 15:27:32.410216 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:32.410186 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mxb4k_71de2c13-b09c-4278-bae0-45930af23e15/limitador/0.log" Jul 14 15:27:34.244269 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.244234 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-p54tz_ab6c4c34-acab-4cf2-b1df-d81dcda1124b/cluster-monitoring-operator/0.log" Jul 14 15:27:34.383085 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.383038 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-cqtvv_7d95850d-30bf-4f9f-86ad-eb6656945648/monitoring-plugin/0.log" Jul 14 15:27:34.570341 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.570229 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcbvr_30beda90-6df6-4ab6-bccc-9b0a81ba676e/node-exporter/0.log" Jul 14 15:27:34.601092 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.601047 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcbvr_30beda90-6df6-4ab6-bccc-9b0a81ba676e/kube-rbac-proxy/0.log" Jul 14 15:27:34.621701 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.621669 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcbvr_30beda90-6df6-4ab6-bccc-9b0a81ba676e/init-textfile/0.log" Jul 14 15:27:34.656500 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.656458 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bxkcq_fcdc436c-fba2-43f1-a937-9a946e14a191/kube-rbac-proxy-main/0.log" Jul 14 15:27:34.679112 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.679069 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bxkcq_fcdc436c-fba2-43f1-a937-9a946e14a191/kube-rbac-proxy-self/0.log" Jul 14 15:27:34.699865 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.699840 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bxkcq_fcdc436c-fba2-43f1-a937-9a946e14a191/openshift-state-metrics/0.log" Jul 14 15:27:34.906282 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.905957 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-zl5dn_957c4103-1af0-4a2b-b6c3-ee047c4d96c9/prometheus-operator/0.log" Jul 14 15:27:34.925939 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.925904 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-zl5dn_957c4103-1af0-4a2b-b6c3-ee047c4d96c9/kube-rbac-proxy/0.log" Jul 14 15:27:34.950325 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:34.950289 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-rczqs_54c0f3c2-f2e9-40ab-a4fd-26b3dd9e4c24/prometheus-operator-admission-webhook/0.log" Jul 14 15:27:35.072472 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:35.072444 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d9b574688-p69th_904cf864-9048-47bd-aa34-212fd7370086/thanos-query/0.log" Jul 14 15:27:35.092271 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:35.092235 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d9b574688-p69th_904cf864-9048-47bd-aa34-212fd7370086/kube-rbac-proxy-web/0.log" Jul 14 15:27:35.112701 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:35.112673 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d9b574688-p69th_904cf864-9048-47bd-aa34-212fd7370086/kube-rbac-proxy/0.log" Jul 14 15:27:35.133168 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:35.133135 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d9b574688-p69th_904cf864-9048-47bd-aa34-212fd7370086/prom-label-proxy/0.log" Jul 14 15:27:35.158617 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:35.158474 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d9b574688-p69th_904cf864-9048-47bd-aa34-212fd7370086/kube-rbac-proxy-rules/0.log" Jul 14 15:27:35.178323 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:35.178298 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d9b574688-p69th_904cf864-9048-47bd-aa34-212fd7370086/kube-rbac-proxy-metrics/0.log" Jul 14 15:27:37.039044 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.039003 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4"] Jul 14 15:27:37.045885 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.045851 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.051890 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.051860 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4"] Jul 14 15:27:37.140252 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.140212 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-sys\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.140586 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.140563 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-lib-modules\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.140747 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.140732 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-podres\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.140912 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.140898 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-proc\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.141049 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.141034 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jprh\" (UniqueName: \"kubernetes.io/projected/05966ad8-4d2a-4a98-888d-dc653f017c34-kube-api-access-8jprh\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.242200 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.242158 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-sys\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.242391 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.242278 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-sys\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.242391 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.242294 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-lib-modules\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.242391 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.242321 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-podres\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.242391 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.242351 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-proc\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.242623 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.242413 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-proc\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.242623 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.242416 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jprh\" (UniqueName: \"kubernetes.io/projected/05966ad8-4d2a-4a98-888d-dc653f017c34-kube-api-access-8jprh\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.242623 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.242467 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-podres\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.242623 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.242501 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05966ad8-4d2a-4a98-888d-dc653f017c34-lib-modules\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.252155 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.252116 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jprh\" (UniqueName: \"kubernetes.io/projected/05966ad8-4d2a-4a98-888d-dc653f017c34-kube-api-access-8jprh\") pod \"perf-node-gather-daemonset-z8qk4\" (UID: \"05966ad8-4d2a-4a98-888d-dc653f017c34\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.361335 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.361246 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:37.555677 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.554561 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4"] Jul 14 15:27:37.558372 ip-10-0-137-89 kubenswrapper[2585]: W0714 15:27:37.558333 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05966ad8_4d2a_4a98_888d_dc653f017c34.slice/crio-8489aeed818110431b374c114b899610c45f1a029b3e46659245124edddb9140 WatchSource:0}: Error finding container 8489aeed818110431b374c114b899610c45f1a029b3e46659245124edddb9140: Status 404 returned error can't find the container with id 8489aeed818110431b374c114b899610c45f1a029b3e46659245124edddb9140 Jul 14 15:27:37.629449 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.629425 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fd7786c7b-xq48m_7f859b7d-b39b-41f5-b1fd-57337e2f47d5/console/0.log" Jul 14 15:27:37.651818 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:37.651790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" event={"ID":"05966ad8-4d2a-4a98-888d-dc653f017c34","Type":"ContainerStarted","Data":"8489aeed818110431b374c114b899610c45f1a029b3e46659245124edddb9140"} Jul 14 15:27:38.659437 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:38.659405 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" event={"ID":"05966ad8-4d2a-4a98-888d-dc653f017c34","Type":"ContainerStarted","Data":"92cac6e8734a59953a209265a8d214e3a1acf1fd1c9d49bb457401789b1068fa"} Jul 14 15:27:38.659881 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:38.659512 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:38.676501 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:38.676425 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" podStartSLOduration=1.676405006 podStartE2EDuration="1.676405006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:27:38.675883205 +0000 UTC m=+1027.550545129" watchObservedRunningTime="2026-07-14 15:27:38.676405006 +0000 UTC m=+1027.551066929" Jul 14 15:27:39.285721 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:39.285690 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2r877_daf0970a-8472-44cc-b652-63d930a8314a/dns/0.log" Jul 14 15:27:39.307927 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:39.307897 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2r877_daf0970a-8472-44cc-b652-63d930a8314a/kube-rbac-proxy/0.log" Jul 14 15:27:39.453591 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:39.453562 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jt4bd_8aefa2d6-4dd1-4a6c-aba0-980d23df0f42/dns-node-resolver/0.log" Jul 14 15:27:40.031701 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:40.031667 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sfsv6_d46a976a-5e32-4f3c-a844-24aa323c4ffd/node-ca/0.log" Jul 14 15:27:41.057622 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:41.057589 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zqlq6_c6516aa2-53bc-4e7e-94ab-e501a4a97650/discovery/0.log" Jul 14 15:27:41.103104 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:41.103071 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754cbb886-rqhhn_ce1af933-4f3d-464e-a94d-1155a57c97f6/kube-auth-proxy/0.log" Jul 14 15:27:41.204367 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:41.204338 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f6bcfb954-zx7cm_2b004017-332e-4387-9412-3a85c4fd503b/router/0.log" Jul 14 15:27:41.848649 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:41.848591 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6mltn_247a017f-af9c-4894-ac46-1eb4c984514c/serve-healthcheck-canary/0.log" Jul 14 15:27:42.356786 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:42.356757 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-8g5z7_fa0b72a7-399a-4de4-9383-3b1735d30641/insights-operator/0.log" Jul 14 15:27:42.357282 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:42.357261 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-8g5z7_fa0b72a7-399a-4de4-9383-3b1735d30641/insights-operator/1.log" Jul 14 15:27:42.376217 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:42.376196 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5h6q4_4b84b9a6-0934-471d-87ec-203ed1d6e002/kube-rbac-proxy/0.log" Jul 14 15:27:42.396804 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:42.396780 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5h6q4_4b84b9a6-0934-471d-87ec-203ed1d6e002/exporter/0.log" Jul 14 15:27:42.416148 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:42.416121 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5h6q4_4b84b9a6-0934-471d-87ec-203ed1d6e002/extractor/0.log" Jul 14 15:27:44.676850 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:44.676821 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-z8qk4" Jul 14 15:27:44.852442 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:44.852413 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-95cfc_bd83681f-84c7-4423-a8d2-898e722d1303/manager/0.log" Jul 14 15:27:44.997853 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:44.997780 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8676d5649d-hjzhv_ee387303-ef55-43c5-8de5-59b9ea46a856/manager/0.log" Jul 14 15:27:45.013714 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:45.013686 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8676d5649d-hjzhv_ee387303-ef55-43c5-8de5-59b9ea46a856/copy-manifests/0.log" Jul 14 15:27:46.541650 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:46.541606 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pkqnx_7b599a67-7648-4c20-8306-1170caaed7e6/openshift-lws-operator/0.log" Jul 14 15:27:47.501201 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:47.501172 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zqlq6_c6516aa2-53bc-4e7e-94ab-e501a4a97650/discovery/0.log" Jul 14 15:27:47.533635 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:47.533606 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754cbb886-rqhhn_ce1af933-4f3d-464e-a94d-1155a57c97f6/kube-auth-proxy/0.log" Jul 14 15:27:47.608751 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:47.608723 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f6bcfb954-zx7cm_2b004017-332e-4387-9412-3a85c4fd503b/router/0.log" Jul 14 15:27:48.771039 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:48.771010 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zqlq6_c6516aa2-53bc-4e7e-94ab-e501a4a97650/discovery/0.log" Jul 14 15:27:48.802824 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:48.802797 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754cbb886-rqhhn_ce1af933-4f3d-464e-a94d-1155a57c97f6/kube-auth-proxy/0.log" Jul 14 15:27:48.884905 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:48.884865 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f6bcfb954-zx7cm_2b004017-332e-4387-9412-3a85c4fd503b/router/0.log" Jul 14 15:27:53.189692 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.189665 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhmb8_6513bd8b-e3f7-4b46-8145-97d98ddc5dc4/kube-multus-additional-cni-plugins/0.log" Jul 14 15:27:53.210084 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.210061 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhmb8_6513bd8b-e3f7-4b46-8145-97d98ddc5dc4/egress-router-binary-copy/0.log" Jul 14 15:27:53.232819 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.232793 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhmb8_6513bd8b-e3f7-4b46-8145-97d98ddc5dc4/cni-plugins/0.log" Jul 14 15:27:53.254194 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.254165 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhmb8_6513bd8b-e3f7-4b46-8145-97d98ddc5dc4/bond-cni-plugin/0.log" Jul 14 15:27:53.275802 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.275775 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhmb8_6513bd8b-e3f7-4b46-8145-97d98ddc5dc4/routeoverride-cni/0.log" Jul 14 15:27:53.296558 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.296531 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhmb8_6513bd8b-e3f7-4b46-8145-97d98ddc5dc4/whereabouts-cni-bincopy/0.log" Jul 14 15:27:53.318713 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.318687 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhmb8_6513bd8b-e3f7-4b46-8145-97d98ddc5dc4/whereabouts-cni/0.log" Jul 14 15:27:53.526112 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.526026 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wwhqt_ca8e4bb9-9873-450a-9016-29c671599bfd/kube-multus/0.log" Jul 14 15:27:53.549910 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.549881 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6qjr4_10fc53e3-505f-404c-a379-c96f6c1e0ef4/network-metrics-daemon/0.log" Jul 14 15:27:53.571033 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:53.571005 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6qjr4_10fc53e3-505f-404c-a379-c96f6c1e0ef4/kube-rbac-proxy/0.log" Jul 14 15:27:54.654287 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:54.654253 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-controller/0.log" Jul 14 15:27:54.670919 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:54.670895 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/1.log" Jul 14 15:27:54.671071 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:54.670921 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/ovn-acl-logging/0.log" Jul 14 15:27:54.689192 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:54.689160 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/kube-rbac-proxy-node/0.log" Jul 14 15:27:54.710321 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:54.710289 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/kube-rbac-proxy-ovn-metrics/0.log" Jul 14 15:27:54.729759 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:54.729730 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/northd/0.log" Jul 14 15:27:54.752149 ip-10-0-137-89 kubenswrapper[2585]: I0714 15:27:54.752126 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8khwt_8ad40ef9-c129-40f8-87c3-31ad85ca85b8/nbdb/0.log"