Jul 02 14:46:13.061232 ip-10-0-141-121 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 14:46:13.061241 ip-10-0-141-121 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 14:46:13.061248 ip-10-0-141-121 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 14:46:13.061493 ip-10-0-141-121 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 14:46:23.128049 ip-10-0-141-121 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 14:46:23.128070 ip-10-0-141-121 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot dbd8f1ac849c413d90fdaf62fa2299f0 -- Jul 02 14:48:24.241625 ip-10-0-141-121 systemd[1]: Starting Kubernetes Kubelet... Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.284284 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289047 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289059 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289063 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289066 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289069 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289072 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:26.326655 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289078 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289083 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289088 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289091 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289094 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289097 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289100 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289102 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289105 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289109 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289111 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289114 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289116 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289119 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289127 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289130 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289133 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289135 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289138 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289141 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:26.329067 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289143 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289147 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289149 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289152 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289155 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289158 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289160 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289163 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289166 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289168 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289171 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289173 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289176 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289179 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289183 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289187 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289190 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289192 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289195 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289198 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:26.329939 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289200 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289204 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289206 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289209 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289212 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289214 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289217 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289219 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289222 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289224 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289227 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289229 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289232 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289234 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289237 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289241 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289243 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289246 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289248 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289250 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:26.331693 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289253 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289256 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289258 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289261 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289264 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289267 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289269 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289272 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289274 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289277 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289279 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289282 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289284 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289288 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289291 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289294 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289296 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289299 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289302 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289304 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:26.332570 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289307 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289310 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289312 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289315 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289317 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289320 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289322 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289325 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289328 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289345 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289350 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289354 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.289358 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290060 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290066 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290069 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290072 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290074 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290077 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:26.334302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290080 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290083 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290085 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290088 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290090 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290093 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290096 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290098 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290101 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290104 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290108 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290112 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290115 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290118 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290121 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290124 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290126 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290129 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290132 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:26.335178 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290135 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290138 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290141 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290144 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290147 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290149 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290152 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290154 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290156 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290159 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290162 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290164 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290166 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290169 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290172 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290174 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290177 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290179 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290182 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290185 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:26.336058 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290187 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290190 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290193 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290196 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290198 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290201 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290203 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290206 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290210 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290213 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290216 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290219 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290221 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290224 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290226 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290230 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290233 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290235 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290238 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290240 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:26.336937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290243 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290245 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290248 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290251 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290254 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290257 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290262 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290266 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290268 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290271 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290274 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290276 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290279 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290283 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290286 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290289 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290292 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290295 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290298 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:26.337819 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290301 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290304 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290307 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290310 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290313 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290315 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290318 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290320 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290323 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290325 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290328 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290345 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290347 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290350 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290352 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290707 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290712 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290715 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290718 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290721 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:26.338671 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290724 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290727 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290730 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290733 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290735 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290738 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290740 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290743 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290745 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290748 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290750 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290753 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290755 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290758 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290761 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290763 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290766 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290769 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290771 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290774 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:26.339559 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290776 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290779 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290785 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290787 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290790 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290792 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290795 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290797 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290799 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290803 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290807 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290810 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290813 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290817 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290820 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290822 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290825 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290828 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290831 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:26.340654 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290834 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290836 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290839 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290841 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290844 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290848 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290852 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290855 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290858 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290861 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290864 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290867 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290870 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290874 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290876 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290880 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290883 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290886 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290889 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:26.341542 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290892 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290894 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290897 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290899 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290902 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290904 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290908 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290911 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290915 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290917 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290920 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290923 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290925 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290928 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290930 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290933 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290935 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290938 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290940 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290943 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:26.342617 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290946 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290948 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290951 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290953 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290956 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290959 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290961 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290964 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290967 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290969 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290972 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290974 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290977 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290979 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290982 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.290984 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291056 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291062 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291068 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291072 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291078 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 14:48:26.343492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291081 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291086 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291090 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291094 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291097 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291100 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291103 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291106 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291109 2566 flags.go:64] FLAG: --cgroup-root="" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291113 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291115 2566 flags.go:64] FLAG: --client-ca-file="" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291118 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291121 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291126 2566 flags.go:64] FLAG: --cluster-domain="" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291129 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291132 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291135 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291138 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291142 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291147 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291150 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291153 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291156 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291159 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 14:48:26.344593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291161 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291165 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291168 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291172 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291175 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291178 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291181 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291185 2566 flags.go:64] FLAG: --enable-server="true" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291189 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291193 2566 flags.go:64] FLAG: --event-burst="100" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291196 2566 flags.go:64] FLAG: --event-qps="50" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291199 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291201 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291204 2566 flags.go:64] FLAG: --eviction-hard="" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291213 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291216 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291219 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291222 2566 flags.go:64] FLAG: --eviction-soft="" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291225 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291228 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291230 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291233 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291236 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291239 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291242 2566 flags.go:64] FLAG: --feature-gates="" Jul 02 14:48:26.346363 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291245 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291248 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291253 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291256 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291259 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291262 2566 flags.go:64] FLAG: --help="false" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291264 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291267 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291270 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291273 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291276 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291280 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291283 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291285 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291290 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291293 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291302 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291305 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291308 2566 flags.go:64] FLAG: --kube-reserved="" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291311 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291314 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291317 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291319 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291322 2566 flags.go:64] FLAG: --lock-file="" Jul 02 14:48:26.347453 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291325 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291328 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291343 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291349 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291352 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291354 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291357 2566 flags.go:64] FLAG: --logging-format="text" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291360 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291364 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291367 2566 flags.go:64] FLAG: --manifest-url="" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291371 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291375 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291378 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291382 2566 flags.go:64] FLAG: --max-pods="110" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291385 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291388 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291391 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291394 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291397 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291400 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291402 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291409 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291414 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291417 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 14:48:26.349628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291420 2566 flags.go:64] FLAG: --pod-cidr="" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291428 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291433 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291435 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291438 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291441 2566 flags.go:64] FLAG: --port="10250" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291448 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291451 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09778fabe3da29588" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291454 2566 flags.go:64] FLAG: --qos-reserved="" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291457 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291460 2566 flags.go:64] FLAG: --register-node="true" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291463 2566 flags.go:64] FLAG: --register-with-taints="" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291466 2566 flags.go:64] FLAG: --registry-burst="10" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291469 2566 flags.go:64] FLAG: --registry-qps="5" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291472 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291475 2566 flags.go:64] FLAG: --reserved-memory="" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291479 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291482 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291486 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291489 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291492 2566 flags.go:64] FLAG: --runonce="false" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291494 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291497 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291500 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291503 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 14:48:26.350715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291506 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291509 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291512 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291515 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291518 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291521 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291526 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291528 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291531 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291535 2566 flags.go:64] FLAG: --system-cgroups="" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291537 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291543 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291546 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291548 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291552 2566 flags.go:64] FLAG: --tls-min-version="" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291555 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291558 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291561 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291564 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291567 2566 flags.go:64] FLAG: --v="2" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291571 2566 flags.go:64] FLAG: --version="false" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291575 2566 flags.go:64] FLAG: --vmodule="" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291578 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.291581 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291694 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:26.352243 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291698 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291703 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291707 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291710 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291712 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291716 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291720 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291723 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291726 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291729 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291732 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291735 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291737 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291741 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291744 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291747 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291749 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291752 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291755 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:26.353344 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291758 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291760 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291762 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291765 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291768 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291771 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291773 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291776 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291778 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291781 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291783 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291786 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291788 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291792 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291795 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291797 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291800 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291802 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291805 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291807 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:26.354227 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291810 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291813 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291815 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291818 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291820 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291823 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291827 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291829 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291832 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291835 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291837 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291840 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291843 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291845 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291848 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291850 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291854 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291857 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291860 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291863 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:26.355119 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291865 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291868 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291871 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291873 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291876 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291880 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291882 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291885 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291887 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291890 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291892 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291895 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291897 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291900 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291902 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291904 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291907 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291910 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291913 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291916 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:26.355995 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291919 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291921 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291924 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291927 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291930 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291932 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291935 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291937 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291940 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291942 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291945 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291948 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291950 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291953 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291955 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291958 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291961 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291965 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:26.357892 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.291968 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.292834 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.300796 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.300812 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.300828 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.300834 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300899 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300906 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300909 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300912 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300917 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300920 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300922 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300926 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300934 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:26.358764 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300937 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300941 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300944 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300954 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300958 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300962 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300965 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300968 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300970 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300974 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300977 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300980 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300985 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300988 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300991 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300993 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.300997 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301000 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301003 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:26.359423 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301008 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301013 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301017 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301020 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301024 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301026 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301030 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301036 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301039 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301042 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301046 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301048 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301051 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301054 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301058 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301060 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301063 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301072 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301075 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301079 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:26.360319 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301082 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301084 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301087 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301089 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301091 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301096 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301098 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301102 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301106 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301109 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301114 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301117 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301120 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301123 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301128 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301130 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301134 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301138 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301140 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301143 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:26.362078 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301147 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301150 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301152 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301155 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301159 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301162 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301164 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301167 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301170 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301173 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301183 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301186 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301188 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301192 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301196 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301198 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301201 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301206 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301209 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301211 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:26.439914 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301214 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:26.372399 ip-10-0-141-121 systemd[1]: Started Kubernetes Kubelet. Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301217 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301220 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301223 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301226 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301229 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301233 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301236 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301239 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301243 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301245 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.301251 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301434 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301439 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:26.440721 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301442 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301446 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301449 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301452 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301455 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301459 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301463 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301467 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301471 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301479 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301482 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301485 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301488 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301491 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301493 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301497 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301502 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301504 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301507 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:26.441302 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301510 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301513 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301515 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301519 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301523 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301526 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301529 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301533 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301535 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301538 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301541 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301545 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301548 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301551 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301554 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301557 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301560 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301562 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301566 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301569 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:26.442004 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301571 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301574 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301577 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301586 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301591 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301594 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301596 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301599 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301602 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301607 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301609 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301613 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301616 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301619 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301621 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301625 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301628 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301632 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301636 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301639 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:26.442650 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301642 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301644 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301648 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301650 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301653 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301655 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301659 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301662 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301664 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301667 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301670 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301674 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301676 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301680 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301684 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301686 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301695 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301698 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301700 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:26.443733 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301703 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301706 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301711 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301713 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301716 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301718 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301722 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301725 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301729 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301733 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301737 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301740 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301742 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301745 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301748 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301752 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301755 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301757 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:26.444834 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:26.301760 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.301765 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.301889 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.305842 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.307415 2566 server.go:1019] "Starting client certificate rotation" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.307529 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.307566 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.310795 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.318450 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.333155 2566 log.go:25] "Validated CRI v1 runtime API" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.335490 2566 log.go:25] "Validated CRI v1 image API" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.336971 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 14:48:26.446283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.340093 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:48:26.447161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.342545 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 851c2fd6-4e74-4b5e-95e2-6b75b4363bf7:/dev/nvme0n1p4 bea4929d-eec7-4d89-8bf4-668fcaa28e78:/dev/nvme0n1p3] Jul 02 14:48:26.447161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.342567 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.348508 2566 manager.go:216] Machine: {Timestamp:2026-07-02 14:48:26.347093126 +0000 UTC m=+0.389895645 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099874 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec282afc39e51e705483e85b9acfce3f SystemUUID:ec282afc-39e5-1e70-5483-e85b9acfce3f BootID:dbd8f1ac-849c-413d-90fd-af62fa2299f0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:c1:a3:29:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:c1:a3:29:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:85:5a:5c:b5:1c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.349025 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.349136 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.352481 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.352503 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.354189 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.354199 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.354210 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.355154 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.356397 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.359692 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.359805 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.359831 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.359841 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.359856 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.359865 2566 kubelet.go:398] "Adding apiserver pod source" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.359874 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 14:48:26.448609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.360260 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.360277 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.362493 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.363452 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r6dqb" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.364718 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.364746 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365630 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365643 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365649 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365654 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365662 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365668 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365732 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365738 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365745 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365750 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365759 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.365768 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.366597 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.366610 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.369602 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.370251 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r6dqb" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.370400 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.370410 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.370469 2566 server.go:1268] "Started kubelet" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.370543 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.370642 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.370687 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.372524 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.374457 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.379084 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.380674 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-121.ec2.internal.18be806c97673a7e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-121.ec2.internal,UID:ip-10-0-141-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-121.ec2.internal,},FirstTimestamp:2026-07-02 14:48:26.370243198 +0000 UTC m=+0.413045594,LastTimestamp:2026-07-02 14:48:26.370243198 +0000 UTC m=+0.413045594,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-121.ec2.internal,}" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.383311 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.383347 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.383737 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.383965 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.383979 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.383965 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.384100 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.384108 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 02 14:48:26.449684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.385404 2566 factory.go:55] Registering systemd factory Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.385420 2566 factory.go:223] Registration of the systemd container factory successfully Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.385648 2566 factory.go:153] Registering CRI-O factory Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.385663 2566 factory.go:223] Registration of the crio container factory successfully Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.385715 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.385740 2566 factory.go:103] Registering Raw factory Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.385756 2566 manager.go:1196] Started watching for new ooms in manager Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.386123 2566 manager.go:349] Starting recovery of all containers Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.396200 2566 manager.go:354] Recovery completed Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.400680 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.402983 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.404400 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-121.ec2.internal\" not found" node="ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.404904 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.404933 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.404947 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.405909 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.405918 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.405938 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.405973 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.406646 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.406669 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.406680 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.407163 2566 policy_none.go:49] "None policy: Start" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.407174 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.407184 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.408248 2566 policy_none.go:47] "Start" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.445089 2566 manager.go:337] "Starting Device Plugin manager" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.445243 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.445254 2566 server.go:87] "Starting device plugin registration server" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.445465 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.445476 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.445774 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.445834 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.445840 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.446405 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 14:48:26.451390 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.446448 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.502267 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.503608 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.503636 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.503661 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.503701 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.506217 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.546241 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.547094 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.547121 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.547132 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.547157 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.555601 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.561024 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.555618 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-121.ec2.internal\": node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:26.582299 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.572940 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.604364 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal"] Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.604428 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.605889 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.605916 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.605930 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.607544 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.607681 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.607704 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.608237 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.608246 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.608261 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.608269 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.608273 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.608278 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.609978 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.609997 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.610686 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.610703 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.610717 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.639878 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-121.ec2.internal\" not found" node="ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.644329 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-121.ec2.internal\" not found" node="ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.673709 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.692258 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.692278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.728291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.692295 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff8112a09a92e79e1fba8f9541e6f8d7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-121.ec2.internal\" (UID: \"ff8112a09a92e79e1fba8f9541e6f8d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.814161 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.774537 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:26.814161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.792877 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.814161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.792900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.814161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.792939 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.814161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.792959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff8112a09a92e79e1fba8f9541e6f8d7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-121.ec2.internal\" (UID: \"ff8112a09a92e79e1fba8f9541e6f8d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.814161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.792992 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff8112a09a92e79e1fba8f9541e6f8d7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-121.ec2.internal\" (UID: \"ff8112a09a92e79e1fba8f9541e6f8d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.814161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.793027 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 14:48:26.881318 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.875238 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.020028 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.943681 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 14:48:27.020028 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:26.947748 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 14:48:27.020028 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:26.976248 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.184682 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:27.077213 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.184682 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:27.178067 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.278438 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:27.278413 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.306886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.306853 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 14:48:27.307023 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.306985 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 14:48:27.307084 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.307037 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 14:48:27.378753 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:27.378730 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.379706 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.379684 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 14:43:26 +0000 UTC" deadline="2027-12-01 14:11:04.425871461 +0000 UTC" Jul 02 14:48:27.379768 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.379707 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12407h22m37.046168466s" Jul 02 14:48:27.479192 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:27.479161 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.551312 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:27.551279 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8112a09a92e79e1fba8f9541e6f8d7.slice/crio-a8d689bdac70586fa6312b4ccf829d0977221a5ccc7e34eae800dbcd51a7cc71 WatchSource:0}: Error finding container a8d689bdac70586fa6312b4ccf829d0977221a5ccc7e34eae800dbcd51a7cc71: Status 404 returned error can't find the container with id a8d689bdac70586fa6312b4ccf829d0977221a5ccc7e34eae800dbcd51a7cc71 Jul 02 14:48:27.551765 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:27.551744 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdda60bf425dadd7b86ec2242e37edb6.slice/crio-75bb9b398f6d4e4c2bb4c8bd01e0ab4acea64a98cb6345475783a3773960fc5b WatchSource:0}: Error finding container 75bb9b398f6d4e4c2bb4c8bd01e0ab4acea64a98cb6345475783a3773960fc5b: Status 404 returned error can't find the container with id 75bb9b398f6d4e4c2bb4c8bd01e0ab4acea64a98cb6345475783a3773960fc5b Jul 02 14:48:27.555852 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.555837 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:48:27.579995 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:27.579975 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.580708 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.580693 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:27.680510 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:27.680477 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.781106 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:27.781029 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 14:48:27.813384 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.813364 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:27.884459 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.884440 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 14:48:27.896049 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.896034 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:48:27.897008 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.896997 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 14:48:27.905591 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:27.905578 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:48:28.354433 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.354402 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:28.360737 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.360632 2566 apiserver.go:52] "Watching apiserver" Jul 02 14:48:28.371184 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.370893 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 14:48:28.372249 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.372221 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal","openshift-multus/multus-additional-cni-plugins-mbjsw","openshift-multus/multus-jc929","openshift-multus/network-metrics-daemon-dtbhn","openshift-network-diagnostics/network-check-target-c676w","openshift-ovn-kubernetes/ovnkube-node-zpq6f","kube-system/global-pull-secret-syncer-k5c5h","kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz","openshift-cluster-node-tuning-operator/tuned-q9lkt","openshift-image-registry/node-ca-52d67","openshift-network-operator/iptables-alerter-kfqll","kube-system/konnectivity-agent-rcc5v","openshift-dns/node-resolver-42pcg"] Jul 02 14:48:28.374017 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.373986 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:28.374148 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.374085 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:28.375294 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.375272 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:28.377271 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.376577 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jc929" Jul 02 14:48:28.377705 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.377688 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:28.377791 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.377754 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:28.379113 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.378974 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:28.379113 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.379071 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:28.381558 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.380161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.382317 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.381686 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.382317 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.381906 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 14:48:28.382508 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.382420 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 14:48:28.382623 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.382602 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rs9p2\"" Jul 02 14:48:28.382701 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.382627 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 14:48:28.382893 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.382876 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 14:48:28.382973 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.382921 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 14:48:28.383142 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.383124 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 14:48:28.383142 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.383138 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v82j7\"" Jul 02 14:48:28.383372 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.383357 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.383732 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.383710 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 14:48:28.383856 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.383833 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 14:48:28.384202 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.384184 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zmsnh\"" Jul 02 14:48:28.384487 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.384470 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 14:48:28.384726 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.384708 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 14:48:28.384829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.384813 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 14:48:28.384914 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.384894 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 14:48:28.385088 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.385067 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 14:48:28.385251 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.385222 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 14:48:28.385398 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.385359 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xsv9l\"" Jul 02 14:48:28.385565 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.385549 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.387428 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.387326 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.388320 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.387852 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 14:48:28.388320 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.388066 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 14:48:28.388320 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.388222 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 14:48:28.388607 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.388538 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.389760 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.389742 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.392829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.392807 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fhnnm\"" Jul 02 14:48:28.392965 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.392948 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 14:48:28.393140 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.393124 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 14:48:28.393189 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.393146 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 14:48:28.393288 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.393268 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 14:48:28.393356 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.393319 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 14:48:28.393446 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.393407 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 14:48:28.393553 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.393532 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rj5sp\"" Jul 02 14:48:28.393694 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.393679 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 14:48:28.393789 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.393772 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 14:48:28.394006 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.393989 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qhdmv\"" Jul 02 14:48:28.394131 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.394117 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:48:28.394236 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.394220 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:48:28.394312 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.394265 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 14:48:28.394514 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.394489 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-95kgg\"" Jul 02 14:48:28.394643 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.394625 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nmwvh\"" Jul 02 14:48:28.403147 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-var-lib-kubelet\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.403246 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-host\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.403246 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403202 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.403376 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb84c\" (UniqueName: \"kubernetes.io/projected/df2cf761-aad7-44b7-8161-2d5fb4811a4b-kube-api-access-gb84c\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.403376 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-run-netns\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.403376 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-var-lib-kubelet\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.403600 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vtjh\" (UniqueName: \"kubernetes.io/projected/ed7db27e-fa51-4c39-83b3-747609b46f63-kube-api-access-2vtjh\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:28.403600 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-systemd-units\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.403600 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-socket-dir-parent\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.403600 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403480 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-var-lib-cni-multus\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.403600 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-conf-dir\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.403600 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df2cf761-aad7-44b7-8161-2d5fb4811a4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.403887 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403692 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a430c8b7-7624-4e58-8631-35e012585f01-dbus\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:28.403887 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-tuned\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.403887 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403842 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-node-log\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.404014 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.403980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-os-release\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.404095 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjzcj\" (UniqueName: \"kubernetes.io/projected/d262182d-2ff7-4c24-93ee-257f5dc28cb4-kube-api-access-fjzcj\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.404095 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-systemd\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.404095 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404072 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-kubelet\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.404224 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c988b0bc-e4f6-494b-ac73-e311157d09ed-env-overrides\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.404224 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6553e047-9e28-4ea2-92bc-9110169bb3f5-konnectivity-ca\") pod \"konnectivity-agent-rcc5v\" (UID: \"6553e047-9e28-4ea2-92bc-9110169bb3f5\") " pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:28.404224 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:28.404224 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404221 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-modprobe-d\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.404425 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404250 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-var-lib-openvswitch\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.404425 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-log-socket\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.404425 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c988b0bc-e4f6-494b-ac73-e311157d09ed-ovnkube-config\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.404425 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.404425 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d262182d-2ff7-4c24-93ee-257f5dc28cb4-cni-binary-copy\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.404425 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404417 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-sys\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.404684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-lib-modules\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.404684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404488 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-system-cni-dir\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.404684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404517 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-cnibin\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.404684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-var-lib-cni-bin\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.404684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404597 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:28.404684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-run-systemd\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.404684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-run-openvswitch\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404700 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c988b0bc-e4f6-494b-ac73-e311157d09ed-ovnkube-script-lib\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-cnibin\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-socket-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404791 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-sysctl-conf\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404825 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-run-netns\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-cni-bin\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404887 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr8ck\" (UniqueName: \"kubernetes.io/projected/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-kube-api-access-kr8ck\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.405005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.404980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a430c8b7-7624-4e58-8631-35e012585f01-kubelet-config\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-etc-openvswitch\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405043 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-cni-netd\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-system-cni-dir\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-hostroot\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-device-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405165 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c988b0bc-e4f6-494b-ac73-e311157d09ed-ovn-node-metrics-cert\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-os-release\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-sys-fs\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405251 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-sysctl-d\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-run\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405312 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-slash\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-daemon-config\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405396 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-etc-kubernetes\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405422 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d165d31f-741f-45c7-822c-752f0af54a09-tmp-dir\") pod \"node-resolver-42pcg\" (UID: \"d165d31f-741f-45c7-822c-752f0af54a09\") " pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnr2n\" (UniqueName: \"kubernetes.io/projected/d165d31f-741f-45c7-822c-752f0af54a09-kube-api-access-pnr2n\") pod \"node-resolver-42pcg\" (UID: \"d165d31f-741f-45c7-822c-752f0af54a09\") " pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6553e047-9e28-4ea2-92bc-9110169bb3f5-agent-certs\") pod \"konnectivity-agent-rcc5v\" (UID: \"6553e047-9e28-4ea2-92bc-9110169bb3f5\") " pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:28.405536 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-run-multus-certs\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405548 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-kubernetes\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405576 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df2cf761-aad7-44b7-8161-2d5fb4811a4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df2cf761-aad7-44b7-8161-2d5fb4811a4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-sysconfig\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bf0bcd1-c36c-49bc-aa67-343442806e76-tmp\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405728 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-run-ovn\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405767 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5lvf\" (UniqueName: \"kubernetes.io/projected/c988b0bc-e4f6-494b-ac73-e311157d09ed-kube-api-access-b5lvf\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405800 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-cni-dir\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405863 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-run-k8s-cni-cncf-io\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-registration-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7r5q\" (UniqueName: \"kubernetes.io/projected/0bf0bcd1-c36c-49bc-aa67-343442806e76-kube-api-access-v7r5q\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.405961 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.406417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.406002 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d165d31f-741f-45c7-822c-752f0af54a09-hosts-file\") pod \"node-resolver-42pcg\" (UID: \"d165d31f-741f-45c7-822c-752f0af54a09\") " pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.419250 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.419061 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:48:28.471689 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.471655 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9c8db" Jul 02 14:48:28.485207 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.484859 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9c8db" Jul 02 14:48:28.485460 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.485369 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-sys-fs\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-sysctl-d\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-run\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-slash\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506609 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-sys-fs\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-daemon-config\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506649 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-etc-kubernetes\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b452d0c-4883-462b-828f-daf3e42d7c08-host\") pod \"node-ca-52d67\" (UID: \"7b452d0c-4883-462b-828f-daf3e42d7c08\") " pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d165d31f-741f-45c7-822c-752f0af54a09-tmp-dir\") pod \"node-resolver-42pcg\" (UID: \"d165d31f-741f-45c7-822c-752f0af54a09\") " pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnr2n\" (UniqueName: \"kubernetes.io/projected/d165d31f-741f-45c7-822c-752f0af54a09-kube-api-access-pnr2n\") pod \"node-resolver-42pcg\" (UID: \"d165d31f-741f-45c7-822c-752f0af54a09\") " pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506742 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-run\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6553e047-9e28-4ea2-92bc-9110169bb3f5-agent-certs\") pod \"konnectivity-agent-rcc5v\" (UID: \"6553e047-9e28-4ea2-92bc-9110169bb3f5\") " pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-run-multus-certs\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-kubernetes\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506847 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-sysctl-d\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.507778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506864 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df2cf761-aad7-44b7-8161-2d5fb4811a4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506893 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df2cf761-aad7-44b7-8161-2d5fb4811a4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506918 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-sysconfig\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bf0bcd1-c36c-49bc-aa67-343442806e76-tmp\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-run-ovn\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.506986 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5lvf\" (UniqueName: \"kubernetes.io/projected/c988b0bc-e4f6-494b-ac73-e311157d09ed-kube-api-access-b5lvf\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-cni-dir\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507034 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-run-k8s-cni-cncf-io\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-registration-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7r5q\" (UniqueName: \"kubernetes.io/projected/0bf0bcd1-c36c-49bc-aa67-343442806e76-kube-api-access-v7r5q\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507133 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d165d31f-741f-45c7-822c-752f0af54a09-hosts-file\") pod \"node-resolver-42pcg\" (UID: \"d165d31f-741f-45c7-822c-752f0af54a09\") " pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507142 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d165d31f-741f-45c7-822c-752f0af54a09-tmp-dir\") pod \"node-resolver-42pcg\" (UID: \"d165d31f-741f-45c7-822c-752f0af54a09\") " pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7b452d0c-4883-462b-828f-daf3e42d7c08-serviceca\") pod \"node-ca-52d67\" (UID: \"7b452d0c-4883-462b-828f-daf3e42d7c08\") " pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-var-lib-kubelet\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507210 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-slash\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507225 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-host\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.508698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb84c\" (UniqueName: \"kubernetes.io/projected/df2cf761-aad7-44b7-8161-2d5fb4811a4b-kube-api-access-gb84c\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507302 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-run-netns\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507325 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-var-lib-kubelet\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507367 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vtjh\" (UniqueName: \"kubernetes.io/projected/ed7db27e-fa51-4c39-83b3-747609b46f63-kube-api-access-2vtjh\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507392 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd64r\" (UniqueName: \"kubernetes.io/projected/7b452d0c-4883-462b-828f-daf3e42d7c08-kube-api-access-fd64r\") pod \"node-ca-52d67\" (UID: \"7b452d0c-4883-462b-828f-daf3e42d7c08\") " pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507426 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-systemd-units\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-socket-dir-parent\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507477 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-var-lib-cni-multus\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507500 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-conf-dir\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d213268f-4b26-4ffd-96e5-efa05204e840-iptables-alerter-script\") pod \"iptables-alerter-kfqll\" (UID: \"d213268f-4b26-4ffd-96e5-efa05204e840\") " pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-daemon-config\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507838 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-etc-kubernetes\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df2cf761-aad7-44b7-8161-2d5fb4811a4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507905 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a430c8b7-7624-4e58-8631-35e012585f01-dbus\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-tuned\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-node-log\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.509540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.507983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-os-release\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjzcj\" (UniqueName: \"kubernetes.io/projected/d262182d-2ff7-4c24-93ee-257f5dc28cb4-kube-api-access-fjzcj\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-systemd\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-kubelet\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c988b0bc-e4f6-494b-ac73-e311157d09ed-env-overrides\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508132 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6553e047-9e28-4ea2-92bc-9110169bb3f5-konnectivity-ca\") pod \"konnectivity-agent-rcc5v\" (UID: \"6553e047-9e28-4ea2-92bc-9110169bb3f5\") " pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-modprobe-d\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508213 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-var-lib-openvswitch\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-log-socket\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c988b0bc-e4f6-494b-ac73-e311157d09ed-ovnkube-config\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508311 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d262182d-2ff7-4c24-93ee-257f5dc28cb4-cni-binary-copy\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508349 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-sys\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508380 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-lib-modules\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508414 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-system-cni-dir\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508438 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-cnibin\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.510355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-var-lib-cni-bin\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508495 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrz8x\" (UniqueName: \"kubernetes.io/projected/d213268f-4b26-4ffd-96e5-efa05204e840-kube-api-access-mrz8x\") pod \"iptables-alerter-kfqll\" (UID: \"d213268f-4b26-4ffd-96e5-efa05204e840\") " pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508548 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-run-systemd\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-run-openvswitch\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508601 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c988b0bc-e4f6-494b-ac73-e311157d09ed-ovnkube-script-lib\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508627 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-cnibin\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508658 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-socket-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-sysctl-conf\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508711 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-run-netns\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508736 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-cni-bin\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508761 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508786 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508812 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr8ck\" (UniqueName: \"kubernetes.io/projected/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-kube-api-access-kr8ck\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508840 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a430c8b7-7624-4e58-8631-35e012585f01-kubelet-config\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508866 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-etc-openvswitch\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-cni-netd\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.511170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508931 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-system-cni-dir\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.511967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508958 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-hostroot\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.511967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.508993 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-device-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.511967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.509019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c988b0bc-e4f6-494b-ac73-e311157d09ed-ovn-node-metrics-cert\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.511967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.509043 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-os-release\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.511967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.509070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d213268f-4b26-4ffd-96e5-efa05204e840-host-slash\") pod \"iptables-alerter-kfqll\" (UID: \"d213268f-4b26-4ffd-96e5-efa05204e840\") " pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.511967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.509234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a430c8b7-7624-4e58-8631-35e012585f01-dbus\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:28.511967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.509539 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 14:48:28.511967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.511850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-node-log\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.511967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.511917 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-os-release\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.512412 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.512100 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-log-socket\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.512412 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.512151 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-kubelet\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.512508 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.512413 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:28.512508 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.512485 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:29.012465611 +0000 UTC m=+3.055268013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:28.512624 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.512574 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-lib-modules\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.512673 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.512645 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c988b0bc-e4f6-494b-ac73-e311157d09ed-ovnkube-config\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.512736 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.512717 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-systemd\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.512790 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.512752 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.512790 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.512777 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-system-cni-dir\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.512929 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.512906 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c988b0bc-e4f6-494b-ac73-e311157d09ed-env-overrides\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.513110 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513086 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-cnibin\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.513212 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6553e047-9e28-4ea2-92bc-9110169bb3f5-konnectivity-ca\") pod \"konnectivity-agent-rcc5v\" (UID: \"6553e047-9e28-4ea2-92bc-9110169bb3f5\") " pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:28.513264 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513228 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d262182d-2ff7-4c24-93ee-257f5dc28cb4-cni-binary-copy\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.513319 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513277 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-cni-dir\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513374 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-socket-dir-parent\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-systemd-units\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-os-release\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513437 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-run-ovn\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513467 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-run-netns\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513486 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-sysconfig\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-host\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513538 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-registration-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513593 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-var-lib-kubelet\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513608 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df2cf761-aad7-44b7-8161-2d5fb4811a4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-var-lib-cni-bin\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513692 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513740 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-sys\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513743 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-var-lib-kubelet\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513773 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-run-k8s-cni-cncf-io\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513790 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-multus-conf-dir\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.514654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-modprobe-d\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513888 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-socket-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513899 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d165d31f-741f-45c7-822c-752f0af54a09-hosts-file\") pod \"node-resolver-42pcg\" (UID: \"d165d31f-741f-45c7-822c-752f0af54a09\") " pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-cni-netd\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-run-systemd\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513941 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-run-netns\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513960 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-run-openvswitch\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-cni-bin\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513994 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-sysctl-conf\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513999 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df2cf761-aad7-44b7-8161-2d5fb4811a4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514035 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a430c8b7-7624-4e58-8631-35e012585f01-kubelet-config\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514040 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514071 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-system-cni-dir\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514105 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-run-multus-certs\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514136 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-etc-openvswitch\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514175 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-kubernetes\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-host-var-lib-cni-multus\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514219 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-device-dir\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.515829 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.514247 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514262 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df2cf761-aad7-44b7-8161-2d5fb4811a4b-cnibin\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514295 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d262182d-2ff7-4c24-93ee-257f5dc28cb4-hostroot\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.514301 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret podName:a430c8b7-7624-4e58-8631-35e012585f01 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:29.014285028 +0000 UTC m=+3.057087429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret") pod "global-pull-secret-syncer-k5c5h" (UID: "a430c8b7-7624-4e58-8631-35e012585f01") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.513695 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514353 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c988b0bc-e4f6-494b-ac73-e311157d09ed-var-lib-openvswitch\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514471 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c988b0bc-e4f6-494b-ac73-e311157d09ed-ovnkube-script-lib\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.514655 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df2cf761-aad7-44b7-8161-2d5fb4811a4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.515249 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bf0bcd1-c36c-49bc-aa67-343442806e76-etc-tuned\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.515397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6553e047-9e28-4ea2-92bc-9110169bb3f5-agent-certs\") pod \"konnectivity-agent-rcc5v\" (UID: \"6553e047-9e28-4ea2-92bc-9110169bb3f5\") " pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.515872 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" event={"ID":"bdda60bf425dadd7b86ec2242e37edb6","Type":"ContainerStarted","Data":"75bb9b398f6d4e4c2bb4c8bd01e0ab4acea64a98cb6345475783a3773960fc5b"} Jul 02 14:48:28.516885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.516178 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bf0bcd1-c36c-49bc-aa67-343442806e76-tmp\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.517527 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.517376 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" event={"ID":"ff8112a09a92e79e1fba8f9541e6f8d7","Type":"ContainerStarted","Data":"a8d689bdac70586fa6312b4ccf829d0977221a5ccc7e34eae800dbcd51a7cc71"} Jul 02 14:48:28.517930 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.517746 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c988b0bc-e4f6-494b-ac73-e311157d09ed-ovn-node-metrics-cert\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.535749 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.535724 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnr2n\" (UniqueName: \"kubernetes.io/projected/d165d31f-741f-45c7-822c-752f0af54a09-kube-api-access-pnr2n\") pod \"node-resolver-42pcg\" (UID: \"d165d31f-741f-45c7-822c-752f0af54a09\") " pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.537871 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.537849 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjzcj\" (UniqueName: \"kubernetes.io/projected/d262182d-2ff7-4c24-93ee-257f5dc28cb4-kube-api-access-fjzcj\") pod \"multus-jc929\" (UID: \"d262182d-2ff7-4c24-93ee-257f5dc28cb4\") " pod="openshift-multus/multus-jc929" Jul 02 14:48:28.542949 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.542928 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:28.543197 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.542953 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:28.543197 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.542967 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tx5lf for pod openshift-network-diagnostics/network-check-target-c676w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:28.543197 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:28.543029 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf podName:a8ef5a74-167d-4685-b9e4-e6ab26c445d2 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:29.043012841 +0000 UTC m=+3.085815242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tx5lf" (UniqueName: "kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf") pod "network-check-target-c676w" (UID: "a8ef5a74-167d-4685-b9e4-e6ab26c445d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:28.546481 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.546461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vtjh\" (UniqueName: \"kubernetes.io/projected/ed7db27e-fa51-4c39-83b3-747609b46f63-kube-api-access-2vtjh\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:28.546573 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.546553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5lvf\" (UniqueName: \"kubernetes.io/projected/c988b0bc-e4f6-494b-ac73-e311157d09ed-kube-api-access-b5lvf\") pod \"ovnkube-node-zpq6f\" (UID: \"c988b0bc-e4f6-494b-ac73-e311157d09ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.547067 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.547037 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb84c\" (UniqueName: \"kubernetes.io/projected/df2cf761-aad7-44b7-8161-2d5fb4811a4b-kube-api-access-gb84c\") pod \"multus-additional-cni-plugins-mbjsw\" (UID: \"df2cf761-aad7-44b7-8161-2d5fb4811a4b\") " pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.547876 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.547837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7r5q\" (UniqueName: \"kubernetes.io/projected/0bf0bcd1-c36c-49bc-aa67-343442806e76-kube-api-access-v7r5q\") pod \"tuned-q9lkt\" (UID: \"0bf0bcd1-c36c-49bc-aa67-343442806e76\") " pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.551463 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.551423 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr8ck\" (UniqueName: \"kubernetes.io/projected/3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5-kube-api-access-kr8ck\") pod \"aws-ebs-csi-driver-node-9sctz\" (UID: \"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.609996 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.609928 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7b452d0c-4883-462b-828f-daf3e42d7c08-serviceca\") pod \"node-ca-52d67\" (UID: \"7b452d0c-4883-462b-828f-daf3e42d7c08\") " pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.609996 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.609966 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd64r\" (UniqueName: \"kubernetes.io/projected/7b452d0c-4883-462b-828f-daf3e42d7c08-kube-api-access-fd64r\") pod \"node-ca-52d67\" (UID: \"7b452d0c-4883-462b-828f-daf3e42d7c08\") " pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.610206 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.610003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d213268f-4b26-4ffd-96e5-efa05204e840-iptables-alerter-script\") pod \"iptables-alerter-kfqll\" (UID: \"d213268f-4b26-4ffd-96e5-efa05204e840\") " pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.610289 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.610205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrz8x\" (UniqueName: \"kubernetes.io/projected/d213268f-4b26-4ffd-96e5-efa05204e840-kube-api-access-mrz8x\") pod \"iptables-alerter-kfqll\" (UID: \"d213268f-4b26-4ffd-96e5-efa05204e840\") " pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.610289 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.610278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d213268f-4b26-4ffd-96e5-efa05204e840-host-slash\") pod \"iptables-alerter-kfqll\" (UID: \"d213268f-4b26-4ffd-96e5-efa05204e840\") " pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.610427 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.610305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b452d0c-4883-462b-828f-daf3e42d7c08-host\") pod \"node-ca-52d67\" (UID: \"7b452d0c-4883-462b-828f-daf3e42d7c08\") " pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.610427 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.610407 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b452d0c-4883-462b-828f-daf3e42d7c08-host\") pod \"node-ca-52d67\" (UID: \"7b452d0c-4883-462b-828f-daf3e42d7c08\") " pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.610528 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.610454 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d213268f-4b26-4ffd-96e5-efa05204e840-host-slash\") pod \"iptables-alerter-kfqll\" (UID: \"d213268f-4b26-4ffd-96e5-efa05204e840\") " pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.610595 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.610523 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7b452d0c-4883-462b-828f-daf3e42d7c08-serviceca\") pod \"node-ca-52d67\" (UID: \"7b452d0c-4883-462b-828f-daf3e42d7c08\") " pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.610721 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.610701 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d213268f-4b26-4ffd-96e5-efa05204e840-iptables-alerter-script\") pod \"iptables-alerter-kfqll\" (UID: \"d213268f-4b26-4ffd-96e5-efa05204e840\") " pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.633204 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.633178 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd64r\" (UniqueName: \"kubernetes.io/projected/7b452d0c-4883-462b-828f-daf3e42d7c08-kube-api-access-fd64r\") pod \"node-ca-52d67\" (UID: \"7b452d0c-4883-462b-828f-daf3e42d7c08\") " pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.633359 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.633292 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrz8x\" (UniqueName: \"kubernetes.io/projected/d213268f-4b26-4ffd-96e5-efa05204e840-kube-api-access-mrz8x\") pod \"iptables-alerter-kfqll\" (UID: \"d213268f-4b26-4ffd-96e5-efa05204e840\") " pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.692264 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.692215 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:28.702395 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.702368 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jc929" Jul 02 14:48:28.713255 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.713233 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:28.722217 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.722197 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" Jul 02 14:48:28.735922 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.735903 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-42pcg" Jul 02 14:48:28.745913 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.745891 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" Jul 02 14:48:28.755627 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.755607 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" Jul 02 14:48:28.761383 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.761362 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52d67" Jul 02 14:48:28.770165 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.770148 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kfqll" Jul 02 14:48:28.909554 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:28.909479 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:29.013529 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:29.013496 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:29.013670 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:29.013638 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:29.013741 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:29.013704 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:30.013687134 +0000 UTC m=+4.056489531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:29.114855 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:29.114817 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:29.115027 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:29.115002 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:29.115086 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:29.115003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:29.115086 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:29.115075 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret podName:a430c8b7-7624-4e58-8631-35e012585f01 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:30.115054433 +0000 UTC m=+4.157856840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret") pod "global-pull-secret-syncer-k5c5h" (UID: "a430c8b7-7624-4e58-8631-35e012585f01") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:29.115167 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:29.115114 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:29.115167 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:29.115134 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:29.115167 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:29.115147 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tx5lf for pod openshift-network-diagnostics/network-check-target-c676w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:29.115309 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:29.115202 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf podName:a8ef5a74-167d-4685-b9e4-e6ab26c445d2 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:30.115185284 +0000 UTC m=+4.157987684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tx5lf" (UniqueName: "kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf") pod "network-check-target-c676w" (UID: "a8ef5a74-167d-4685-b9e4-e6ab26c445d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:29.488527 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:29.488485 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 14:43:28 +0000 UTC" deadline="2027-12-10 03:39:37.734574103 +0000 UTC" Jul 02 14:48:29.488527 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:29.488520 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12612h51m8.246057337s" Jul 02 14:48:29.504886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:29.504860 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:29.505016 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:29.504971 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:29.545569 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:29.545470 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd262182d_2ff7_4c24_93ee_257f5dc28cb4.slice/crio-64c2c305602f9d9e00c4f7858249baf7ded3d4fc73e17d6d606471c1a33ef2ea WatchSource:0}: Error finding container 64c2c305602f9d9e00c4f7858249baf7ded3d4fc73e17d6d606471c1a33ef2ea: Status 404 returned error can't find the container with id 64c2c305602f9d9e00c4f7858249baf7ded3d4fc73e17d6d606471c1a33ef2ea Jul 02 14:48:29.546863 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:29.546836 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc988b0bc_e4f6_494b_ac73_e311157d09ed.slice/crio-3f5f1b5552cb48798f9e5349be124497c67ed389d5c9687336836d01db094c9c WatchSource:0}: Error finding container 3f5f1b5552cb48798f9e5349be124497c67ed389d5c9687336836d01db094c9c: Status 404 returned error can't find the container with id 3f5f1b5552cb48798f9e5349be124497c67ed389d5c9687336836d01db094c9c Jul 02 14:48:29.547458 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:29.547439 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc9b49e_94a3_4c52_a1bf_89d81f8e94d5.slice/crio-2329dd41bfec42d3fe98a65c75fe6b108c291fca235ca025aabca11980222e68 WatchSource:0}: Error finding container 2329dd41bfec42d3fe98a65c75fe6b108c291fca235ca025aabca11980222e68: Status 404 returned error can't find the container with id 2329dd41bfec42d3fe98a65c75fe6b108c291fca235ca025aabca11980222e68 Jul 02 14:48:29.548254 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:29.548149 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2cf761_aad7_44b7_8161_2d5fb4811a4b.slice/crio-5091c562089e26971acbcb5de17eb18f8432fa40fab5065106297d440fc530f3 WatchSource:0}: Error finding container 5091c562089e26971acbcb5de17eb18f8432fa40fab5065106297d440fc530f3: Status 404 returned error can't find the container with id 5091c562089e26971acbcb5de17eb18f8432fa40fab5065106297d440fc530f3 Jul 02 14:48:29.550661 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:29.550623 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd165d31f_741f_45c7_822c_752f0af54a09.slice/crio-271651194c6a0bc1a5895254b637cf9f3cd7058db7f14b9686125deb0876c87b WatchSource:0}: Error finding container 271651194c6a0bc1a5895254b637cf9f3cd7058db7f14b9686125deb0876c87b: Status 404 returned error can't find the container with id 271651194c6a0bc1a5895254b637cf9f3cd7058db7f14b9686125deb0876c87b Jul 02 14:48:29.552775 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:29.552736 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd213268f_4b26_4ffd_96e5_efa05204e840.slice/crio-a124ef97f2b6d2a0195c3eaf3300e41e7b734aa5978e049876f412a27db1a6f7 WatchSource:0}: Error finding container a124ef97f2b6d2a0195c3eaf3300e41e7b734aa5978e049876f412a27db1a6f7: Status 404 returned error can't find the container with id a124ef97f2b6d2a0195c3eaf3300e41e7b734aa5978e049876f412a27db1a6f7 Jul 02 14:48:29.554013 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:29.553966 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b452d0c_4883_462b_828f_daf3e42d7c08.slice/crio-f7354947104702e1716f600cf6f0da82e3d3f6a7a9b97f8f5b1abc8ff8e73cd6 WatchSource:0}: Error finding container f7354947104702e1716f600cf6f0da82e3d3f6a7a9b97f8f5b1abc8ff8e73cd6: Status 404 returned error can't find the container with id f7354947104702e1716f600cf6f0da82e3d3f6a7a9b97f8f5b1abc8ff8e73cd6 Jul 02 14:48:29.554699 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:48:29.554678 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf0bcd1_c36c_49bc_aa67_343442806e76.slice/crio-bb3158698a306886d80248cbf794c1d505ce42a69143ab2d0e4acdd7d14856f2 WatchSource:0}: Error finding container bb3158698a306886d80248cbf794c1d505ce42a69143ab2d0e4acdd7d14856f2: Status 404 returned error can't find the container with id bb3158698a306886d80248cbf794c1d505ce42a69143ab2d0e4acdd7d14856f2 Jul 02 14:48:30.022796 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.022501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:30.023018 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.022896 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:30.023018 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.022961 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:32.022941174 +0000 UTC m=+6.065743585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:30.123428 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.123390 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:30.123625 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.123457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:30.123625 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.123580 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:30.123732 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.123644 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret podName:a430c8b7-7624-4e58-8631-35e012585f01 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:32.123624334 +0000 UTC m=+6.166426722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret") pod "global-pull-secret-syncer-k5c5h" (UID: "a430c8b7-7624-4e58-8631-35e012585f01") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:30.124054 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.124033 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:30.124155 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.124058 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:30.124155 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.124072 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tx5lf for pod openshift-network-diagnostics/network-check-target-c676w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:30.124155 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.124123 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf podName:a8ef5a74-167d-4685-b9e4-e6ab26c445d2 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:32.124108795 +0000 UTC m=+6.166911183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tx5lf" (UniqueName: "kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf") pod "network-check-target-c676w" (UID: "a8ef5a74-167d-4685-b9e4-e6ab26c445d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:30.489024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.488913 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 14:43:28 +0000 UTC" deadline="2028-04-12 10:54:05.30411928 +0000 UTC" Jul 02 14:48:30.489024 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.488973 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15596h5m34.815150677s" Jul 02 14:48:30.507501 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.506799 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:30.507501 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.506922 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:30.507501 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.507322 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:30.507501 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:30.507445 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:30.539561 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.539172 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jc929" event={"ID":"d262182d-2ff7-4c24-93ee-257f5dc28cb4","Type":"ContainerStarted","Data":"64c2c305602f9d9e00c4f7858249baf7ded3d4fc73e17d6d606471c1a33ef2ea"} Jul 02 14:48:30.544885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.544813 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" event={"ID":"ff8112a09a92e79e1fba8f9541e6f8d7","Type":"ContainerStarted","Data":"69e0c0c47765b975d16f6f837e6cc80d097b5a1be94ff2d06bab67fbde1b65ac"} Jul 02 14:48:30.548990 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.548964 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rcc5v" event={"ID":"6553e047-9e28-4ea2-92bc-9110169bb3f5","Type":"ContainerStarted","Data":"9fb43de0e8020a0529c534814fbba3835d9da0fa64458213827f9bf75b3dd6bb"} Jul 02 14:48:30.562535 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.562477 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kfqll" event={"ID":"d213268f-4b26-4ffd-96e5-efa05204e840","Type":"ContainerStarted","Data":"a124ef97f2b6d2a0195c3eaf3300e41e7b734aa5978e049876f412a27db1a6f7"} Jul 02 14:48:30.576050 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.575979 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-42pcg" event={"ID":"d165d31f-741f-45c7-822c-752f0af54a09","Type":"ContainerStarted","Data":"271651194c6a0bc1a5895254b637cf9f3cd7058db7f14b9686125deb0876c87b"} Jul 02 14:48:30.586355 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.586307 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" event={"ID":"c988b0bc-e4f6-494b-ac73-e311157d09ed","Type":"ContainerStarted","Data":"3f5f1b5552cb48798f9e5349be124497c67ed389d5c9687336836d01db094c9c"} Jul 02 14:48:30.610381 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.609487 2566 generic.go:356] "Generic (PLEG): container finished" podID="bdda60bf425dadd7b86ec2242e37edb6" containerID="67a4c6e66f2d9710e6d32f8e84295a3271466ef9373921ce8531a44fb3b6db2e" exitCode=0 Jul 02 14:48:30.610381 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.609578 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" event={"ID":"bdda60bf425dadd7b86ec2242e37edb6","Type":"ContainerDied","Data":"67a4c6e66f2d9710e6d32f8e84295a3271466ef9373921ce8531a44fb3b6db2e"} Jul 02 14:48:30.615429 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.615400 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" event={"ID":"0bf0bcd1-c36c-49bc-aa67-343442806e76","Type":"ContainerStarted","Data":"bb3158698a306886d80248cbf794c1d505ce42a69143ab2d0e4acdd7d14856f2"} Jul 02 14:48:30.624027 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.623965 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52d67" event={"ID":"7b452d0c-4883-462b-828f-daf3e42d7c08","Type":"ContainerStarted","Data":"f7354947104702e1716f600cf6f0da82e3d3f6a7a9b97f8f5b1abc8ff8e73cd6"} Jul 02 14:48:30.627404 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.627323 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" podStartSLOduration=3.627304005 podStartE2EDuration="3.627304005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:30.560434718 +0000 UTC m=+4.603237125" watchObservedRunningTime="2026-07-02 14:48:30.627304005 +0000 UTC m=+4.670106412" Jul 02 14:48:30.637304 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.637245 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" event={"ID":"df2cf761-aad7-44b7-8161-2d5fb4811a4b","Type":"ContainerStarted","Data":"5091c562089e26971acbcb5de17eb18f8432fa40fab5065106297d440fc530f3"} Jul 02 14:48:30.657756 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:30.657723 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" event={"ID":"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5","Type":"ContainerStarted","Data":"2329dd41bfec42d3fe98a65c75fe6b108c291fca235ca025aabca11980222e68"} Jul 02 14:48:31.504977 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:31.504487 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:31.504977 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:31.504618 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:31.672421 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:31.672386 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" event={"ID":"bdda60bf425dadd7b86ec2242e37edb6","Type":"ContainerStarted","Data":"f63e15e92a03507c3b96e88d9388a670a6e7bb88f13483cfa70e4a1d58b5fcc7"} Jul 02 14:48:31.687405 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:31.687350 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" podStartSLOduration=4.68731626 podStartE2EDuration="4.68731626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:31.687038159 +0000 UTC m=+5.729840577" watchObservedRunningTime="2026-07-02 14:48:31.68731626 +0000 UTC m=+5.730118659" Jul 02 14:48:32.039799 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:32.039760 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:32.040007 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.039992 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:32.040097 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.040071 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:36.040039694 +0000 UTC m=+10.082842096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:32.142240 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:32.141290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:32.142240 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:32.141436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:32.142240 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.141580 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:32.142240 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.141646 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret podName:a430c8b7-7624-4e58-8631-35e012585f01 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:36.14162691 +0000 UTC m=+10.184429298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret") pod "global-pull-secret-syncer-k5c5h" (UID: "a430c8b7-7624-4e58-8631-35e012585f01") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:32.142240 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.142082 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:32.142240 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.142100 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:32.142240 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.142112 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tx5lf for pod openshift-network-diagnostics/network-check-target-c676w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:32.142240 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.142161 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf podName:a8ef5a74-167d-4685-b9e4-e6ab26c445d2 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:36.142143154 +0000 UTC m=+10.184945544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tx5lf" (UniqueName: "kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf") pod "network-check-target-c676w" (UID: "a8ef5a74-167d-4685-b9e4-e6ab26c445d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:32.505417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:32.505157 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:32.505417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:32.505157 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:32.505417 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.505298 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:32.505959 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:32.505384 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:33.504300 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:33.504264 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:33.504501 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:33.504429 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:34.504479 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:34.504406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:34.504479 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:34.504422 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:34.504978 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:34.504548 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:34.505039 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:34.504973 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:35.504547 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:35.504508 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:35.505024 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:35.504658 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:36.076046 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:36.076010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:36.076227 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.076216 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:36.076303 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.076290 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:44.076270078 +0000 UTC m=+18.119072481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:36.176969 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:36.176909 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:36.177149 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:36.176977 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:36.177149 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.177092 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:36.177149 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.177118 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:36.177149 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.177142 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:36.177149 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.177152 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret podName:a430c8b7-7624-4e58-8631-35e012585f01 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:44.17713267 +0000 UTC m=+18.219935069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret") pod "global-pull-secret-syncer-k5c5h" (UID: "a430c8b7-7624-4e58-8631-35e012585f01") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:36.177418 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.177154 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tx5lf for pod openshift-network-diagnostics/network-check-target-c676w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:36.177418 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.177209 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf podName:a8ef5a74-167d-4685-b9e4-e6ab26c445d2 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:44.177191056 +0000 UTC m=+18.219993443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tx5lf" (UniqueName: "kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf") pod "network-check-target-c676w" (UID: "a8ef5a74-167d-4685-b9e4-e6ab26c445d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:36.505715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:36.505298 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:36.505715 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.505427 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:36.505715 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:36.505542 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:36.505715 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:36.505631 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:37.504837 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:37.504801 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:37.505025 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:37.504957 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:38.503875 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:38.503840 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:38.504380 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:38.503846 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:38.504380 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:38.503980 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:38.504535 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:38.504382 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:39.504326 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:39.504295 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:39.504689 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:39.504429 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:40.504582 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:40.504543 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:40.504983 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:40.504546 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:40.504983 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:40.504692 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:40.504983 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:40.504818 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:41.504649 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:41.504611 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:41.505053 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:41.504741 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:42.504681 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:42.504600 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:42.505072 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:42.504741 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:42.505072 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:42.504798 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:42.505072 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:42.504898 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:43.504773 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:43.504744 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:43.505226 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:43.504875 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:44.138367 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:44.138322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:44.138523 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.138445 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:44.138523 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.138499 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:00.138484577 +0000 UTC m=+34.181286960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:44.238721 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:44.238693 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:44.238867 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:44.238735 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:44.238867 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.238832 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:44.238867 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.238858 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:44.238961 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.238882 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:44.238961 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.238886 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret podName:a430c8b7-7624-4e58-8631-35e012585f01 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:00.238872335 +0000 UTC m=+34.281674719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret") pod "global-pull-secret-syncer-k5c5h" (UID: "a430c8b7-7624-4e58-8631-35e012585f01") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:44.238961 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.238894 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tx5lf for pod openshift-network-diagnostics/network-check-target-c676w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:44.238961 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.238932 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf podName:a8ef5a74-167d-4685-b9e4-e6ab26c445d2 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:00.238922267 +0000 UTC m=+34.281724667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tx5lf" (UniqueName: "kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf") pod "network-check-target-c676w" (UID: "a8ef5a74-167d-4685-b9e4-e6ab26c445d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:44.507370 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:44.507273 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:44.507783 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:44.507286 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:44.507783 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.507411 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:44.507783 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:44.507452 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:45.504172 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:45.504139 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:45.504364 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:45.504264 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:46.505222 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:46.505181 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:46.505698 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:46.505305 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:46.505698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:46.505376 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:46.505698 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:46.505519 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:47.504435 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:47.504399 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:47.504590 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:47.504538 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:48.505446 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.504479 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:48.505446 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:48.504808 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:48.505446 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.504918 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:48.505446 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:48.504997 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:48.708433 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.708181 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rcc5v" event={"ID":"6553e047-9e28-4ea2-92bc-9110169bb3f5","Type":"ContainerStarted","Data":"70d5c76d2bf93b8273a1f15b57eede2c93fd7e31a36dd9d790318a00f2b69c87"} Jul 02 14:48:48.709769 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.709731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-42pcg" event={"ID":"d165d31f-741f-45c7-822c-752f0af54a09","Type":"ContainerStarted","Data":"66d4a515279cb3fbeb9f8102ee08cc4a16236e1c4a16884f834bb7dc6331e36a"} Jul 02 14:48:48.711903 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.711882 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" event={"ID":"c988b0bc-e4f6-494b-ac73-e311157d09ed","Type":"ContainerStarted","Data":"99cf0a6ceb0300a1e01cf7fedb2585974cf374ed22f079a353e5c25b867f7775"} Jul 02 14:48:48.712022 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.711970 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" event={"ID":"c988b0bc-e4f6-494b-ac73-e311157d09ed","Type":"ContainerStarted","Data":"6bfc5c93ed9267283153a59cd5af205c985dbfa17782faea2249b5583a911ae6"} Jul 02 14:48:48.712138 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.712035 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" event={"ID":"c988b0bc-e4f6-494b-ac73-e311157d09ed","Type":"ContainerStarted","Data":"05df99ca2a5f547e283480045d3c06711bcc3977f1eed6d72da129be6161381c"} Jul 02 14:48:48.713293 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.713272 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" event={"ID":"0bf0bcd1-c36c-49bc-aa67-343442806e76","Type":"ContainerStarted","Data":"4fe9f81d8b3a1d182d5592f66c9f3d099eb5357b2a68eeac2c0092aadaaaecbe"} Jul 02 14:48:48.714688 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.714649 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52d67" event={"ID":"7b452d0c-4883-462b-828f-daf3e42d7c08","Type":"ContainerStarted","Data":"a8cdf4835e9014178d813764f1c62cfdc9e642f01d669c6a06399dc6913ac9a6"} Jul 02 14:48:48.716194 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.716171 2566 generic.go:356] "Generic (PLEG): container finished" podID="df2cf761-aad7-44b7-8161-2d5fb4811a4b" containerID="88ba4f10791b515c3d7dbf1675a893a351d444a8dec7eebff54f81a371c9349a" exitCode=0 Jul 02 14:48:48.716293 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.716258 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" event={"ID":"df2cf761-aad7-44b7-8161-2d5fb4811a4b","Type":"ContainerDied","Data":"88ba4f10791b515c3d7dbf1675a893a351d444a8dec7eebff54f81a371c9349a"} Jul 02 14:48:48.717761 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.717744 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" event={"ID":"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5","Type":"ContainerStarted","Data":"e6e4f1854ba3401e5d9e1e6bd71cd44dfc4f69ddf1adf8064c67d758c2c3408f"} Jul 02 14:48:48.719209 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.719188 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jc929" event={"ID":"d262182d-2ff7-4c24-93ee-257f5dc28cb4","Type":"ContainerStarted","Data":"b46c1dca89dfb07a2b2335a57e4878014ede96b220295f528d8dfc5815dc56cf"} Jul 02 14:48:48.722210 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.722175 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rcc5v" podStartSLOduration=12.266325008 podStartE2EDuration="22.722163344s" totalImagesPullingTime="10.455838336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:48.721692246 +0000 UTC m=+22.764494653" watchObservedRunningTime="2026-07-02 14:48:48.722163344 +0000 UTC m=+22.764965746" Jul 02 14:48:48.753791 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.753728 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-52d67" podStartSLOduration=4.006918252 podStartE2EDuration="22.75370862s" totalImagesPullingTime="18.746790368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:48.753517048 +0000 UTC m=+22.796319464" watchObservedRunningTime="2026-07-02 14:48:48.75370862 +0000 UTC m=+22.796511026" Jul 02 14:48:48.766353 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.766292 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-42pcg" podStartSLOduration=4.016066383 podStartE2EDuration="22.766277066s" totalImagesPullingTime="18.750210683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:48.765994876 +0000 UTC m=+22.808797289" watchObservedRunningTime="2026-07-02 14:48:48.766277066 +0000 UTC m=+22.809079472" Jul 02 14:48:48.780724 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.780681 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q9lkt" podStartSLOduration=4.033084425 podStartE2EDuration="22.780667057s" totalImagesPullingTime="18.747582632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:48.780432575 +0000 UTC m=+22.823234981" watchObservedRunningTime="2026-07-02 14:48:48.780667057 +0000 UTC m=+22.823469463" Jul 02 14:48:48.800483 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:48.800436 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jc929" podStartSLOduration=3.8471115940000002 podStartE2EDuration="22.800422032s" totalImagesPullingTime="18.953310438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:48.800218028 +0000 UTC m=+22.843020436" watchObservedRunningTime="2026-07-02 14:48:48.800422032 +0000 UTC m=+22.843224483" Jul 02 14:48:49.504343 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:49.504292 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:49.504543 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:49.504436 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:49.724933 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:49.724900 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" event={"ID":"c988b0bc-e4f6-494b-ac73-e311157d09ed","Type":"ContainerStarted","Data":"b3b48a6145d8e7427a00193c1b48e04a725fe5bbb6f511257e52541730b91bf7"} Jul 02 14:48:49.725788 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:49.725002 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" event={"ID":"c988b0bc-e4f6-494b-ac73-e311157d09ed","Type":"ContainerStarted","Data":"d9653624555d72b1176ae89b2517ae590b1faf25780ce034db575d826eed0cbc"} Jul 02 14:48:49.725788 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:49.725050 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" event={"ID":"c988b0bc-e4f6-494b-ac73-e311157d09ed","Type":"ContainerStarted","Data":"ceb2cc5788dd84fb6a0c2b7d74fa093d4b67e38686ee5036921df3839d51762f"} Jul 02 14:48:49.944066 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:49.943933 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:49.944409 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:49.944378 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:49.949614 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:49.949592 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 14:48:50.456422 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.456306 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T14:48:49.949610492Z","UUID":"d94e8789-4475-42e0-80dc-07543863969c","Handler":null,"Name":"","Endpoint":""} Jul 02 14:48:50.457782 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.457752 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 14:48:50.457922 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.457797 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 14:48:50.504710 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.504681 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:50.504710 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.504701 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:50.504924 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:50.504800 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:50.504924 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:50.504907 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:50.729357 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.729260 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" event={"ID":"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5","Type":"ContainerStarted","Data":"f53405bca8f60b1c6c746ee423c354b0984da66c9014073cb168d4d3e4dfcc74"} Jul 02 14:48:50.730960 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.730932 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kfqll" event={"ID":"d213268f-4b26-4ffd-96e5-efa05204e840","Type":"ContainerStarted","Data":"98f605e80c49fb2b43d807c2c3802e04ce3decc5d9b718db4bdc6b540ac3f1a2"} Jul 02 14:48:50.731150 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.731133 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:50.731789 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.731768 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rcc5v" Jul 02 14:48:50.759377 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:50.758817 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kfqll" podStartSLOduration=6.008888832 podStartE2EDuration="24.758798251s" totalImagesPullingTime="18.749909419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:50.745288217 +0000 UTC m=+24.788090622" watchObservedRunningTime="2026-07-02 14:48:50.758798251 +0000 UTC m=+24.801600657" Jul 02 14:48:51.505056 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:51.504818 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:51.505215 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:51.505102 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:51.736688 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:51.736648 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" event={"ID":"3fc9b49e-94a3-4c52-a1bf-89d81f8e94d5","Type":"ContainerStarted","Data":"05e3dcb126ca90539aa88dfa0c21fc4d2259526f35fc7f2d2320f459e3e46252"} Jul 02 14:48:51.740479 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:51.740435 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" event={"ID":"c988b0bc-e4f6-494b-ac73-e311157d09ed","Type":"ContainerStarted","Data":"f0131032284c981cca933a8a3435624fd130f97453925deb2c04358ee9bb16bc"} Jul 02 14:48:51.754160 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:51.754110 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sctz" podStartSLOduration=4.547681683 podStartE2EDuration="25.754098279s" totalImagesPullingTime="21.206416596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:51.753603443 +0000 UTC m=+25.796405867" watchObservedRunningTime="2026-07-02 14:48:51.754098279 +0000 UTC m=+25.796900685" Jul 02 14:48:52.504022 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:52.503983 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:52.504200 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:52.504110 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:52.504200 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:52.504167 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:52.504313 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:52.504285 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:53.504619 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:53.504446 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:53.505206 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:53.504711 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:53.745419 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:53.745385 2566 generic.go:356] "Generic (PLEG): container finished" podID="df2cf761-aad7-44b7-8161-2d5fb4811a4b" containerID="1d9ce9d31c8307f78b3d4d5aed040b6db66f10b7caebae4508fa7b1a46e24056" exitCode=0 Jul 02 14:48:53.745757 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:53.745463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" event={"ID":"df2cf761-aad7-44b7-8161-2d5fb4811a4b","Type":"ContainerDied","Data":"1d9ce9d31c8307f78b3d4d5aed040b6db66f10b7caebae4508fa7b1a46e24056"} Jul 02 14:48:53.749403 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:53.749382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" event={"ID":"c988b0bc-e4f6-494b-ac73-e311157d09ed","Type":"ContainerStarted","Data":"d58762ada17742b15539273cb1dc2d2121616799e2660cb86a665f85bab468c7"} Jul 02 14:48:53.749672 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:53.749646 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:53.764866 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:53.764846 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:54.504531 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:54.504497 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:54.504713 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:54.504616 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:54.504713 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:54.504663 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:54.505088 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:54.504771 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:54.751798 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:54.751767 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:54.752051 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:54.751863 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:54.769852 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:54.769788 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:48:54.795733 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:54.795690 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" podStartSLOduration=10.009065205 podStartE2EDuration="28.795676112s" totalImagesPullingTime="18.786610907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:53.798826652 +0000 UTC m=+27.841629054" watchObservedRunningTime="2026-07-02 14:48:54.795676112 +0000 UTC m=+28.838478518" Jul 02 14:48:55.504518 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:55.504346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:55.504746 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:55.504597 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:55.538907 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:55.538876 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtbhn"] Jul 02 14:48:55.539617 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:55.539597 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c676w"] Jul 02 14:48:55.539703 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:55.539683 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:55.539783 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:55.539764 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:55.541105 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:55.541082 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5c5h"] Jul 02 14:48:55.541197 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:55.541160 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:55.541264 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:55.541244 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:55.755193 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:55.755119 2566 generic.go:356] "Generic (PLEG): container finished" podID="df2cf761-aad7-44b7-8161-2d5fb4811a4b" containerID="13562f74e8f69ec90c9816cff008e87670f568a84e9a05e5b0e95a80f5fb84c6" exitCode=0 Jul 02 14:48:55.755193 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:55.755186 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:55.755530 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:55.755197 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" event={"ID":"df2cf761-aad7-44b7-8161-2d5fb4811a4b","Type":"ContainerDied","Data":"13562f74e8f69ec90c9816cff008e87670f568a84e9a05e5b0e95a80f5fb84c6"} Jul 02 14:48:55.755530 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:55.755309 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:57.504795 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:57.504772 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:57.504795 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:57.504783 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:57.505214 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:57.504783 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:57.505214 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:57.504865 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:57.505214 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:57.504951 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:57.505214 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:57.505018 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:48:57.762697 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:57.762610 2566 generic.go:356] "Generic (PLEG): container finished" podID="df2cf761-aad7-44b7-8161-2d5fb4811a4b" containerID="1f2081f78acfb4a13f42b7c4238680d5fdfd193fa84ce39c1ecd1e9e23bca58d" exitCode=0 Jul 02 14:48:57.762697 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:57.762658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" event={"ID":"df2cf761-aad7-44b7-8161-2d5fb4811a4b","Type":"ContainerDied","Data":"1f2081f78acfb4a13f42b7c4238680d5fdfd193fa84ce39c1ecd1e9e23bca58d"} Jul 02 14:48:59.504886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:59.504852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:48:59.505548 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:59.504891 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:48:59.505548 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:48:59.504953 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:48:59.505548 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:59.504965 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5c5h" podUID="a430c8b7-7624-4e58-8631-35e012585f01" Jul 02 14:48:59.505548 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:59.505059 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:48:59.505548 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:48:59.505129 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c676w" podUID="a8ef5a74-167d-4685-b9e4-e6ab26c445d2" Jul 02 14:49:00.168607 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:00.168573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:49:00.168787 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:00.168756 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:49:00.168848 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:00.168836 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:32.168813431 +0000 UTC m=+66.211615818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:49:00.270000 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:00.269963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:49:00.270176 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:00.270010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:49:00.270176 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:00.270112 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:49:00.270176 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:00.270131 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:49:00.270176 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:00.270146 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:49:00.270176 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:00.270159 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tx5lf for pod openshift-network-diagnostics/network-check-target-c676w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:49:00.270176 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:00.270179 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret podName:a430c8b7-7624-4e58-8631-35e012585f01 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:32.270161905 +0000 UTC m=+66.312964293 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret") pod "global-pull-secret-syncer-k5c5h" (UID: "a430c8b7-7624-4e58-8631-35e012585f01") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:49:00.270403 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:00.270195 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf podName:a8ef5a74-167d-4685-b9e4-e6ab26c445d2 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:32.270185819 +0000 UTC m=+66.312988217 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tx5lf" (UniqueName: "kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf") pod "network-check-target-c676w" (UID: "a8ef5a74-167d-4685-b9e4-e6ab26c445d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:49:01.252026 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.251993 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeReady" Jul 02 14:49:01.252639 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.252165 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 14:49:01.310430 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.310387 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5tbbf"] Jul 02 14:49:01.344316 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.344278 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tx475"] Jul 02 14:49:01.344499 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.344422 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.346796 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.346773 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 14:49:01.346914 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.346776 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 14:49:01.346987 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.346783 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gj4nd\"" Jul 02 14:49:01.357605 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.357582 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tx475"] Jul 02 14:49:01.357718 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.357619 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tbbf"] Jul 02 14:49:01.357718 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.357700 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tx475" Jul 02 14:49:01.360695 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.360673 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpgfg\"" Jul 02 14:49:01.360800 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.360701 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 14:49:01.360800 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.360718 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 14:49:01.360800 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.360722 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 14:49:01.479102 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.479067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df366d57-a34a-4207-96fd-1d9555173e23-cert\") pod \"ingress-canary-tx475\" (UID: \"df366d57-a34a-4207-96fd-1d9555173e23\") " pod="openshift-ingress-canary/ingress-canary-tx475" Jul 02 14:49:01.479284 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.479111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fca010e-0df5-4240-bcbd-cac7e7702982-tmp-dir\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.479284 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.479188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.479284 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.479248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ptsd\" (UniqueName: \"kubernetes.io/projected/6fca010e-0df5-4240-bcbd-cac7e7702982-kube-api-access-6ptsd\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.479464 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.479290 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cctk\" (UniqueName: \"kubernetes.io/projected/df366d57-a34a-4207-96fd-1d9555173e23-kube-api-access-4cctk\") pod \"ingress-canary-tx475\" (UID: \"df366d57-a34a-4207-96fd-1d9555173e23\") " pod="openshift-ingress-canary/ingress-canary-tx475" Jul 02 14:49:01.479464 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.479376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fca010e-0df5-4240-bcbd-cac7e7702982-config-volume\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.504350 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.504266 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:49:01.504350 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.504266 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:49:01.504541 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.504269 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:49:01.507018 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.506973 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wp67j\"" Jul 02 14:49:01.507138 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.507031 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:49:01.507138 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.506975 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:49:01.507138 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.507058 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:49:01.507138 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.507059 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rrv2x\"" Jul 02 14:49:01.507353 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.506985 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:49:01.579804 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.579760 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fca010e-0df5-4240-bcbd-cac7e7702982-config-volume\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.580055 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.579828 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df366d57-a34a-4207-96fd-1d9555173e23-cert\") pod \"ingress-canary-tx475\" (UID: \"df366d57-a34a-4207-96fd-1d9555173e23\") " pod="openshift-ingress-canary/ingress-canary-tx475" Jul 02 14:49:01.580055 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.579857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fca010e-0df5-4240-bcbd-cac7e7702982-tmp-dir\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.580055 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.579898 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.580055 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.579944 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ptsd\" (UniqueName: \"kubernetes.io/projected/6fca010e-0df5-4240-bcbd-cac7e7702982-kube-api-access-6ptsd\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.580055 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.579981 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cctk\" (UniqueName: \"kubernetes.io/projected/df366d57-a34a-4207-96fd-1d9555173e23-kube-api-access-4cctk\") pod \"ingress-canary-tx475\" (UID: \"df366d57-a34a-4207-96fd-1d9555173e23\") " pod="openshift-ingress-canary/ingress-canary-tx475" Jul 02 14:49:01.580361 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:01.580107 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:01.580361 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:01.580194 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls podName:6fca010e-0df5-4240-bcbd-cac7e7702982 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:02.080171316 +0000 UTC m=+36.122973723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls") pod "dns-default-5tbbf" (UID: "6fca010e-0df5-4240-bcbd-cac7e7702982") : secret "dns-default-metrics-tls" not found Jul 02 14:49:01.580361 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.580315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fca010e-0df5-4240-bcbd-cac7e7702982-tmp-dir\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.580510 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.580490 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fca010e-0df5-4240-bcbd-cac7e7702982-config-volume\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.585454 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.585424 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df366d57-a34a-4207-96fd-1d9555173e23-cert\") pod \"ingress-canary-tx475\" (UID: \"df366d57-a34a-4207-96fd-1d9555173e23\") " pod="openshift-ingress-canary/ingress-canary-tx475" Jul 02 14:49:01.588819 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.588798 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ptsd\" (UniqueName: \"kubernetes.io/projected/6fca010e-0df5-4240-bcbd-cac7e7702982-kube-api-access-6ptsd\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:01.589093 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.589066 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cctk\" (UniqueName: \"kubernetes.io/projected/df366d57-a34a-4207-96fd-1d9555173e23-kube-api-access-4cctk\") pod \"ingress-canary-tx475\" (UID: \"df366d57-a34a-4207-96fd-1d9555173e23\") " pod="openshift-ingress-canary/ingress-canary-tx475" Jul 02 14:49:01.667018 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.666980 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tx475" Jul 02 14:49:01.983743 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:01.983571 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tx475"] Jul 02 14:49:02.026069 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:49:02.026039 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf366d57_a34a_4207_96fd_1d9555173e23.slice/crio-7a717ae942551d8198fa2bc90fc37a05b669a972e5572d88e71d3fcba059451c WatchSource:0}: Error finding container 7a717ae942551d8198fa2bc90fc37a05b669a972e5572d88e71d3fcba059451c: Status 404 returned error can't find the container with id 7a717ae942551d8198fa2bc90fc37a05b669a972e5572d88e71d3fcba059451c Jul 02 14:49:02.085192 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:02.085158 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:02.085353 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:02.085279 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:02.085449 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:02.085366 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls podName:6fca010e-0df5-4240-bcbd-cac7e7702982 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:03.08534563 +0000 UTC m=+37.128148032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls") pod "dns-default-5tbbf" (UID: "6fca010e-0df5-4240-bcbd-cac7e7702982") : secret "dns-default-metrics-tls" not found Jul 02 14:49:02.776783 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:02.776752 2566 generic.go:356] "Generic (PLEG): container finished" podID="df2cf761-aad7-44b7-8161-2d5fb4811a4b" containerID="8b67a7b88cbb4a3e700e78432901b76b76d4b00a460ac0c2875653cc35c3ae02" exitCode=0 Jul 02 14:49:02.777231 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:02.776834 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" event={"ID":"df2cf761-aad7-44b7-8161-2d5fb4811a4b","Type":"ContainerDied","Data":"8b67a7b88cbb4a3e700e78432901b76b76d4b00a460ac0c2875653cc35c3ae02"} Jul 02 14:49:02.778001 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:02.777973 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tx475" event={"ID":"df366d57-a34a-4207-96fd-1d9555173e23","Type":"ContainerStarted","Data":"7a717ae942551d8198fa2bc90fc37a05b669a972e5572d88e71d3fcba059451c"} Jul 02 14:49:03.092433 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:03.092319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:03.092599 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:03.092493 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:03.092599 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:03.092566 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls podName:6fca010e-0df5-4240-bcbd-cac7e7702982 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:05.092544241 +0000 UTC m=+39.135346628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls") pod "dns-default-5tbbf" (UID: "6fca010e-0df5-4240-bcbd-cac7e7702982") : secret "dns-default-metrics-tls" not found Jul 02 14:49:03.784390 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:03.784354 2566 generic.go:356] "Generic (PLEG): container finished" podID="df2cf761-aad7-44b7-8161-2d5fb4811a4b" containerID="fe9ed95e30cef8f8696166b8288fb68345ef43eae45754ae7a3d417c0ff34633" exitCode=0 Jul 02 14:49:03.784802 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:03.784430 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" event={"ID":"df2cf761-aad7-44b7-8161-2d5fb4811a4b","Type":"ContainerDied","Data":"fe9ed95e30cef8f8696166b8288fb68345ef43eae45754ae7a3d417c0ff34633"} Jul 02 14:49:04.788308 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:04.788272 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tx475" event={"ID":"df366d57-a34a-4207-96fd-1d9555173e23","Type":"ContainerStarted","Data":"5ceaf8f0707034f0a84b4046d97430b3e71e4bda73f83e7c7e1a7d13887fefd2"} Jul 02 14:49:04.791452 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:04.791427 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" event={"ID":"df2cf761-aad7-44b7-8161-2d5fb4811a4b","Type":"ContainerStarted","Data":"d86eece9cd2e576f91dafb5c66d3d84cba9151a4b69efb64d118f0fbf00f0e72"} Jul 02 14:49:04.802780 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:04.802730 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tx475" podStartSLOduration=1.565828298 podStartE2EDuration="3.802714048s" totalImagesPullingTime="2.23688575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:04.802199767 +0000 UTC m=+38.845002172" watchObservedRunningTime="2026-07-02 14:49:04.802714048 +0000 UTC m=+38.845516455" Jul 02 14:49:04.821983 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:04.821948 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mbjsw" podStartSLOduration=8.690242521 podStartE2EDuration="38.821934998s" totalImagesPullingTime="30.131692477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:04.821811282 +0000 UTC m=+38.864613688" watchObservedRunningTime="2026-07-02 14:49:04.821934998 +0000 UTC m=+38.864737431" Jul 02 14:49:05.105681 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:05.105593 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:05.105834 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:05.105758 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:05.105834 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:05.105833 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls podName:6fca010e-0df5-4240-bcbd-cac7e7702982 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:09.105814125 +0000 UTC m=+43.148616525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls") pod "dns-default-5tbbf" (UID: "6fca010e-0df5-4240-bcbd-cac7e7702982") : secret "dns-default-metrics-tls" not found Jul 02 14:49:09.133601 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:09.133555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:09.133991 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:09.133707 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:09.133991 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:09.133776 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls podName:6fca010e-0df5-4240-bcbd-cac7e7702982 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:17.133760108 +0000 UTC m=+51.176562505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls") pod "dns-default-5tbbf" (UID: "6fca010e-0df5-4240-bcbd-cac7e7702982") : secret "dns-default-metrics-tls" not found Jul 02 14:49:17.194918 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:17.194874 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:17.195519 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:17.195038 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:17.195519 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:17.195128 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls podName:6fca010e-0df5-4240-bcbd-cac7e7702982 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:33.195105879 +0000 UTC m=+67.237908276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls") pod "dns-default-5tbbf" (UID: "6fca010e-0df5-4240-bcbd-cac7e7702982") : secret "dns-default-metrics-tls" not found Jul 02 14:49:26.767845 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:26.767818 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpq6f" Jul 02 14:49:32.202863 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.202804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:49:32.204920 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.204901 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:49:32.213397 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:32.213381 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:49:32.213451 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:32.213440 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:50:36.213419703 +0000 UTC m=+130.256222092 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : secret "metrics-daemon-secret" not found Jul 02 14:49:32.303119 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.303082 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:49:32.303185 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.303162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:49:32.305741 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.305724 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:49:32.305783 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.305724 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:49:32.315379 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.315354 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:49:32.317144 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.317126 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a430c8b7-7624-4e58-8631-35e012585f01-original-pull-secret\") pod \"global-pull-secret-syncer-k5c5h\" (UID: \"a430c8b7-7624-4e58-8631-35e012585f01\") " pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:49:32.326041 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.326019 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx5lf\" (UniqueName: \"kubernetes.io/projected/a8ef5a74-167d-4685-b9e4-e6ab26c445d2-kube-api-access-tx5lf\") pod \"network-check-target-c676w\" (UID: \"a8ef5a74-167d-4685-b9e4-e6ab26c445d2\") " pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:49:32.426993 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.426967 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rrv2x\"" Jul 02 14:49:32.430561 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.430546 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5c5h" Jul 02 14:49:32.435706 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.435689 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:49:32.572867 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.572767 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5c5h"] Jul 02 14:49:32.592318 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.592296 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c676w"] Jul 02 14:49:32.594958 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:49:32.594931 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ef5a74_167d_4685_b9e4_e6ab26c445d2.slice/crio-e51cdfa34106c70865f3705d66182db7cce860491659b21be9ccb9b9d0ecfa08 WatchSource:0}: Error finding container e51cdfa34106c70865f3705d66182db7cce860491659b21be9ccb9b9d0ecfa08: Status 404 returned error can't find the container with id e51cdfa34106c70865f3705d66182db7cce860491659b21be9ccb9b9d0ecfa08 Jul 02 14:49:32.855253 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.855169 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c676w" event={"ID":"a8ef5a74-167d-4685-b9e4-e6ab26c445d2","Type":"ContainerStarted","Data":"e51cdfa34106c70865f3705d66182db7cce860491659b21be9ccb9b9d0ecfa08"} Jul 02 14:49:32.856165 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:32.856131 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5c5h" event={"ID":"a430c8b7-7624-4e58-8631-35e012585f01","Type":"ContainerStarted","Data":"3cc22ccd1d594ab9a51040862b9a06535a558f165b629da1295354e93c39a4a8"} Jul 02 14:49:33.209669 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:33.209628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:49:33.210114 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:33.209789 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:33.210114 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:49:33.209869 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls podName:6fca010e-0df5-4240-bcbd-cac7e7702982 nodeName:}" failed. No retries permitted until 2026-07-02 14:50:05.209848154 +0000 UTC m=+99.252650554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls") pod "dns-default-5tbbf" (UID: "6fca010e-0df5-4240-bcbd-cac7e7702982") : secret "dns-default-metrics-tls" not found Jul 02 14:49:37.871889 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:37.871857 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c676w" event={"ID":"a8ef5a74-167d-4685-b9e4-e6ab26c445d2","Type":"ContainerStarted","Data":"67fb1dedb394be25d51b9c9d993d9dc487c476e219412d97dee607383893b499"} Jul 02 14:49:37.872412 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:37.871920 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:49:37.873321 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:37.873298 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5c5h" event={"ID":"a430c8b7-7624-4e58-8631-35e012585f01","Type":"ContainerStarted","Data":"5648cf93083f4c3743c35948f83e2948d10c6c960d83992a98582c780a763b63"} Jul 02 14:49:37.892426 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:37.892373 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c676w" podStartSLOduration=67.061347901 podStartE2EDuration="1m11.892360855s" totalImagesPullingTime="4.831012954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:37.891823771 +0000 UTC m=+71.934626204" watchObservedRunningTime="2026-07-02 14:49:37.892360855 +0000 UTC m=+71.935163261" Jul 02 14:49:37.907568 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:49:37.907526 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k5c5h" podStartSLOduration=67.045403142 podStartE2EDuration="1m11.907508633s" totalImagesPullingTime="4.862105491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:37.907347229 +0000 UTC m=+71.950149625" watchObservedRunningTime="2026-07-02 14:49:37.907508633 +0000 UTC m=+71.950311029" Jul 02 14:50:05.218811 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:50:05.218708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:50:05.219213 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:50:05.218843 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:50:05.219213 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:50:05.218903 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls podName:6fca010e-0df5-4240-bcbd-cac7e7702982 nodeName:}" failed. No retries permitted until 2026-07-02 14:51:09.218886359 +0000 UTC m=+163.261688765 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls") pod "dns-default-5tbbf" (UID: "6fca010e-0df5-4240-bcbd-cac7e7702982") : secret "dns-default-metrics-tls" not found Jul 02 14:50:08.878725 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:50:08.878687 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c676w" Jul 02 14:50:36.222885 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:50:36.222830 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:50:36.223503 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:50:36.223017 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:50:36.223503 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:50:36.223109 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:38.223086791 +0000 UTC m=+252.265889177 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : secret "metrics-daemon-secret" not found Jul 02 14:51:04.354670 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:51:04.354621 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5tbbf" podUID="6fca010e-0df5-4240-bcbd-cac7e7702982" Jul 02 14:51:04.517107 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:51:04.517066 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:51:05.081733 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:51:05.081698 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tbbf" Jul 02 14:51:09.247500 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:51:09.247457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:51:09.247983 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:51:09.247612 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:51:09.247983 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:51:09.247690 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls podName:6fca010e-0df5-4240-bcbd-cac7e7702982 nodeName:}" failed. No retries permitted until 2026-07-02 14:53:11.247673522 +0000 UTC m=+285.290475909 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls") pod "dns-default-5tbbf" (UID: "6fca010e-0df5-4240-bcbd-cac7e7702982") : secret "dns-default-metrics-tls" not found Jul 02 14:51:15.504581 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:51:15.504546 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:52:38.236234 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:38.236168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:52:38.236774 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:38.236350 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:52:38.236774 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:38.236430 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs podName:ed7db27e-fa51-4c39-83b3-747609b46f63 nodeName:}" failed. No retries permitted until 2026-07-02 14:54:40.236410779 +0000 UTC m=+374.279213168 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs") pod "network-metrics-daemon-dtbhn" (UID: "ed7db27e-fa51-4c39-83b3-747609b46f63") : secret "metrics-daemon-secret" not found Jul 02 14:52:44.100693 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.100656 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm"] Jul 02 14:52:44.102417 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.102400 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.105968 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.105942 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 14:52:44.106128 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.105976 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kdjgg\"" Jul 02 14:52:44.106128 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.105990 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 14:52:44.106128 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.106010 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 14:52:44.106128 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.106027 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 14:52:44.108543 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.108525 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-b6mdd"] Jul 02 14:52:44.110348 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.110316 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w"] Jul 02 14:52:44.110445 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.110429 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.111892 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.111877 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g"] Jul 02 14:52:44.112005 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.111990 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.113012 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.112989 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 14:52:44.113136 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.113012 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 14:52:44.113136 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.113012 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-clgq5\"" Jul 02 14:52:44.113136 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.113013 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 14:52:44.113136 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.113112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:52:44.113778 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.113760 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:44.113873 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.113845 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 14:52:44.113951 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.113912 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 14:52:44.114081 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.114063 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:52:44.114081 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.114079 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 14:52:44.114650 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.114632 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l2qqg\"" Jul 02 14:52:44.116051 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.116030 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 14:52:44.116279 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.116264 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6gqg8\"" Jul 02 14:52:44.116489 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.116465 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:52:44.116745 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.116727 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 14:52:44.118973 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.118957 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 14:52:44.124071 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.124046 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm"] Jul 02 14:52:44.144112 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.144095 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g"] Jul 02 14:52:44.144907 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.144887 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w"] Jul 02 14:52:44.145733 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.145710 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-b6mdd"] Jul 02 14:52:44.175076 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:44.175194 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175091 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4368dc51-7877-4af3-9623-a28c0d6d3a9d-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-d9x4w\" (UID: \"4368dc51-7877-4af3-9623-a28c0d6d3a9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.175194 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175134 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqgf6\" (UniqueName: \"kubernetes.io/projected/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-kube-api-access-qqgf6\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.175308 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175226 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6z5s\" (UniqueName: \"kubernetes.io/projected/4368dc51-7877-4af3-9623-a28c0d6d3a9d-kube-api-access-v6z5s\") pod \"kube-storage-version-migrator-operator-79964ff6f9-d9x4w\" (UID: \"4368dc51-7877-4af3-9623-a28c0d6d3a9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.175308 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175260 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.175308 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsqkj\" (UniqueName: \"kubernetes.io/projected/51a0c98d-5be5-452a-9320-b9857bed2e76-kube-api-access-qsqkj\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:44.175486 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqjmv\" (UniqueName: \"kubernetes.io/projected/baa7b16f-3062-47ee-87b9-b17060a67326-kube-api-access-lqjmv\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.175486 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175410 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4368dc51-7877-4af3-9623-a28c0d6d3a9d-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-d9x4w\" (UID: \"4368dc51-7877-4af3-9623-a28c0d6d3a9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.175486 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175457 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/baa7b16f-3062-47ee-87b9-b17060a67326-config\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.175605 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175489 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baa7b16f-3062-47ee-87b9-b17060a67326-trusted-ca\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.175605 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175559 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.175605 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.175586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa7b16f-3062-47ee-87b9-b17060a67326-serving-cert\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.205955 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.205935 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs"] Jul 02 14:52:44.207831 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.207818 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.210073 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.210057 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 14:52:44.210219 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.210202 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:52:44.210605 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.210588 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 14:52:44.210826 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.210804 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dwnqn\"" Jul 02 14:52:44.211216 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.211197 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 14:52:44.211535 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.211516 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65d8647c49-lrt7h"] Jul 02 14:52:44.213634 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.213618 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.215365 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.215351 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bnkbn\"" Jul 02 14:52:44.215555 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.215541 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 14:52:44.215631 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.215545 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 14:52:44.215689 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.215662 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 14:52:44.216106 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.216092 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 14:52:44.216493 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.216478 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 14:52:44.216867 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.216850 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 14:52:44.224179 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.224159 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs"] Jul 02 14:52:44.228395 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.228372 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65d8647c49-lrt7h"] Jul 02 14:52:44.276567 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276545 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4368dc51-7877-4af3-9623-a28c0d6d3a9d-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-d9x4w\" (UID: \"4368dc51-7877-4af3-9623-a28c0d6d3a9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.276658 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/baa7b16f-3062-47ee-87b9-b17060a67326-config\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.276658 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276591 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-default-certificate\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.276658 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.276658 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baa7b16f-3062-47ee-87b9-b17060a67326-trusted-ca\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.276658 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.276884 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.276884 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276706 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa7b16f-3062-47ee-87b9-b17060a67326-serving-cert\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.276884 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:44.276884 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.276788 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:44.276884 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276795 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4368dc51-7877-4af3-9623-a28c0d6d3a9d-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-d9x4w\" (UID: \"4368dc51-7877-4af3-9623-a28c0d6d3a9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.276884 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.276836 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 14:52:44.276884 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276877 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzclt\" (UniqueName: \"kubernetes.io/projected/6e8695ae-1c13-4545-98ef-0df65454ef4d-kube-api-access-xzclt\") pod \"service-ca-operator-5d7b7dc95c-6rgcs\" (UID: \"6e8695ae-1c13-4545-98ef-0df65454ef4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.276903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d2x6\" (UniqueName: \"kubernetes.io/projected/86d096b5-cb22-4fc8-8417-382bc87322c6-kube-api-access-9d2x6\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.276936 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls podName:51a0c98d-5be5-452a-9320-b9857bed2e76 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:44.776913142 +0000 UTC m=+258.819715541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-cbv2g" (UID: "51a0c98d-5be5-452a-9320-b9857bed2e76") : secret "samples-operator-tls" not found Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.276973 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls podName:e21a9e03-ccfb-4ede-9c2b-2cbf8815712f nodeName:}" failed. No retries permitted until 2026-07-02 14:52:44.776955686 +0000 UTC m=+258.819758086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-kv6nm" (UID: "e21a9e03-ccfb-4ede-9c2b-2cbf8815712f") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqgf6\" (UniqueName: \"kubernetes.io/projected/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-kube-api-access-qqgf6\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277065 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6z5s\" (UniqueName: \"kubernetes.io/projected/4368dc51-7877-4af3-9623-a28c0d6d3a9d-kube-api-access-v6z5s\") pod \"kube-storage-version-migrator-operator-79964ff6f9-d9x4w\" (UID: \"4368dc51-7877-4af3-9623-a28c0d6d3a9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277091 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e8695ae-1c13-4545-98ef-0df65454ef4d-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-6rgcs\" (UID: \"6e8695ae-1c13-4545-98ef-0df65454ef4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-stats-auth\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsqkj\" (UniqueName: \"kubernetes.io/projected/51a0c98d-5be5-452a-9320-b9857bed2e76-kube-api-access-qsqkj\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:44.277206 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277201 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqjmv\" (UniqueName: \"kubernetes.io/projected/baa7b16f-3062-47ee-87b9-b17060a67326-kube-api-access-lqjmv\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.277660 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277226 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e8695ae-1c13-4545-98ef-0df65454ef4d-config\") pod \"service-ca-operator-5d7b7dc95c-6rgcs\" (UID: \"6e8695ae-1c13-4545-98ef-0df65454ef4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.277660 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277363 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/baa7b16f-3062-47ee-87b9-b17060a67326-config\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.277660 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277479 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4368dc51-7877-4af3-9623-a28c0d6d3a9d-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-d9x4w\" (UID: \"4368dc51-7877-4af3-9623-a28c0d6d3a9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.277660 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277492 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baa7b16f-3062-47ee-87b9-b17060a67326-trusted-ca\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.277845 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.277828 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.279508 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.279489 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4368dc51-7877-4af3-9623-a28c0d6d3a9d-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-d9x4w\" (UID: \"4368dc51-7877-4af3-9623-a28c0d6d3a9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.279621 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.279600 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa7b16f-3062-47ee-87b9-b17060a67326-serving-cert\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.284554 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.284534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqgf6\" (UniqueName: \"kubernetes.io/projected/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-kube-api-access-qqgf6\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.287725 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.287706 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqjmv\" (UniqueName: \"kubernetes.io/projected/baa7b16f-3062-47ee-87b9-b17060a67326-kube-api-access-lqjmv\") pod \"console-operator-7fdbdf9c99-b6mdd\" (UID: \"baa7b16f-3062-47ee-87b9-b17060a67326\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.287904 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.287887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6z5s\" (UniqueName: \"kubernetes.io/projected/4368dc51-7877-4af3-9623-a28c0d6d3a9d-kube-api-access-v6z5s\") pod \"kube-storage-version-migrator-operator-79964ff6f9-d9x4w\" (UID: \"4368dc51-7877-4af3-9623-a28c0d6d3a9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.288273 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.288253 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsqkj\" (UniqueName: \"kubernetes.io/projected/51a0c98d-5be5-452a-9320-b9857bed2e76-kube-api-access-qsqkj\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:44.378456 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.378389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzclt\" (UniqueName: \"kubernetes.io/projected/6e8695ae-1c13-4545-98ef-0df65454ef4d-kube-api-access-xzclt\") pod \"service-ca-operator-5d7b7dc95c-6rgcs\" (UID: \"6e8695ae-1c13-4545-98ef-0df65454ef4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.378456 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.378419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d2x6\" (UniqueName: \"kubernetes.io/projected/86d096b5-cb22-4fc8-8417-382bc87322c6-kube-api-access-9d2x6\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.378456 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.378446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e8695ae-1c13-4545-98ef-0df65454ef4d-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-6rgcs\" (UID: \"6e8695ae-1c13-4545-98ef-0df65454ef4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.378650 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.378471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-stats-auth\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.378650 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.378498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e8695ae-1c13-4545-98ef-0df65454ef4d-config\") pod \"service-ca-operator-5d7b7dc95c-6rgcs\" (UID: \"6e8695ae-1c13-4545-98ef-0df65454ef4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.378650 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.378539 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-default-certificate\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.378650 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.378561 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.378650 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.378597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.378991 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.378678 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:52:44.378991 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.378710 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:44.878690178 +0000 UTC m=+258.921492578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : configmap references non-existent config key: service-ca.crt Jul 02 14:52:44.378991 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.378728 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:44.878719439 +0000 UTC m=+258.921521826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : secret "router-metrics-certs-default" not found Jul 02 14:52:44.379122 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.379103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e8695ae-1c13-4545-98ef-0df65454ef4d-config\") pod \"service-ca-operator-5d7b7dc95c-6rgcs\" (UID: \"6e8695ae-1c13-4545-98ef-0df65454ef4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.380805 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.380785 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-stats-auth\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.381104 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.381084 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e8695ae-1c13-4545-98ef-0df65454ef4d-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-6rgcs\" (UID: \"6e8695ae-1c13-4545-98ef-0df65454ef4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.381401 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.381378 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-default-certificate\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.388547 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.388527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d2x6\" (UniqueName: \"kubernetes.io/projected/86d096b5-cb22-4fc8-8417-382bc87322c6-kube-api-access-9d2x6\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.388878 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.388862 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzclt\" (UniqueName: \"kubernetes.io/projected/6e8695ae-1c13-4545-98ef-0df65454ef4d-kube-api-access-xzclt\") pod \"service-ca-operator-5d7b7dc95c-6rgcs\" (UID: \"6e8695ae-1c13-4545-98ef-0df65454ef4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.420957 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.420932 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:44.426702 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.426680 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" Jul 02 14:52:44.518679 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.518650 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" Jul 02 14:52:44.551936 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.551832 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w"] Jul 02 14:52:44.554313 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:52:44.554287 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4368dc51_7877_4af3_9623_a28c0d6d3a9d.slice/crio-cc5dabe5aa5eaa4ac9de00be6ee403378e8ba70e13de943cf20a8ce5ef4b9261 WatchSource:0}: Error finding container cc5dabe5aa5eaa4ac9de00be6ee403378e8ba70e13de943cf20a8ce5ef4b9261: Status 404 returned error can't find the container with id cc5dabe5aa5eaa4ac9de00be6ee403378e8ba70e13de943cf20a8ce5ef4b9261 Jul 02 14:52:44.570444 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.570383 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-b6mdd"] Jul 02 14:52:44.574682 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:52:44.574657 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa7b16f_3062_47ee_87b9_b17060a67326.slice/crio-8a22a3960ccbe66afead0bd5c1134f0681b2693342e1a47076c683e07b116c1e WatchSource:0}: Error finding container 8a22a3960ccbe66afead0bd5c1134f0681b2693342e1a47076c683e07b116c1e: Status 404 returned error can't find the container with id 8a22a3960ccbe66afead0bd5c1134f0681b2693342e1a47076c683e07b116c1e Jul 02 14:52:44.645951 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.645868 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs"] Jul 02 14:52:44.649408 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:52:44.649374 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8695ae_1c13_4545_98ef_0df65454ef4d.slice/crio-e0a3be0ab9497e0a981976ee7f5dbcc9315d8c685b7ac1f314bf2e0fa878d2b5 WatchSource:0}: Error finding container e0a3be0ab9497e0a981976ee7f5dbcc9315d8c685b7ac1f314bf2e0fa878d2b5: Status 404 returned error can't find the container with id e0a3be0ab9497e0a981976ee7f5dbcc9315d8c685b7ac1f314bf2e0fa878d2b5 Jul 02 14:52:44.782197 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.782173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:44.782367 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.782266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:44.782367 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.782315 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 14:52:44.782484 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.782367 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:44.782484 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.782389 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls podName:51a0c98d-5be5-452a-9320-b9857bed2e76 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:45.782374282 +0000 UTC m=+259.825176670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-cbv2g" (UID: "51a0c98d-5be5-452a-9320-b9857bed2e76") : secret "samples-operator-tls" not found Jul 02 14:52:44.782484 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.782406 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls podName:e21a9e03-ccfb-4ede-9c2b-2cbf8815712f nodeName:}" failed. No retries permitted until 2026-07-02 14:52:45.782395645 +0000 UTC m=+259.825198029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-kv6nm" (UID: "e21a9e03-ccfb-4ede-9c2b-2cbf8815712f") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:44.883349 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.883312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.883502 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:44.883369 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:44.883502 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.883489 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:45.88347236 +0000 UTC m=+259.926274744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : configmap references non-existent config key: service-ca.crt Jul 02 14:52:44.883580 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.883502 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:52:44.883580 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:44.883541 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:45.883528789 +0000 UTC m=+259.926331173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : secret "router-metrics-certs-default" not found Jul 02 14:52:45.313660 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:45.313626 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" event={"ID":"6e8695ae-1c13-4545-98ef-0df65454ef4d","Type":"ContainerStarted","Data":"e0a3be0ab9497e0a981976ee7f5dbcc9315d8c685b7ac1f314bf2e0fa878d2b5"} Jul 02 14:52:45.314636 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:45.314615 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" event={"ID":"baa7b16f-3062-47ee-87b9-b17060a67326","Type":"ContainerStarted","Data":"8a22a3960ccbe66afead0bd5c1134f0681b2693342e1a47076c683e07b116c1e"} Jul 02 14:52:45.317352 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:45.317312 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" event={"ID":"4368dc51-7877-4af3-9623-a28c0d6d3a9d","Type":"ContainerStarted","Data":"cc5dabe5aa5eaa4ac9de00be6ee403378e8ba70e13de943cf20a8ce5ef4b9261"} Jul 02 14:52:45.790629 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:45.790532 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:45.790629 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:45.790596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:45.790888 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:45.790698 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:45.790888 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:45.790712 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 14:52:45.790888 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:45.790774 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls podName:51a0c98d-5be5-452a-9320-b9857bed2e76 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:47.790755534 +0000 UTC m=+261.833557918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-cbv2g" (UID: "51a0c98d-5be5-452a-9320-b9857bed2e76") : secret "samples-operator-tls" not found Jul 02 14:52:45.790888 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:45.790792 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls podName:e21a9e03-ccfb-4ede-9c2b-2cbf8815712f nodeName:}" failed. No retries permitted until 2026-07-02 14:52:47.790783085 +0000 UTC m=+261.833585474 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-kv6nm" (UID: "e21a9e03-ccfb-4ede-9c2b-2cbf8815712f") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:45.891447 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:45.891418 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:45.891622 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:45.891527 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:45.891622 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:45.891580 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:52:45.891742 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:45.891649 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:47.891630619 +0000 UTC m=+261.934433009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : configmap references non-existent config key: service-ca.crt Jul 02 14:52:45.891742 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:45.891670 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:47.891660008 +0000 UTC m=+261.934462396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : secret "router-metrics-certs-default" not found Jul 02 14:52:47.806797 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:47.806756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:47.807282 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:47.806900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:47.807282 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:47.806936 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 14:52:47.807282 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:47.807017 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls podName:51a0c98d-5be5-452a-9320-b9857bed2e76 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:51.806996587 +0000 UTC m=+265.849798971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-cbv2g" (UID: "51a0c98d-5be5-452a-9320-b9857bed2e76") : secret "samples-operator-tls" not found Jul 02 14:52:47.807282 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:47.807016 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:47.807282 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:47.807056 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls podName:e21a9e03-ccfb-4ede-9c2b-2cbf8815712f nodeName:}" failed. No retries permitted until 2026-07-02 14:52:51.807046192 +0000 UTC m=+265.849848579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-kv6nm" (UID: "e21a9e03-ccfb-4ede-9c2b-2cbf8815712f") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:47.907230 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:47.907211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:47.907294 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:47.907245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:47.907387 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:47.907370 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:51.90732804 +0000 UTC m=+265.950130428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : configmap references non-existent config key: service-ca.crt Jul 02 14:52:47.907461 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:47.907393 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:52:47.907461 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:47.907442 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:51.907427056 +0000 UTC m=+265.950229456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : secret "router-metrics-certs-default" not found Jul 02 14:52:48.326546 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.326505 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" event={"ID":"4368dc51-7877-4af3-9623-a28c0d6d3a9d","Type":"ContainerStarted","Data":"f5d1586e08846c570254aa58e7b3e7e6190432f9c6ee36433a78e69efd34ee34"} Jul 02 14:52:48.327998 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.327970 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" event={"ID":"6e8695ae-1c13-4545-98ef-0df65454ef4d","Type":"ContainerStarted","Data":"c7026966633d9dc8a632f2d783c740eb66c39aaf05ef34dde8b4e010acff4c75"} Jul 02 14:52:48.329415 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.329396 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/0.log" Jul 02 14:52:48.329502 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.329434 2566 generic.go:356] "Generic (PLEG): container finished" podID="baa7b16f-3062-47ee-87b9-b17060a67326" containerID="fd6a5b8d7505a0d8d75fd6d868653532f1d5450ef4e33ea20de722c54f75c0e7" exitCode=255 Jul 02 14:52:48.329502 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.329464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" event={"ID":"baa7b16f-3062-47ee-87b9-b17060a67326","Type":"ContainerDied","Data":"fd6a5b8d7505a0d8d75fd6d868653532f1d5450ef4e33ea20de722c54f75c0e7"} Jul 02 14:52:48.329698 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.329681 2566 scope.go:117] "RemoveContainer" containerID="fd6a5b8d7505a0d8d75fd6d868653532f1d5450ef4e33ea20de722c54f75c0e7" Jul 02 14:52:48.341510 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.341465 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" podStartSLOduration=0.992572287 podStartE2EDuration="4.341448843s" totalImagesPullingTime="3.348876556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:52:48.340591845 +0000 UTC m=+262.383394251" watchObservedRunningTime="2026-07-02 14:52:48.341448843 +0000 UTC m=+262.384251254" Jul 02 14:52:48.357436 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.357391 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" podStartSLOduration=1.097688792 podStartE2EDuration="4.357373869s" totalImagesPullingTime="3.259685077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:52:48.356166881 +0000 UTC m=+262.398969288" watchObservedRunningTime="2026-07-02 14:52:48.357373869 +0000 UTC m=+262.400176256" Jul 02 14:52:48.482167 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.482135 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h6dtf"] Jul 02 14:52:48.485540 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.485475 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.487597 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.487579 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 14:52:48.487689 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.487630 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 14:52:48.487689 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.487636 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 14:52:48.487804 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.487771 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9m28\"" Jul 02 14:52:48.487858 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.487838 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 14:52:48.508622 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.508595 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6dtf"] Jul 02 14:52:48.613043 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.612965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45f46634-ecde-4774-87d0-8112f0a396c7-crio-socket\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.613190 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.613154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45f46634-ecde-4774-87d0-8112f0a396c7-data-volume\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.613252 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.613190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.613252 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.613240 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wsgr\" (UniqueName: \"kubernetes.io/projected/45f46634-ecde-4774-87d0-8112f0a396c7-kube-api-access-9wsgr\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.613326 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.613284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.713676 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.713643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45f46634-ecde-4774-87d0-8112f0a396c7-data-volume\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.713676 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.713678 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.713939 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.713705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wsgr\" (UniqueName: \"kubernetes.io/projected/45f46634-ecde-4774-87d0-8112f0a396c7-kube-api-access-9wsgr\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.713939 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:48.713809 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:48.713939 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.713846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.713939 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:48.713881 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:49.213861436 +0000 UTC m=+263.256663922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : configmap "kube-rbac-proxy" not found Jul 02 14:52:48.713939 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.713929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45f46634-ecde-4774-87d0-8112f0a396c7-crio-socket\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.714138 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:48.713945 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:48.714138 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:48.713999 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:49.21398187 +0000 UTC m=+263.256784270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:48.714138 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.714023 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45f46634-ecde-4774-87d0-8112f0a396c7-crio-socket\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.714138 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.714057 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45f46634-ecde-4774-87d0-8112f0a396c7-data-volume\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:48.721299 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:48.721270 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wsgr\" (UniqueName: \"kubernetes.io/projected/45f46634-ecde-4774-87d0-8112f0a396c7-kube-api-access-9wsgr\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:49.217467 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:49.217434 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:49.217831 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:49.217487 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:49.217831 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:49.217567 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:49.217831 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:49.217588 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:49.217831 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:49.217634 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:50.21762046 +0000 UTC m=+264.260422844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:49.217831 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:49.217650 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:50.217641727 +0000 UTC m=+264.260444111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : configmap "kube-rbac-proxy" not found Jul 02 14:52:49.333485 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:49.333456 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/1.log" Jul 02 14:52:49.333873 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:49.333857 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/0.log" Jul 02 14:52:49.333939 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:49.333892 2566 generic.go:356] "Generic (PLEG): container finished" podID="baa7b16f-3062-47ee-87b9-b17060a67326" containerID="5ffcbc8f03964d409cbc113f11234e91d2b79e56bdd29953b7083b1bca58f979" exitCode=255 Jul 02 14:52:49.333981 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:49.333962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" event={"ID":"baa7b16f-3062-47ee-87b9-b17060a67326","Type":"ContainerDied","Data":"5ffcbc8f03964d409cbc113f11234e91d2b79e56bdd29953b7083b1bca58f979"} Jul 02 14:52:49.334031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:49.334020 2566 scope.go:117] "RemoveContainer" containerID="fd6a5b8d7505a0d8d75fd6d868653532f1d5450ef4e33ea20de722c54f75c0e7" Jul 02 14:52:49.334238 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:49.334220 2566 scope.go:117] "RemoveContainer" containerID="5ffcbc8f03964d409cbc113f11234e91d2b79e56bdd29953b7083b1bca58f979" Jul 02 14:52:49.334453 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:49.334433 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-b6mdd_openshift-console-operator(baa7b16f-3062-47ee-87b9-b17060a67326)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" podUID="baa7b16f-3062-47ee-87b9-b17060a67326" Jul 02 14:52:50.223952 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:50.223920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:50.224405 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:50.223973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:50.224405 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:50.224062 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:50.224405 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:50.224089 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:50.224405 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:50.224161 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:52.224143775 +0000 UTC m=+266.266946159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:50.224405 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:50.224180 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:52.224171257 +0000 UTC m=+266.266973641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : configmap "kube-rbac-proxy" not found Jul 02 14:52:50.254981 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:50.254956 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-42pcg_d165d31f-741f-45c7-822c-752f0af54a09/dns-node-resolver/0.log" Jul 02 14:52:50.338349 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:50.338308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/1.log" Jul 02 14:52:50.338664 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:50.338650 2566 scope.go:117] "RemoveContainer" containerID="5ffcbc8f03964d409cbc113f11234e91d2b79e56bdd29953b7083b1bca58f979" Jul 02 14:52:50.338823 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:50.338804 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-b6mdd_openshift-console-operator(baa7b16f-3062-47ee-87b9-b17060a67326)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" podUID="baa7b16f-3062-47ee-87b9-b17060a67326" Jul 02 14:52:51.257381 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:51.257349 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-52d67_7b452d0c-4883-462b-828f-daf3e42d7c08/node-ca/0.log" Jul 02 14:52:51.838442 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:51.838401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:51.838642 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:51.838518 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:51.838642 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:51.838562 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 14:52:51.838642 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:51.838640 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls podName:51a0c98d-5be5-452a-9320-b9857bed2e76 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:59.838620271 +0000 UTC m=+273.881422667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-cbv2g" (UID: "51a0c98d-5be5-452a-9320-b9857bed2e76") : secret "samples-operator-tls" not found Jul 02 14:52:51.838780 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:51.838679 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:51.838780 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:51.838728 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls podName:e21a9e03-ccfb-4ede-9c2b-2cbf8815712f nodeName:}" failed. No retries permitted until 2026-07-02 14:52:59.838715782 +0000 UTC m=+273.881518177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-kv6nm" (UID: "e21a9e03-ccfb-4ede-9c2b-2cbf8815712f") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:51.939196 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:51.939162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:51.939480 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:51.939233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:52:51.939480 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:51.939315 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 14:52:51.939480 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:51.939400 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:59.939382725 +0000 UTC m=+273.982185114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : secret "router-metrics-certs-default" not found Jul 02 14:52:51.939480 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:51.939419 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:59.939410804 +0000 UTC m=+273.982213187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : configmap references non-existent config key: service-ca.crt Jul 02 14:52:52.241152 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:52.241122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:52.241297 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:52.241176 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:52.241297 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:52.241248 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:52.241385 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:52.241313 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:56.241298132 +0000 UTC m=+270.284100516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : configmap "kube-rbac-proxy" not found Jul 02 14:52:52.241385 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:52.241329 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:52.241455 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:52.241391 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:56.241378275 +0000 UTC m=+270.284180661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:52.457727 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:52.457694 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tx475_df366d57-a34a-4207-96fd-1d9555173e23/serve-healthcheck-canary/0.log" Jul 02 14:52:54.421131 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:54.421042 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:54.421131 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:54.421106 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:52:54.421538 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:54.421403 2566 scope.go:117] "RemoveContainer" containerID="5ffcbc8f03964d409cbc113f11234e91d2b79e56bdd29953b7083b1bca58f979" Jul 02 14:52:54.421576 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:54.421537 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-b6mdd_openshift-console-operator(baa7b16f-3062-47ee-87b9-b17060a67326)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" podUID="baa7b16f-3062-47ee-87b9-b17060a67326" Jul 02 14:52:56.272279 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:56.272242 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:56.272665 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:56.272307 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:52:56.272665 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:56.272380 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:56.272665 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:56.272454 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:53:04.272432961 +0000 UTC m=+278.315235345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : configmap "kube-rbac-proxy" not found Jul 02 14:52:56.272665 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:56.272488 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:56.272665 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:56.272542 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:53:04.272525608 +0000 UTC m=+278.315327992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:59.900872 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:59.900836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:52:59.901294 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:59.900933 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:52:59.901294 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:59.900980 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:59.901294 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:52:59.901037 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls podName:e21a9e03-ccfb-4ede-9c2b-2cbf8815712f nodeName:}" failed. No retries permitted until 2026-07-02 14:53:15.901023208 +0000 UTC m=+289.943825596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-kv6nm" (UID: "e21a9e03-ccfb-4ede-9c2b-2cbf8815712f") : secret "cluster-monitoring-operator-tls" not found Jul 02 14:52:59.903235 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:52:59.903215 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51a0c98d-5be5-452a-9320-b9857bed2e76-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-cbv2g\" (UID: \"51a0c98d-5be5-452a-9320-b9857bed2e76\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:53:00.001934 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:00.001902 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:00.002072 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:00.001965 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:00.002106 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:53:00.002079 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle podName:86d096b5-cb22-4fc8-8417-382bc87322c6 nodeName:}" failed. No retries permitted until 2026-07-02 14:53:16.002064641 +0000 UTC m=+290.044867026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle") pod "router-default-65d8647c49-lrt7h" (UID: "86d096b5-cb22-4fc8-8417-382bc87322c6") : configmap references non-existent config key: service-ca.crt Jul 02 14:53:00.004272 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:00.004252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d096b5-cb22-4fc8-8417-382bc87322c6-metrics-certs\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:00.031804 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:00.031770 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" Jul 02 14:53:00.152563 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:00.152475 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g"] Jul 02 14:53:00.371020 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:00.370989 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" event={"ID":"51a0c98d-5be5-452a-9320-b9857bed2e76","Type":"ContainerStarted","Data":"9d9a6f522582a69d881db36b1ca18e92011ee1c92c766a67ff6da2438e149b3c"} Jul 02 14:53:03.385233 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:03.385199 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" event={"ID":"51a0c98d-5be5-452a-9320-b9857bed2e76","Type":"ContainerStarted","Data":"1fa2e97e8b021ae237d173d57e59cfad155e7759fbfbe63c2b4cb71ffa9f545b"} Jul 02 14:53:03.385647 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:03.385272 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" event={"ID":"51a0c98d-5be5-452a-9320-b9857bed2e76","Type":"ContainerStarted","Data":"d2ed997cf55ae95ce43c8cd5ab2dabd40d75ff04767ad063900ec7329f2d8a30"} Jul 02 14:53:03.402111 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:03.402055 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-cbv2g" podStartSLOduration=17.245473282 podStartE2EDuration="19.402038961s" totalImagesPullingTime="2.156565679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:03.401437905 +0000 UTC m=+277.444240311" watchObservedRunningTime="2026-07-02 14:53:03.402038961 +0000 UTC m=+277.444841379" Jul 02 14:53:04.338982 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:04.338947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:53:04.339146 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:04.339004 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:53:04.339184 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:53:04.339163 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:53:04.339239 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:53:04.339229 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls podName:45f46634-ecde-4774-87d0-8112f0a396c7 nodeName:}" failed. No retries permitted until 2026-07-02 14:53:20.339214516 +0000 UTC m=+294.382016901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6dtf" (UID: "45f46634-ecde-4774-87d0-8112f0a396c7") : secret "insights-runtime-extractor-tls" not found Jul 02 14:53:04.339521 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:04.339503 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45f46634-ecde-4774-87d0-8112f0a396c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:53:06.505843 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:06.505818 2566 scope.go:117] "RemoveContainer" containerID="5ffcbc8f03964d409cbc113f11234e91d2b79e56bdd29953b7083b1bca58f979" Jul 02 14:53:07.397019 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:07.396994 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 14:53:07.397382 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:07.397366 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/1.log" Jul 02 14:53:07.397463 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:07.397399 2566 generic.go:356] "Generic (PLEG): container finished" podID="baa7b16f-3062-47ee-87b9-b17060a67326" containerID="f85bde666a88f867c789fd1d6ab8b6991cd6b2b390d1a2f9d82c5fc6adc9bfa0" exitCode=255 Jul 02 14:53:07.397463 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:07.397457 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" event={"ID":"baa7b16f-3062-47ee-87b9-b17060a67326","Type":"ContainerDied","Data":"f85bde666a88f867c789fd1d6ab8b6991cd6b2b390d1a2f9d82c5fc6adc9bfa0"} Jul 02 14:53:07.397548 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:07.397498 2566 scope.go:117] "RemoveContainer" containerID="5ffcbc8f03964d409cbc113f11234e91d2b79e56bdd29953b7083b1bca58f979" Jul 02 14:53:07.397830 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:07.397810 2566 scope.go:117] "RemoveContainer" containerID="f85bde666a88f867c789fd1d6ab8b6991cd6b2b390d1a2f9d82c5fc6adc9bfa0" Jul 02 14:53:07.397981 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:53:07.397964 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-b6mdd_openshift-console-operator(baa7b16f-3062-47ee-87b9-b17060a67326)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" podUID="baa7b16f-3062-47ee-87b9-b17060a67326" Jul 02 14:53:08.082190 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:53:08.082148 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5tbbf" podUID="6fca010e-0df5-4240-bcbd-cac7e7702982" Jul 02 14:53:08.401316 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:08.401245 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 14:53:08.401499 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:08.401354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tbbf" Jul 02 14:53:11.292023 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:11.291971 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:53:11.294245 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:11.294227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fca010e-0df5-4240-bcbd-cac7e7702982-metrics-tls\") pod \"dns-default-5tbbf\" (UID: \"6fca010e-0df5-4240-bcbd-cac7e7702982\") " pod="openshift-dns/dns-default-5tbbf" Jul 02 14:53:11.404824 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:11.404791 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gj4nd\"" Jul 02 14:53:11.413026 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:11.413003 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tbbf" Jul 02 14:53:11.536739 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:11.536717 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tbbf"] Jul 02 14:53:11.539092 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:11.539059 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fca010e_0df5_4240_bcbd_cac7e7702982.slice/crio-c8ff238058f8e6fd3ca2e6b4aef49c030daeab1e9d07578b93799cc365707d16 WatchSource:0}: Error finding container c8ff238058f8e6fd3ca2e6b4aef49c030daeab1e9d07578b93799cc365707d16: Status 404 returned error can't find the container with id c8ff238058f8e6fd3ca2e6b4aef49c030daeab1e9d07578b93799cc365707d16 Jul 02 14:53:12.413950 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.413911 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tbbf" event={"ID":"6fca010e-0df5-4240-bcbd-cac7e7702982","Type":"ContainerStarted","Data":"c8ff238058f8e6fd3ca2e6b4aef49c030daeab1e9d07578b93799cc365707d16"} Jul 02 14:53:12.456950 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.456916 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59b8c87646-zrqs7"] Jul 02 14:53:12.459155 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.459128 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.461568 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.461371 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 14:53:12.461568 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.461418 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj2f4\"" Jul 02 14:53:12.461755 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.461691 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 14:53:12.461895 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.461872 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 14:53:12.466521 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.466497 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 14:53:12.472289 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.472270 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59b8c87646-zrqs7"] Jul 02 14:53:12.601524 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.601491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlvb4\" (UniqueName: \"kubernetes.io/projected/f737c4ee-31dc-4f11-8799-3cdc5381f035-kube-api-access-rlvb4\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.601702 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.601533 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f737c4ee-31dc-4f11-8799-3cdc5381f035-trusted-ca\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.601702 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.601636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f737c4ee-31dc-4f11-8799-3cdc5381f035-bound-sa-token\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.601702 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.601687 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f737c4ee-31dc-4f11-8799-3cdc5381f035-registry-certificates\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.601850 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.601750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f737c4ee-31dc-4f11-8799-3cdc5381f035-ca-trust-extracted\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.601850 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.601772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f737c4ee-31dc-4f11-8799-3cdc5381f035-installation-pull-secrets\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.601850 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.601802 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f737c4ee-31dc-4f11-8799-3cdc5381f035-image-registry-private-configuration\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.601850 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.601832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f737c4ee-31dc-4f11-8799-3cdc5381f035-registry-tls\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.703229 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.703195 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f737c4ee-31dc-4f11-8799-3cdc5381f035-ca-trust-extracted\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.703229 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.703233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f737c4ee-31dc-4f11-8799-3cdc5381f035-installation-pull-secrets\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.703484 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.703262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f737c4ee-31dc-4f11-8799-3cdc5381f035-image-registry-private-configuration\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.703484 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.703401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f737c4ee-31dc-4f11-8799-3cdc5381f035-registry-tls\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.703596 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.703571 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvb4\" (UniqueName: \"kubernetes.io/projected/f737c4ee-31dc-4f11-8799-3cdc5381f035-kube-api-access-rlvb4\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.703649 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.703613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f737c4ee-31dc-4f11-8799-3cdc5381f035-trusted-ca\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.703703 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.703677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f737c4ee-31dc-4f11-8799-3cdc5381f035-bound-sa-token\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.703703 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.703691 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f737c4ee-31dc-4f11-8799-3cdc5381f035-ca-trust-extracted\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.703810 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.703709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f737c4ee-31dc-4f11-8799-3cdc5381f035-registry-certificates\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.704541 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.704514 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f737c4ee-31dc-4f11-8799-3cdc5381f035-registry-certificates\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.704674 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.704616 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f737c4ee-31dc-4f11-8799-3cdc5381f035-trusted-ca\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.706058 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.706031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f737c4ee-31dc-4f11-8799-3cdc5381f035-image-registry-private-configuration\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.706174 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.706104 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f737c4ee-31dc-4f11-8799-3cdc5381f035-registry-tls\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.706223 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.706192 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f737c4ee-31dc-4f11-8799-3cdc5381f035-installation-pull-secrets\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.715345 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.715292 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f737c4ee-31dc-4f11-8799-3cdc5381f035-bound-sa-token\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.715653 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.715633 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvb4\" (UniqueName: \"kubernetes.io/projected/f737c4ee-31dc-4f11-8799-3cdc5381f035-kube-api-access-rlvb4\") pod \"image-registry-59b8c87646-zrqs7\" (UID: \"f737c4ee-31dc-4f11-8799-3cdc5381f035\") " pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:12.770877 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:12.770845 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:13.210276 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:13.210207 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59b8c87646-zrqs7"] Jul 02 14:53:13.211865 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:13.211832 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf737c4ee_31dc_4f11_8799_3cdc5381f035.slice/crio-33fa4cc24314d9062c0bc6d284e4ad3738122ff77c3e785a65d17bbcdbb2b0fb WatchSource:0}: Error finding container 33fa4cc24314d9062c0bc6d284e4ad3738122ff77c3e785a65d17bbcdbb2b0fb: Status 404 returned error can't find the container with id 33fa4cc24314d9062c0bc6d284e4ad3738122ff77c3e785a65d17bbcdbb2b0fb Jul 02 14:53:13.419639 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:13.419563 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" event={"ID":"f737c4ee-31dc-4f11-8799-3cdc5381f035","Type":"ContainerStarted","Data":"1a6fe60e74bac410edfcb2af702b15749dab6a27529dfecf2b9094388da1fe02"} Jul 02 14:53:13.419639 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:13.419611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" event={"ID":"f737c4ee-31dc-4f11-8799-3cdc5381f035","Type":"ContainerStarted","Data":"33fa4cc24314d9062c0bc6d284e4ad3738122ff77c3e785a65d17bbcdbb2b0fb"} Jul 02 14:53:13.420150 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:13.419688 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:13.421463 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:13.421440 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tbbf" event={"ID":"6fca010e-0df5-4240-bcbd-cac7e7702982","Type":"ContainerStarted","Data":"4a22100dfaa7a1435aa9e19f0b69475f3f9951138002180f53279e60a3ae2ec1"} Jul 02 14:53:13.421571 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:13.421478 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tbbf" event={"ID":"6fca010e-0df5-4240-bcbd-cac7e7702982","Type":"ContainerStarted","Data":"377bf318c17bb0dc9674f0437083302d19e0cd7d15699081f3b985d01e38d5da"} Jul 02 14:53:13.421571 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:13.421528 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5tbbf" Jul 02 14:53:13.437293 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:13.437232 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" podStartSLOduration=1.437218378 podStartE2EDuration="1.437218378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:13.436305963 +0000 UTC m=+287.479108368" watchObservedRunningTime="2026-07-02 14:53:13.437218378 +0000 UTC m=+287.480020784" Jul 02 14:53:13.450862 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:13.450816 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5tbbf" podStartSLOduration=250.892829907 podStartE2EDuration="4m12.450803471s" totalImagesPullingTime="1.557973564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:13.450390435 +0000 UTC m=+287.493192845" watchObservedRunningTime="2026-07-02 14:53:13.450803471 +0000 UTC m=+287.493605882" Jul 02 14:53:14.421305 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:14.421267 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:53:14.421760 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:14.421321 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:53:14.421760 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:14.421638 2566 scope.go:117] "RemoveContainer" containerID="f85bde666a88f867c789fd1d6ab8b6991cd6b2b390d1a2f9d82c5fc6adc9bfa0" Jul 02 14:53:14.421839 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:53:14.421792 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-b6mdd_openshift-console-operator(baa7b16f-3062-47ee-87b9-b17060a67326)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" podUID="baa7b16f-3062-47ee-87b9-b17060a67326" Jul 02 14:53:15.933569 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:15.933529 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:53:15.935826 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:15.935794 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e21a9e03-ccfb-4ede-9c2b-2cbf8815712f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-kv6nm\" (UID: \"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:53:16.034151 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:16.034119 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:16.034724 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:16.034704 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d096b5-cb22-4fc8-8417-382bc87322c6-service-ca-bundle\") pod \"router-default-65d8647c49-lrt7h\" (UID: \"86d096b5-cb22-4fc8-8417-382bc87322c6\") " pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:16.211887 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:16.211855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" Jul 02 14:53:16.328472 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:16.328434 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:16.383799 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:16.383770 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm"] Jul 02 14:53:16.385937 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:16.385901 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21a9e03_ccfb_4ede_9c2b_2cbf8815712f.slice/crio-5d37e37ccc6dde4fcb395dd2f65b794c52541a66d200e75608c5918815b38baa WatchSource:0}: Error finding container 5d37e37ccc6dde4fcb395dd2f65b794c52541a66d200e75608c5918815b38baa: Status 404 returned error can't find the container with id 5d37e37ccc6dde4fcb395dd2f65b794c52541a66d200e75608c5918815b38baa Jul 02 14:53:16.431747 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:16.431718 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" event={"ID":"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f","Type":"ContainerStarted","Data":"5d37e37ccc6dde4fcb395dd2f65b794c52541a66d200e75608c5918815b38baa"} Jul 02 14:53:16.470736 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:16.470674 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65d8647c49-lrt7h"] Jul 02 14:53:16.473465 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:16.473442 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d096b5_cb22_4fc8_8417_382bc87322c6.slice/crio-badd11b0c6dd29dd6293552926ad750753f931b819c1b9b74358b4ebb94b4b35 WatchSource:0}: Error finding container badd11b0c6dd29dd6293552926ad750753f931b819c1b9b74358b4ebb94b4b35: Status 404 returned error can't find the container with id badd11b0c6dd29dd6293552926ad750753f931b819c1b9b74358b4ebb94b4b35 Jul 02 14:53:17.436615 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:17.436577 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65d8647c49-lrt7h" event={"ID":"86d096b5-cb22-4fc8-8417-382bc87322c6","Type":"ContainerStarted","Data":"85f22bc787c1dadef691b3b6570c2aedbf96a48e47e9f073940f823f700428cf"} Jul 02 14:53:17.436615 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:17.436624 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65d8647c49-lrt7h" event={"ID":"86d096b5-cb22-4fc8-8417-382bc87322c6","Type":"ContainerStarted","Data":"badd11b0c6dd29dd6293552926ad750753f931b819c1b9b74358b4ebb94b4b35"} Jul 02 14:53:17.455779 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:17.455732 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-65d8647c49-lrt7h" podStartSLOduration=33.455717523 podStartE2EDuration="33.455717523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:17.454604389 +0000 UTC m=+291.497406796" watchObservedRunningTime="2026-07-02 14:53:17.455717523 +0000 UTC m=+291.498519906" Jul 02 14:53:18.329227 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:18.329190 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:18.332170 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:18.332144 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:18.441426 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:18.441359 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:18.443054 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:18.443029 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65d8647c49-lrt7h" Jul 02 14:53:18.505036 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:53:18.505006 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dtbhn" podUID="ed7db27e-fa51-4c39-83b3-747609b46f63" Jul 02 14:53:19.446073 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:19.446037 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" event={"ID":"e21a9e03-ccfb-4ede-9c2b-2cbf8815712f","Type":"ContainerStarted","Data":"e2048a5a8d0172759620c11f2bb7642c16599ac927958d991795fc59e05ba708"} Jul 02 14:53:19.460706 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:19.460630 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-kv6nm" podStartSLOduration=32.475682592 podStartE2EDuration="35.460613727s" totalImagesPullingTime="2.984931135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:19.459709485 +0000 UTC m=+293.502511882" watchObservedRunningTime="2026-07-02 14:53:19.460613727 +0000 UTC m=+293.503416132" Jul 02 14:53:20.368975 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:20.368937 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:53:20.371185 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:20.371155 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45f46634-ecde-4774-87d0-8112f0a396c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6dtf\" (UID: \"45f46634-ecde-4774-87d0-8112f0a396c7\") " pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:53:20.615095 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:20.615047 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6dtf" Jul 02 14:53:20.743399 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:20.743369 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6dtf"] Jul 02 14:53:20.746481 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:20.746453 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f46634_ecde_4774_87d0_8112f0a396c7.slice/crio-0ff613a9d7ce289f06fcfae71397875247ce75d8700f83a7b7cab1d8b15ea009 WatchSource:0}: Error finding container 0ff613a9d7ce289f06fcfae71397875247ce75d8700f83a7b7cab1d8b15ea009: Status 404 returned error can't find the container with id 0ff613a9d7ce289f06fcfae71397875247ce75d8700f83a7b7cab1d8b15ea009 Jul 02 14:53:21.455037 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:21.454993 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6dtf" event={"ID":"45f46634-ecde-4774-87d0-8112f0a396c7","Type":"ContainerStarted","Data":"0ff613a9d7ce289f06fcfae71397875247ce75d8700f83a7b7cab1d8b15ea009"} Jul 02 14:53:23.426475 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:23.426449 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5tbbf" Jul 02 14:53:24.472531 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:24.472492 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6dtf" event={"ID":"45f46634-ecde-4774-87d0-8112f0a396c7","Type":"ContainerStarted","Data":"32b5fb3643c900571d17e2b56cb11854f48c76c963a5ad539c815d49def81f94"} Jul 02 14:53:25.477286 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:25.477254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6dtf" event={"ID":"45f46634-ecde-4774-87d0-8112f0a396c7","Type":"ContainerStarted","Data":"3b740579c631b7ea5d9ea2862e8fb076b1fbffa9260bca9406549dafcb925b03"} Jul 02 14:53:26.394801 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:26.394756 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 14:53:26.396858 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:26.396829 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 14:53:26.406917 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:26.406897 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 14:53:27.504635 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:27.504606 2566 scope.go:117] "RemoveContainer" containerID="f85bde666a88f867c789fd1d6ab8b6991cd6b2b390d1a2f9d82c5fc6adc9bfa0" Jul 02 14:53:28.490555 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.490514 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6dtf" event={"ID":"45f46634-ecde-4774-87d0-8112f0a396c7","Type":"ContainerStarted","Data":"efa9c371a67e0b6baf1765a8500c2c3bcb25ec5dc01c351ce4c962e3a827c342"} Jul 02 14:53:28.492302 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.492284 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 14:53:28.492424 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.492322 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" event={"ID":"baa7b16f-3062-47ee-87b9-b17060a67326","Type":"ContainerStarted","Data":"bef475c9d1f0a77809b415180434e422833100d991f3407cfd36084da1b6f427"} Jul 02 14:53:28.492609 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.492594 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:53:28.507640 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.507601 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h6dtf" podStartSLOduration=33.035669604 podStartE2EDuration="40.507585423s" totalImagesPullingTime="7.471915819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:52:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:28.506437008 +0000 UTC m=+302.549239427" watchObservedRunningTime="2026-07-02 14:53:28.507585423 +0000 UTC m=+302.550387830" Jul 02 14:53:28.521025 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.520983 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" podStartSLOduration=41.185924312 podStartE2EDuration="44.520970722s" totalImagesPullingTime="3.33504641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:28.520428391 +0000 UTC m=+302.563230815" watchObservedRunningTime="2026-07-02 14:53:28.520970722 +0000 UTC m=+302.563773130" Jul 02 14:53:28.724886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.724857 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-b6mdd" Jul 02 14:53:28.912406 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.912376 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-k7jq5"] Jul 02 14:53:28.915418 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.915398 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-k7jq5" Jul 02 14:53:28.917529 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.917488 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 14:53:28.917889 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.917870 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 14:53:28.918173 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.918157 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-p8rzq\"" Jul 02 14:53:28.929399 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:28.929378 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-k7jq5"] Jul 02 14:53:29.040526 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:29.040449 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btm4h\" (UniqueName: \"kubernetes.io/projected/63798f4a-7862-4095-8fb8-0cc9d69f404d-kube-api-access-btm4h\") pod \"downloads-5499b6fb8f-k7jq5\" (UID: \"63798f4a-7862-4095-8fb8-0cc9d69f404d\") " pod="openshift-console/downloads-5499b6fb8f-k7jq5" Jul 02 14:53:29.141729 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:29.141695 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btm4h\" (UniqueName: \"kubernetes.io/projected/63798f4a-7862-4095-8fb8-0cc9d69f404d-kube-api-access-btm4h\") pod \"downloads-5499b6fb8f-k7jq5\" (UID: \"63798f4a-7862-4095-8fb8-0cc9d69f404d\") " pod="openshift-console/downloads-5499b6fb8f-k7jq5" Jul 02 14:53:29.156649 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:29.156619 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btm4h\" (UniqueName: \"kubernetes.io/projected/63798f4a-7862-4095-8fb8-0cc9d69f404d-kube-api-access-btm4h\") pod \"downloads-5499b6fb8f-k7jq5\" (UID: \"63798f4a-7862-4095-8fb8-0cc9d69f404d\") " pod="openshift-console/downloads-5499b6fb8f-k7jq5" Jul 02 14:53:29.226058 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:29.226027 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-k7jq5" Jul 02 14:53:29.362218 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:29.362184 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-k7jq5"] Jul 02 14:53:29.365949 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:29.365905 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63798f4a_7862_4095_8fb8_0cc9d69f404d.slice/crio-6e3558f1bf11e1743f60634afb4fab7649a3451d629ecad40e07b94d303894b9 WatchSource:0}: Error finding container 6e3558f1bf11e1743f60634afb4fab7649a3451d629ecad40e07b94d303894b9: Status 404 returned error can't find the container with id 6e3558f1bf11e1743f60634afb4fab7649a3451d629ecad40e07b94d303894b9 Jul 02 14:53:29.368436 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:29.368415 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:53:29.496977 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:29.496938 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-k7jq5" event={"ID":"63798f4a-7862-4095-8fb8-0cc9d69f404d","Type":"ContainerStarted","Data":"6e3558f1bf11e1743f60634afb4fab7649a3451d629ecad40e07b94d303894b9"} Jul 02 14:53:31.504808 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.504776 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:53:31.561867 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.561834 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ntqtq"] Jul 02 14:53:31.565422 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.565391 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.569450 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.569384 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 14:53:31.569569 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.569486 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 14:53:31.570135 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.570004 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9ks79\"" Jul 02 14:53:31.570135 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.570107 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 14:53:31.570135 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.570109 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 14:53:31.662400 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.662364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94ba87b5-14c2-4609-9d55-6d64c035314b-sys\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.662400 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.662405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc6vd\" (UniqueName: \"kubernetes.io/projected/94ba87b5-14c2-4609-9d55-6d64c035314b-kube-api-access-hc6vd\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.662652 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.662429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-wtmp\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.662652 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.662503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94ba87b5-14c2-4609-9d55-6d64c035314b-metrics-client-ca\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.662652 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.662549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-tls\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.662652 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.662585 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.662652 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.662628 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94ba87b5-14c2-4609-9d55-6d64c035314b-root\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.662843 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.662652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-textfile\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.662843 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.662680 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.763817 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.763728 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94ba87b5-14c2-4609-9d55-6d64c035314b-metrics-client-ca\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.763817 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.763781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-tls\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.763817 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.763813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764099 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.763840 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94ba87b5-14c2-4609-9d55-6d64c035314b-root\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764099 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.763886 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94ba87b5-14c2-4609-9d55-6d64c035314b-root\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764099 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.763925 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-textfile\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764099 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.763952 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764099 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.763991 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94ba87b5-14c2-4609-9d55-6d64c035314b-sys\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764099 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.764012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc6vd\" (UniqueName: \"kubernetes.io/projected/94ba87b5-14c2-4609-9d55-6d64c035314b-kube-api-access-hc6vd\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764099 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.764036 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-wtmp\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764472 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.764177 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-wtmp\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764472 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.764185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94ba87b5-14c2-4609-9d55-6d64c035314b-sys\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764472 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.764408 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-textfile\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764626 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.764515 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94ba87b5-14c2-4609-9d55-6d64c035314b-metrics-client-ca\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.764695 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.764675 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.766378 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.766349 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.766502 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.766489 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94ba87b5-14c2-4609-9d55-6d64c035314b-node-exporter-tls\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.781410 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.781387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc6vd\" (UniqueName: \"kubernetes.io/projected/94ba87b5-14c2-4609-9d55-6d64c035314b-kube-api-access-hc6vd\") pod \"node-exporter-ntqtq\" (UID: \"94ba87b5-14c2-4609-9d55-6d64c035314b\") " pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:31.876544 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:31.876507 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ntqtq" Jul 02 14:53:32.450802 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.450764 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 14:53:32.455785 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.455763 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.458661 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.458637 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 14:53:32.458661 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.458657 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 14:53:32.458859 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.458645 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 14:53:32.458941 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.458922 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 14:53:32.459187 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.459148 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 14:53:32.459187 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.459170 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 14:53:32.459443 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.459351 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 14:53:32.459443 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.459436 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vrzcn\"" Jul 02 14:53:32.459595 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.459564 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 14:53:32.459657 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.459611 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 14:53:32.470883 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.470864 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 14:53:32.509889 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.509857 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntqtq" event={"ID":"94ba87b5-14c2-4609-9d55-6d64c035314b","Type":"ContainerStarted","Data":"1c13ec19fa8dfa0bb5fc48ee556be0e832e6d5eb9f6ab28e3e417fea91db36de"} Jul 02 14:53:32.570200 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570430 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570430 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-out\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570430 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570323 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-web-config\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570430 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570430 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570430 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570425 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dpcx\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-kube-api-access-7dpcx\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570782 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570782 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570471 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570782 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570489 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570782 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570782 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.570782 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.570584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.671807 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.671772 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.671807 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.671810 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672033 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.671838 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dpcx\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-kube-api-access-7dpcx\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672033 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:53:32.671989 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-trusted-ca-bundle podName:40d3ea41-ec9a-40fa-95c9-f28e096326b6 nodeName:}" failed. No retries permitted until 2026-07-02 14:53:33.171968188 +0000 UTC m=+307.214770575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6") : configmap references non-existent config key: ca-bundle.crt Jul 02 14:53:32.672149 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672149 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672118 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672259 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672147 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672259 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672259 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672259 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672240 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672259 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672253 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672531 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672299 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672531 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672531 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672422 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-out\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.672531 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.672446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-web-config\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.673036 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.673011 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.676031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.675744 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.677011 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.676983 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.677327 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.677282 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.677327 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.677315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.677327 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.677325 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.677732 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.677692 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-web-config\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.678251 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.678226 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-out\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.678776 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.678736 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.678879 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.678857 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:32.680506 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:32.680485 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dpcx\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-kube-api-access-7dpcx\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:33.178111 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:33.178075 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:33.178846 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:33.178825 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:33.366553 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:33.366517 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:53:33.519722 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:33.519698 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 14:53:33.523865 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:33.523834 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d3ea41_ec9a_40fa_95c9_f28e096326b6.slice/crio-42183abafdf9f2855bee3ea885a3e7eed8d6593f423cf25f5a1af08eedf38e17 WatchSource:0}: Error finding container 42183abafdf9f2855bee3ea885a3e7eed8d6593f423cf25f5a1af08eedf38e17: Status 404 returned error can't find the container with id 42183abafdf9f2855bee3ea885a3e7eed8d6593f423cf25f5a1af08eedf38e17 Jul 02 14:53:34.367600 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.367516 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7869d4594c-p8fvm"] Jul 02 14:53:34.371838 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.371810 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.377326 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.377291 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f16bvvl3gfep1\"" Jul 02 14:53:34.377469 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.377290 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 14:53:34.377919 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.377896 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dh4v4\"" Jul 02 14:53:34.378038 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.377936 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 14:53:34.378038 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.377971 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 14:53:34.378038 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.377991 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 14:53:34.378190 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.378153 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 14:53:34.383975 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.383940 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7869d4594c-p8fvm"] Jul 02 14:53:34.429068 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.429041 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59b8c87646-zrqs7" Jul 02 14:53:34.490068 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.490010 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.490632 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.490087 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.490632 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.490141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-tls\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.490632 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.490174 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/181d92f3-861f-455a-8e76-12bf30663c11-metrics-client-ca\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.490632 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.490255 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.490632 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.490328 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-grpc-tls\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.490632 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.490407 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.490632 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.490435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2ksq\" (UniqueName: \"kubernetes.io/projected/181d92f3-861f-455a-8e76-12bf30663c11-kube-api-access-r2ksq\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.520505 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.520365 2566 generic.go:356] "Generic (PLEG): container finished" podID="94ba87b5-14c2-4609-9d55-6d64c035314b" containerID="aceaddd27b8a9a4980aa86818bf1c07ce55e3359269cb3863aa7b16f93c08503" exitCode=0 Jul 02 14:53:34.520505 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.520435 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntqtq" event={"ID":"94ba87b5-14c2-4609-9d55-6d64c035314b","Type":"ContainerDied","Data":"aceaddd27b8a9a4980aa86818bf1c07ce55e3359269cb3863aa7b16f93c08503"} Jul 02 14:53:34.522308 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.522233 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerStarted","Data":"42183abafdf9f2855bee3ea885a3e7eed8d6593f423cf25f5a1af08eedf38e17"} Jul 02 14:53:34.591404 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.591273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.591404 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.591318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.591404 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.591375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-tls\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.591404 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.591404 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/181d92f3-861f-455a-8e76-12bf30663c11-metrics-client-ca\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.591631 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.591490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.591631 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.591567 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-grpc-tls\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.591631 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.591609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.591733 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.591639 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2ksq\" (UniqueName: \"kubernetes.io/projected/181d92f3-861f-455a-8e76-12bf30663c11-kube-api-access-r2ksq\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.593089 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.593057 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/181d92f3-861f-455a-8e76-12bf30663c11-metrics-client-ca\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.595461 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.595416 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-grpc-tls\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.595729 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.595707 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.595994 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.595946 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.596101 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.596076 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.600410 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.600017 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-tls\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.600661 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.600621 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/181d92f3-861f-455a-8e76-12bf30663c11-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.602944 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.602902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2ksq\" (UniqueName: \"kubernetes.io/projected/181d92f3-861f-455a-8e76-12bf30663c11-kube-api-access-r2ksq\") pod \"thanos-querier-7869d4594c-p8fvm\" (UID: \"181d92f3-861f-455a-8e76-12bf30663c11\") " pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:34.683601 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:34.683570 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:35.093157 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:35.093132 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7869d4594c-p8fvm"] Jul 02 14:53:35.096651 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:35.096623 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181d92f3_861f_455a_8e76_12bf30663c11.slice/crio-22b6b30445ac67ba5204f503338b3b81584eb95bbf01907fbd95afe32e6189ab WatchSource:0}: Error finding container 22b6b30445ac67ba5204f503338b3b81584eb95bbf01907fbd95afe32e6189ab: Status 404 returned error can't find the container with id 22b6b30445ac67ba5204f503338b3b81584eb95bbf01907fbd95afe32e6189ab Jul 02 14:53:35.528234 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:35.528194 2566 generic.go:356] "Generic (PLEG): container finished" podID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerID="f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500" exitCode=0 Jul 02 14:53:35.528738 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:35.528289 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerDied","Data":"f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500"} Jul 02 14:53:35.530108 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:35.529939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" event={"ID":"181d92f3-861f-455a-8e76-12bf30663c11","Type":"ContainerStarted","Data":"22b6b30445ac67ba5204f503338b3b81584eb95bbf01907fbd95afe32e6189ab"} Jul 02 14:53:35.532501 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:35.532477 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntqtq" event={"ID":"94ba87b5-14c2-4609-9d55-6d64c035314b","Type":"ContainerStarted","Data":"0cbfc3dffcf162aa4b28a82323284b0f83e6a993ac932e11f3a578e429ef3931"} Jul 02 14:53:35.532613 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:35.532526 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntqtq" event={"ID":"94ba87b5-14c2-4609-9d55-6d64c035314b","Type":"ContainerStarted","Data":"00a2a681af90ea5abc90a315dc637d8f991336fd8ae4bf62afabd7b6359eca98"} Jul 02 14:53:35.574276 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:35.574211 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ntqtq" podStartSLOduration=2.388731611 podStartE2EDuration="4.574191277s" totalImagesPullingTime="2.11052358s" totalInitContainerRuntime="74.936086ms" isStatefulPod=true podCreationTimestamp="2026-07-02 14:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:35.572476762 +0000 UTC m=+309.615279170" watchObservedRunningTime="2026-07-02 14:53:35.574191277 +0000 UTC m=+309.616993662" Jul 02 14:53:38.238740 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.238616 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64744f57bc-xdn7t"] Jul 02 14:53:38.242654 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.242593 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.245833 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.245585 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 14:53:38.245833 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.245641 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nb5xk\"" Jul 02 14:53:38.245833 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.245806 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 14:53:38.246027 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.245856 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 14:53:38.246027 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.245986 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 14:53:38.246128 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.246110 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 14:53:38.256174 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.256109 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64744f57bc-xdn7t"] Jul 02 14:53:38.327302 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.326910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-serving-cert\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.327302 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.326985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-oauth-config\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.327302 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.327012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-oauth-serving-cert\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.327302 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.327057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-service-ca\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.327302 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.327091 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-config\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.327302 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.327127 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t986q\" (UniqueName: \"kubernetes.io/projected/693dd103-076d-4a89-8fad-fd9ba87ed0c0-kube-api-access-t986q\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.427971 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.427925 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t986q\" (UniqueName: \"kubernetes.io/projected/693dd103-076d-4a89-8fad-fd9ba87ed0c0-kube-api-access-t986q\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.428073 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.427997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-serving-cert\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.428073 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.428059 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-oauth-config\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.428181 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.428085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-oauth-serving-cert\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.428181 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.428128 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-service-ca\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.428181 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.428159 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-config\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.428932 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.428887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-config\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.429309 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.429286 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-oauth-serving-cert\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.429703 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.429683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-service-ca\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.431400 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.431377 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-serving-cert\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.431959 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.431938 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-oauth-config\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.436484 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.436460 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t986q\" (UniqueName: \"kubernetes.io/projected/693dd103-076d-4a89-8fad-fd9ba87ed0c0-kube-api-access-t986q\") pod \"console-64744f57bc-xdn7t\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.550167 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.550122 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerStarted","Data":"4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad"} Jul 02 14:53:38.550373 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.550201 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerStarted","Data":"63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9"} Jul 02 14:53:38.550373 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.550238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerStarted","Data":"f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a"} Jul 02 14:53:38.550373 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.550276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerStarted","Data":"9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd"} Jul 02 14:53:38.550373 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.550317 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerStarted","Data":"4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374"} Jul 02 14:53:38.552420 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.552396 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" event={"ID":"181d92f3-861f-455a-8e76-12bf30663c11","Type":"ContainerStarted","Data":"bc72b418c665ff7eb3094ea5b2c0edd445c58b9b7369670884882b5655d7445e"} Jul 02 14:53:38.552537 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.552453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" event={"ID":"181d92f3-861f-455a-8e76-12bf30663c11","Type":"ContainerStarted","Data":"4d0077550940a5be040476289200ea8f6c0293be91cfb7add96caa75a96d9838"} Jul 02 14:53:38.552537 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.552481 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" event={"ID":"181d92f3-861f-455a-8e76-12bf30663c11","Type":"ContainerStarted","Data":"7337e25bf62f4da0881f4780599a244f6b41d33d08f3fb23d8440854dd7545e0"} Jul 02 14:53:38.554824 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.554799 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:53:38.700566 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:38.700534 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64744f57bc-xdn7t"] Jul 02 14:53:38.704288 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:38.704256 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693dd103_076d_4a89_8fad_fd9ba87ed0c0.slice/crio-527e5819b73c60069b3a426b742da4a525ea0141d1e54171a0fe6b659c7330d1 WatchSource:0}: Error finding container 527e5819b73c60069b3a426b742da4a525ea0141d1e54171a0fe6b659c7330d1: Status 404 returned error can't find the container with id 527e5819b73c60069b3a426b742da4a525ea0141d1e54171a0fe6b659c7330d1 Jul 02 14:53:39.563058 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:39.562963 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerStarted","Data":"5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2"} Jul 02 14:53:39.564393 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:39.564364 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64744f57bc-xdn7t" event={"ID":"693dd103-076d-4a89-8fad-fd9ba87ed0c0","Type":"ContainerStarted","Data":"527e5819b73c60069b3a426b742da4a525ea0141d1e54171a0fe6b659c7330d1"} Jul 02 14:53:39.612511 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:39.612434 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.599655247 podStartE2EDuration="7.612413642s" totalImagesPullingTime="4.992545394s" totalInitContainerRuntime="20.213001ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:39.610232876 +0000 UTC m=+313.653035283" watchObservedRunningTime="2026-07-02 14:53:39.612413642 +0000 UTC m=+313.655216049" Jul 02 14:53:40.573395 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:40.573357 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" event={"ID":"181d92f3-861f-455a-8e76-12bf30663c11","Type":"ContainerStarted","Data":"8cfcb0289f19b0a199d20472e41ef0671e5add956655129d586e16aad1899527"} Jul 02 14:53:40.573898 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:40.573444 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" event={"ID":"181d92f3-861f-455a-8e76-12bf30663c11","Type":"ContainerStarted","Data":"6c14c22524315a779ea945c37f377fe8f2f178c7eec7b88d2e95b7a7ff80c87f"} Jul 02 14:53:40.573898 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:40.573488 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" event={"ID":"181d92f3-861f-455a-8e76-12bf30663c11","Type":"ContainerStarted","Data":"d0e3f9cf3edf5c1d504203cd4413fc41ccd36e665c2b67499cd4dfd5ef7c2115"} Jul 02 14:53:40.574001 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:40.573937 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:40.596868 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:40.596813 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" podStartSLOduration=2.198353657 podStartE2EDuration="6.596790948s" totalImagesPullingTime="4.398437291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:40.59495706 +0000 UTC m=+314.637759524" watchObservedRunningTime="2026-07-02 14:53:40.596790948 +0000 UTC m=+314.639593358" Jul 02 14:53:46.816173 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.816133 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5877966-kzrvt"] Jul 02 14:53:46.822119 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.822096 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:46.829881 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.829816 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 14:53:46.831831 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.831805 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5877966-kzrvt"] Jul 02 14:53:46.908911 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.908881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-serving-cert\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:46.909086 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.908940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-oauth-config\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:46.909086 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.908989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-oauth-serving-cert\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:46.909086 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.909045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-service-ca\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:46.909086 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.909081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-console-config\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:46.909245 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.909154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-trusted-ca-bundle\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:46.909245 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:46.909175 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqqmn\" (UniqueName: \"kubernetes.io/projected/f25696bc-4780-4866-958f-1a5519139182-kube-api-access-cqqmn\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.010265 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.010232 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-console-config\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.010451 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.010278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-trusted-ca-bundle\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.010451 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.010298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqqmn\" (UniqueName: \"kubernetes.io/projected/f25696bc-4780-4866-958f-1a5519139182-kube-api-access-cqqmn\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.010451 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.010384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-serving-cert\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.010612 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.010486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-oauth-config\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.010612 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.010527 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-oauth-serving-cert\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.010612 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.010559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-service-ca\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.011069 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.011043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-console-config\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.011308 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.011279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-service-ca\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.011432 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.011312 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-oauth-serving-cert\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.011432 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.011319 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-trusted-ca-bundle\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.012838 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.012818 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-oauth-config\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.013254 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.013233 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-serving-cert\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.018733 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.018709 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqqmn\" (UniqueName: \"kubernetes.io/projected/f25696bc-4780-4866-958f-1a5519139182-kube-api-access-cqqmn\") pod \"console-5877966-kzrvt\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.135209 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.135128 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:47.591779 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:47.591239 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7869d4594c-p8fvm" Jul 02 14:53:48.611235 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:48.611195 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-k7jq5" event={"ID":"63798f4a-7862-4095-8fb8-0cc9d69f404d","Type":"ContainerStarted","Data":"129fd0eba9bfd6882bb1ebff90da35bc08f8bc0fd912a8d4fc9420884e263109"} Jul 02 14:53:48.611665 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:48.611364 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-k7jq5" Jul 02 14:53:48.613040 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:48.613009 2566 patch_prober.go:28] interesting pod/downloads-5499b6fb8f-k7jq5 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused" start-of-body= Jul 02 14:53:48.613163 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:48.613067 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5499b6fb8f-k7jq5" podUID="63798f4a-7862-4095-8fb8-0cc9d69f404d" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused" Jul 02 14:53:48.613396 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:48.613373 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64744f57bc-xdn7t" event={"ID":"693dd103-076d-4a89-8fad-fd9ba87ed0c0","Type":"ContainerStarted","Data":"6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3"} Jul 02 14:53:48.617806 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:48.617782 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5877966-kzrvt"] Jul 02 14:53:48.619689 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:53:48.619666 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25696bc_4780_4866_958f_1a5519139182.slice/crio-486f030941fb093094cc827b511683fc2b5e7c60e3eeb963c445d3776713d324 WatchSource:0}: Error finding container 486f030941fb093094cc827b511683fc2b5e7c60e3eeb963c445d3776713d324: Status 404 returned error can't find the container with id 486f030941fb093094cc827b511683fc2b5e7c60e3eeb963c445d3776713d324 Jul 02 14:53:48.628782 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:48.628734 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-k7jq5" podStartSLOduration=1.471819131 podStartE2EDuration="20.628716748s" totalImagesPullingTime="19.156897617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:48.626514113 +0000 UTC m=+322.669316543" watchObservedRunningTime="2026-07-02 14:53:48.628716748 +0000 UTC m=+322.671519156" Jul 02 14:53:48.646553 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:48.646499 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64744f57bc-xdn7t" podStartSLOduration=0.871207084 podStartE2EDuration="10.64647826s" totalImagesPullingTime="9.775271176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:48.644267094 +0000 UTC m=+322.687069504" watchObservedRunningTime="2026-07-02 14:53:48.64647826 +0000 UTC m=+322.689280671" Jul 02 14:53:49.620555 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:49.620515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5877966-kzrvt" event={"ID":"f25696bc-4780-4866-958f-1a5519139182","Type":"ContainerStarted","Data":"19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd"} Jul 02 14:53:49.621004 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:49.620575 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5877966-kzrvt" event={"ID":"f25696bc-4780-4866-958f-1a5519139182","Type":"ContainerStarted","Data":"486f030941fb093094cc827b511683fc2b5e7c60e3eeb963c445d3776713d324"} Jul 02 14:53:49.624099 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:49.624072 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-k7jq5" Jul 02 14:53:49.637265 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:49.637210 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5877966-kzrvt" podStartSLOduration=3.637192893 podStartE2EDuration="3.637192893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:49.636218205 +0000 UTC m=+323.679020611" watchObservedRunningTime="2026-07-02 14:53:49.637192893 +0000 UTC m=+323.679995299" Jul 02 14:53:57.135352 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:57.135295 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:57.135883 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:57.135428 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:57.141433 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:57.141406 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:57.666688 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:57.666662 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5877966-kzrvt" Jul 02 14:53:57.725188 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:57.725156 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64744f57bc-xdn7t"] Jul 02 14:53:58.555842 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:53:58.555812 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:54:03.686447 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:03.686413 2566 generic.go:356] "Generic (PLEG): container finished" podID="4368dc51-7877-4af3-9623-a28c0d6d3a9d" containerID="f5d1586e08846c570254aa58e7b3e7e6190432f9c6ee36433a78e69efd34ee34" exitCode=0 Jul 02 14:54:03.686821 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:03.686467 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" event={"ID":"4368dc51-7877-4af3-9623-a28c0d6d3a9d","Type":"ContainerDied","Data":"f5d1586e08846c570254aa58e7b3e7e6190432f9c6ee36433a78e69efd34ee34"} Jul 02 14:54:03.686821 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:03.686763 2566 scope.go:117] "RemoveContainer" containerID="f5d1586e08846c570254aa58e7b3e7e6190432f9c6ee36433a78e69efd34ee34" Jul 02 14:54:04.692023 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:04.691993 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-d9x4w" event={"ID":"4368dc51-7877-4af3-9623-a28c0d6d3a9d","Type":"ContainerStarted","Data":"dc1842b4e4d1d435eadecd1786d46812e362ef8a4d6c814dc3541184d8738e71"} Jul 02 14:54:09.163225 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:09.163197 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d8647c49-lrt7h_86d096b5-cb22-4fc8-8417-382bc87322c6/router/0.log" Jul 02 14:54:09.183986 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:09.183953 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tx475_df366d57-a34a-4207-96fd-1d9555173e23/serve-healthcheck-canary/0.log" Jul 02 14:54:13.725634 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:13.725602 2566 generic.go:356] "Generic (PLEG): container finished" podID="6e8695ae-1c13-4545-98ef-0df65454ef4d" containerID="c7026966633d9dc8a632f2d783c740eb66c39aaf05ef34dde8b4e010acff4c75" exitCode=0 Jul 02 14:54:13.726081 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:13.725670 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" event={"ID":"6e8695ae-1c13-4545-98ef-0df65454ef4d","Type":"ContainerDied","Data":"c7026966633d9dc8a632f2d783c740eb66c39aaf05ef34dde8b4e010acff4c75"} Jul 02 14:54:13.726081 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:13.725956 2566 scope.go:117] "RemoveContainer" containerID="c7026966633d9dc8a632f2d783c740eb66c39aaf05ef34dde8b4e010acff4c75" Jul 02 14:54:14.731642 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:14.731608 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6rgcs" event={"ID":"6e8695ae-1c13-4545-98ef-0df65454ef4d","Type":"ContainerStarted","Data":"c6176dbad0d3c01c8f6d4a60922ea85d21218f69a997c36bfcaf34d0f315cc44"} Jul 02 14:54:22.756467 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:22.756372 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64744f57bc-xdn7t" podUID="693dd103-076d-4a89-8fad-fd9ba87ed0c0" containerName="console" containerID="cri-o://6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3" gracePeriod=15 Jul 02 14:54:23.065457 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.065430 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:54:23.141053 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.141010 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-oauth-config\") pod \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " Jul 02 14:54:23.141713 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.141691 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t986q\" (UniqueName: \"kubernetes.io/projected/693dd103-076d-4a89-8fad-fd9ba87ed0c0-kube-api-access-t986q\") pod \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " Jul 02 14:54:23.141891 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.141875 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-service-ca\") pod \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " Jul 02 14:54:23.142079 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.142065 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-oauth-serving-cert\") pod \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " Jul 02 14:54:23.142250 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.142198 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-serving-cert\") pod \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " Jul 02 14:54:23.142321 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.142272 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-config\") pod \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\" (UID: \"693dd103-076d-4a89-8fad-fd9ba87ed0c0\") " Jul 02 14:54:23.142583 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.142528 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "693dd103-076d-4a89-8fad-fd9ba87ed0c0" (UID: "693dd103-076d-4a89-8fad-fd9ba87ed0c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:23.142583 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.142535 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "693dd103-076d-4a89-8fad-fd9ba87ed0c0" (UID: "693dd103-076d-4a89-8fad-fd9ba87ed0c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:23.142823 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.142792 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-config" (OuterVolumeSpecName: "console-config") pod "693dd103-076d-4a89-8fad-fd9ba87ed0c0" (UID: "693dd103-076d-4a89-8fad-fd9ba87ed0c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:23.144496 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.144474 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "693dd103-076d-4a89-8fad-fd9ba87ed0c0" (UID: "693dd103-076d-4a89-8fad-fd9ba87ed0c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:23.144763 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.144740 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693dd103-076d-4a89-8fad-fd9ba87ed0c0-kube-api-access-t986q" (OuterVolumeSpecName: "kube-api-access-t986q") pod "693dd103-076d-4a89-8fad-fd9ba87ed0c0" (UID: "693dd103-076d-4a89-8fad-fd9ba87ed0c0"). InnerVolumeSpecName "kube-api-access-t986q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:54:23.144829 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.144756 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "693dd103-076d-4a89-8fad-fd9ba87ed0c0" (UID: "693dd103-076d-4a89-8fad-fd9ba87ed0c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:23.243986 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.243957 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-oauth-serving-cert\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:23.243986 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.243987 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-serving-cert\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:23.244177 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.244000 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:23.244177 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.244008 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693dd103-076d-4a89-8fad-fd9ba87ed0c0-console-oauth-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:23.244177 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.244018 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t986q\" (UniqueName: \"kubernetes.io/projected/693dd103-076d-4a89-8fad-fd9ba87ed0c0-kube-api-access-t986q\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:23.244177 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.244026 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693dd103-076d-4a89-8fad-fd9ba87ed0c0-service-ca\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:23.772347 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.772288 2566 generic.go:356] "Generic (PLEG): container finished" podID="693dd103-076d-4a89-8fad-fd9ba87ed0c0" containerID="6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3" exitCode=0 Jul 02 14:54:23.772347 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.772346 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64744f57bc-xdn7t" Jul 02 14:54:23.772838 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.772375 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64744f57bc-xdn7t" event={"ID":"693dd103-076d-4a89-8fad-fd9ba87ed0c0","Type":"ContainerDied","Data":"6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3"} Jul 02 14:54:23.772838 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.772426 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64744f57bc-xdn7t" event={"ID":"693dd103-076d-4a89-8fad-fd9ba87ed0c0","Type":"ContainerDied","Data":"527e5819b73c60069b3a426b742da4a525ea0141d1e54171a0fe6b659c7330d1"} Jul 02 14:54:23.772838 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.772450 2566 scope.go:117] "RemoveContainer" containerID="6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3" Jul 02 14:54:23.780702 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.780681 2566 scope.go:117] "RemoveContainer" containerID="6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3" Jul 02 14:54:23.780952 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:54:23.780935 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3\": container with ID starting with 6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3 not found: ID does not exist" containerID="6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3" Jul 02 14:54:23.781002 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.780959 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3"} err="failed to get container status \"6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3\": rpc error: code = NotFound desc = could not find container \"6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3\": container with ID starting with 6a3e8b92d01128ae700fab432a4e5adfdc2a2c88669a0bd06b4592f28fa14bd3 not found: ID does not exist" Jul 02 14:54:23.793037 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.793015 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64744f57bc-xdn7t"] Jul 02 14:54:23.796246 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:23.796228 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64744f57bc-xdn7t"] Jul 02 14:54:24.509965 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:24.509932 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="693dd103-076d-4a89-8fad-fd9ba87ed0c0" path="/var/lib/kubelet/pods/693dd103-076d-4a89-8fad-fd9ba87ed0c0/volumes" Jul 02 14:54:40.289583 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:40.289543 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:54:40.291768 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:40.291748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7db27e-fa51-4c39-83b3-747609b46f63-metrics-certs\") pod \"network-metrics-daemon-dtbhn\" (UID: \"ed7db27e-fa51-4c39-83b3-747609b46f63\") " pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:54:40.507082 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:40.507057 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wp67j\"" Jul 02 14:54:40.515867 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:40.515838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtbhn" Jul 02 14:54:40.644437 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:40.644409 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtbhn"] Jul 02 14:54:40.647088 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:54:40.647066 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7db27e_fa51_4c39_83b3_747609b46f63.slice/crio-a3b2a5c50e81ef0e3a5bc36b6c19cf718f8c1e178a38f2c0ce0873877e5e1a06 WatchSource:0}: Error finding container a3b2a5c50e81ef0e3a5bc36b6c19cf718f8c1e178a38f2c0ce0873877e5e1a06: Status 404 returned error can't find the container with id a3b2a5c50e81ef0e3a5bc36b6c19cf718f8c1e178a38f2c0ce0873877e5e1a06 Jul 02 14:54:40.836344 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:40.836245 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtbhn" event={"ID":"ed7db27e-fa51-4c39-83b3-747609b46f63","Type":"ContainerStarted","Data":"a3b2a5c50e81ef0e3a5bc36b6c19cf718f8c1e178a38f2c0ce0873877e5e1a06"} Jul 02 14:54:41.841850 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:41.841764 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtbhn" event={"ID":"ed7db27e-fa51-4c39-83b3-747609b46f63","Type":"ContainerStarted","Data":"a587b4e26578082ba43d380851fbdde7d4f13973bc2cddc522721e17120238ad"} Jul 02 14:54:41.841850 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:41.841816 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtbhn" event={"ID":"ed7db27e-fa51-4c39-83b3-747609b46f63","Type":"ContainerStarted","Data":"4d5de640ed00bed3134dde31e351895ff7b0e922481ffc09a7bac4b7a1ebaae8"} Jul 02 14:54:41.856786 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:41.856730 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dtbhn" podStartSLOduration=375.034010623 podStartE2EDuration="6m15.856711679s" totalImagesPullingTime="822.701056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:54:41.855927988 +0000 UTC m=+375.898730394" watchObservedRunningTime="2026-07-02 14:54:41.856711679 +0000 UTC m=+375.899514091" Jul 02 14:54:51.805792 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:51.805759 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 14:54:51.806283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:51.806055 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="alertmanager" containerID="cri-o://4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374" gracePeriod=120 Jul 02 14:54:51.806283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:51.806121 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy-metric" containerID="cri-o://4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad" gracePeriod=120 Jul 02 14:54:51.806283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:51.806163 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="prom-label-proxy" containerID="cri-o://5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2" gracePeriod=120 Jul 02 14:54:51.806283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:51.806202 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy" containerID="cri-o://63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9" gracePeriod=120 Jul 02 14:54:51.806283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:51.806203 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="config-reloader" containerID="cri-o://9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd" gracePeriod=120 Jul 02 14:54:51.806591 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:51.806157 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy-web" containerID="cri-o://f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a" gracePeriod=120 Jul 02 14:54:52.887283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:52.887258 2566 generic.go:356] "Generic (PLEG): container finished" podID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerID="5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2" exitCode=0 Jul 02 14:54:52.887283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:52.887280 2566 generic.go:356] "Generic (PLEG): container finished" podID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerID="63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9" exitCode=0 Jul 02 14:54:52.887283 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:52.887286 2566 generic.go:356] "Generic (PLEG): container finished" podID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerID="9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd" exitCode=0 Jul 02 14:54:52.887640 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:52.887292 2566 generic.go:356] "Generic (PLEG): container finished" podID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerID="4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374" exitCode=0 Jul 02 14:54:52.887640 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:52.887327 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerDied","Data":"5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2"} Jul 02 14:54:52.887640 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:52.887399 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerDied","Data":"63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9"} Jul 02 14:54:52.887640 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:52.887424 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerDied","Data":"9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd"} Jul 02 14:54:52.887640 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:52.887446 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerDied","Data":"4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374"} Jul 02 14:54:53.055303 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.055278 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:53.094356 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094307 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-main-tls\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094510 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094374 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-web-config\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094510 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094400 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-volume\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094510 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094432 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-main-db\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094510 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094458 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-cluster-tls-config\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094510 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094483 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-tls-assets\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094765 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094527 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-trusted-ca-bundle\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094765 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094555 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094765 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094593 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094765 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094628 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-metrics-client-ca\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094765 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094665 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094765 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094711 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-out\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.094765 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.094757 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dpcx\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-kube-api-access-7dpcx\") pod \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\" (UID: \"40d3ea41-ec9a-40fa-95c9-f28e096326b6\") " Jul 02 14:54:53.095714 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.095252 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:54:53.095841 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.095725 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:53.096156 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.096125 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:53.097587 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.097549 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:54:53.098666 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.098637 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:53.099066 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.099041 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:53.099191 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.099113 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-volume" (OuterVolumeSpecName: "config-volume") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:53.099298 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.099269 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:53.099681 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.099648 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-out" (OuterVolumeSpecName: "config-out") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:54:53.099798 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.099777 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-kube-api-access-7dpcx" (OuterVolumeSpecName: "kube-api-access-7dpcx") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "kube-api-access-7dpcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:54:53.100427 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.100391 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:53.104568 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.104526 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:53.110786 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.110735 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-web-config" (OuterVolumeSpecName: "web-config") pod "40d3ea41-ec9a-40fa-95c9-f28e096326b6" (UID: "40d3ea41-ec9a-40fa-95c9-f28e096326b6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:53.195837 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195799 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.195837 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195825 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.195837 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195836 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.195837 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195845 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40d3ea41-ec9a-40fa-95c9-f28e096326b6-metrics-client-ca\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.196075 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195853 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.196075 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195862 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-out\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.196075 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195871 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dpcx\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-kube-api-access-7dpcx\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.196075 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195879 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-secret-alertmanager-main-tls\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.196075 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195886 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-web-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.196075 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195894 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-config-volume\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.196075 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195902 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40d3ea41-ec9a-40fa-95c9-f28e096326b6-alertmanager-main-db\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.196075 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195912 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40d3ea41-ec9a-40fa-95c9-f28e096326b6-cluster-tls-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.196075 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.195919 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40d3ea41-ec9a-40fa-95c9-f28e096326b6-tls-assets\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:54:53.893888 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.893855 2566 generic.go:356] "Generic (PLEG): container finished" podID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerID="4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad" exitCode=0 Jul 02 14:54:53.893888 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.893880 2566 generic.go:356] "Generic (PLEG): container finished" podID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerID="f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a" exitCode=0 Jul 02 14:54:53.894360 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.893940 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:53.894360 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.893939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerDied","Data":"4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad"} Jul 02 14:54:53.894360 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.894036 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerDied","Data":"f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a"} Jul 02 14:54:53.894360 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.894078 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40d3ea41-ec9a-40fa-95c9-f28e096326b6","Type":"ContainerDied","Data":"42183abafdf9f2855bee3ea885a3e7eed8d6593f423cf25f5a1af08eedf38e17"} Jul 02 14:54:53.894360 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.894097 2566 scope.go:117] "RemoveContainer" containerID="5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2" Jul 02 14:54:53.902214 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.902197 2566 scope.go:117] "RemoveContainer" containerID="4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad" Jul 02 14:54:53.909102 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.909088 2566 scope.go:117] "RemoveContainer" containerID="63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9" Jul 02 14:54:53.916786 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.916767 2566 scope.go:117] "RemoveContainer" containerID="f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a" Jul 02 14:54:53.919565 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.919544 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 14:54:53.923774 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.923756 2566 scope.go:117] "RemoveContainer" containerID="9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd" Jul 02 14:54:53.927543 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.927521 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 14:54:53.931415 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.931401 2566 scope.go:117] "RemoveContainer" containerID="4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374" Jul 02 14:54:53.938167 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.938153 2566 scope.go:117] "RemoveContainer" containerID="f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500" Jul 02 14:54:53.944674 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.944658 2566 scope.go:117] "RemoveContainer" containerID="5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2" Jul 02 14:54:53.944935 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:54:53.944909 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2\": container with ID starting with 5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2 not found: ID does not exist" containerID="5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2" Jul 02 14:54:53.945012 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.944945 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2"} err="failed to get container status \"5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2\": rpc error: code = NotFound desc = could not find container \"5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2\": container with ID starting with 5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2 not found: ID does not exist" Jul 02 14:54:53.945012 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.944966 2566 scope.go:117] "RemoveContainer" containerID="4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad" Jul 02 14:54:53.945186 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:54:53.945172 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad\": container with ID starting with 4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad not found: ID does not exist" containerID="4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad" Jul 02 14:54:53.945225 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.945190 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad"} err="failed to get container status \"4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad\": rpc error: code = NotFound desc = could not find container \"4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad\": container with ID starting with 4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad not found: ID does not exist" Jul 02 14:54:53.945225 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.945203 2566 scope.go:117] "RemoveContainer" containerID="63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9" Jul 02 14:54:53.945574 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:54:53.945554 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9\": container with ID starting with 63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9 not found: ID does not exist" containerID="63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9" Jul 02 14:54:53.945667 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.945577 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9"} err="failed to get container status \"63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9\": rpc error: code = NotFound desc = could not find container \"63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9\": container with ID starting with 63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9 not found: ID does not exist" Jul 02 14:54:53.945667 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.945591 2566 scope.go:117] "RemoveContainer" containerID="f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a" Jul 02 14:54:53.945818 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:54:53.945800 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a\": container with ID starting with f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a not found: ID does not exist" containerID="f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a" Jul 02 14:54:53.945867 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.945825 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a"} err="failed to get container status \"f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a\": rpc error: code = NotFound desc = could not find container \"f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a\": container with ID starting with f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a not found: ID does not exist" Jul 02 14:54:53.945867 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.945842 2566 scope.go:117] "RemoveContainer" containerID="9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd" Jul 02 14:54:53.946065 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:54:53.946044 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd\": container with ID starting with 9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd not found: ID does not exist" containerID="9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd" Jul 02 14:54:53.946140 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.946068 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd"} err="failed to get container status \"9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd\": rpc error: code = NotFound desc = could not find container \"9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd\": container with ID starting with 9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd not found: ID does not exist" Jul 02 14:54:53.946140 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.946084 2566 scope.go:117] "RemoveContainer" containerID="4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374" Jul 02 14:54:53.946378 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:54:53.946363 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374\": container with ID starting with 4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374 not found: ID does not exist" containerID="4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374" Jul 02 14:54:53.946426 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.946380 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374"} err="failed to get container status \"4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374\": rpc error: code = NotFound desc = could not find container \"4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374\": container with ID starting with 4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374 not found: ID does not exist" Jul 02 14:54:53.946426 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.946391 2566 scope.go:117] "RemoveContainer" containerID="f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500" Jul 02 14:54:53.946642 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:54:53.946625 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500\": container with ID starting with f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500 not found: ID does not exist" containerID="f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500" Jul 02 14:54:53.946680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.946648 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500"} err="failed to get container status \"f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500\": rpc error: code = NotFound desc = could not find container \"f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500\": container with ID starting with f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500 not found: ID does not exist" Jul 02 14:54:53.946680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.946670 2566 scope.go:117] "RemoveContainer" containerID="5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2" Jul 02 14:54:53.946883 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.946866 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2"} err="failed to get container status \"5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2\": rpc error: code = NotFound desc = could not find container \"5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2\": container with ID starting with 5b9de0dbbc77f8d649c989e85b1d1ca7f74a8acde40fee20e00e471370eae2f2 not found: ID does not exist" Jul 02 14:54:53.946883 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.946882 2566 scope.go:117] "RemoveContainer" containerID="4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad" Jul 02 14:54:53.947089 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947070 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad"} err="failed to get container status \"4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad\": rpc error: code = NotFound desc = could not find container \"4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad\": container with ID starting with 4b5abcd97ad4f1b208e6f90e03e8db888bbe62f0a21ca0c8e2ec00ee249844ad not found: ID does not exist" Jul 02 14:54:53.947135 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947089 2566 scope.go:117] "RemoveContainer" containerID="63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9" Jul 02 14:54:53.947299 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947285 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9"} err="failed to get container status \"63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9\": rpc error: code = NotFound desc = could not find container \"63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9\": container with ID starting with 63c6b34e8d543bcd43ce7f8e523c123a1277c059ace37d2a710fc599140460f9 not found: ID does not exist" Jul 02 14:54:53.947367 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947299 2566 scope.go:117] "RemoveContainer" containerID="f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a" Jul 02 14:54:53.947509 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947494 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a"} err="failed to get container status \"f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a\": rpc error: code = NotFound desc = could not find container \"f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a\": container with ID starting with f6659293026f49c0254341471cae9a7f457a0ffe48eb3f4ea3fbe1c10c7b258a not found: ID does not exist" Jul 02 14:54:53.947558 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947509 2566 scope.go:117] "RemoveContainer" containerID="9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd" Jul 02 14:54:53.947684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947667 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd"} err="failed to get container status \"9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd\": rpc error: code = NotFound desc = could not find container \"9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd\": container with ID starting with 9f62dbe8d4ce7b45d3ddc6993fc296888c431c9bc1ea84761055a220712d27bd not found: ID does not exist" Jul 02 14:54:53.947724 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947685 2566 scope.go:117] "RemoveContainer" containerID="4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374" Jul 02 14:54:53.947903 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947887 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374"} err="failed to get container status \"4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374\": rpc error: code = NotFound desc = could not find container \"4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374\": container with ID starting with 4ba237cba2744a0a6733605a84cefd58ac23f40632e028e033c5714e693aa374 not found: ID does not exist" Jul 02 14:54:53.947941 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.947904 2566 scope.go:117] "RemoveContainer" containerID="f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500" Jul 02 14:54:53.948079 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.948062 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500"} err="failed to get container status \"f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500\": rpc error: code = NotFound desc = could not find container \"f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500\": container with ID starting with f8cd7cf2cc945ca12195d9278855ed7074c78642193df393d36a4a9e5da41500 not found: ID does not exist" Jul 02 14:54:53.954528 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954509 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 14:54:53.954772 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954761 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="config-reloader" Jul 02 14:54:53.954818 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954774 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="config-reloader" Jul 02 14:54:53.954818 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954785 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy-metric" Jul 02 14:54:53.954818 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954790 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy-metric" Jul 02 14:54:53.954818 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954799 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy-web" Jul 02 14:54:53.954818 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954805 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy-web" Jul 02 14:54:53.954818 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954815 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy" Jul 02 14:54:53.954818 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954820 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954826 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="init-config-reloader" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954832 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="init-config-reloader" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954837 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693dd103-076d-4a89-8fad-fd9ba87ed0c0" containerName="console" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954842 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="693dd103-076d-4a89-8fad-fd9ba87ed0c0" containerName="console" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954849 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="prom-label-proxy" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954854 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="prom-label-proxy" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954861 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="alertmanager" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954866 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="alertmanager" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954913 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy-web" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954921 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="alertmanager" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954928 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy-metric" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954934 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="config-reloader" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954940 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="kube-rbac-proxy" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954945 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" containerName="prom-label-proxy" Jul 02 14:54:53.955015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.954949 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="693dd103-076d-4a89-8fad-fd9ba87ed0c0" containerName="console" Jul 02 14:54:53.958571 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.958557 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:53.960772 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.960753 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 14:54:53.960979 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.960958 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 14:54:53.961076 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.960959 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 14:54:53.961076 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.960959 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 14:54:53.961076 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.961018 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 14:54:53.961319 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.961304 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vrzcn\"" Jul 02 14:54:53.961392 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.961361 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 14:54:53.961476 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.961464 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 14:54:53.961565 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.961549 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 14:54:53.966680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.966659 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 14:54:53.977147 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:53.977127 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 14:54:54.002563 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002537 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-web-config\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002567 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002595 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002612 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acc94b4c-305b-487d-b17d-fb9a77665bdc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002647 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sr4t\" (UniqueName: \"kubernetes.io/projected/acc94b4c-305b-487d-b17d-fb9a77665bdc-kube-api-access-8sr4t\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002726 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-config-volume\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002753 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/acc94b4c-305b-487d-b17d-fb9a77665bdc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002777 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acc94b4c-305b-487d-b17d-fb9a77665bdc-config-out\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acc94b4c-305b-487d-b17d-fb9a77665bdc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.002886 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc94b4c-305b-487d-b17d-fb9a77665bdc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.003106 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.002938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.103913 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.103865 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.103913 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.103922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-web-config\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104163 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.103946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104163 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104063 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104163 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104094 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acc94b4c-305b-487d-b17d-fb9a77665bdc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104163 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sr4t\" (UniqueName: \"kubernetes.io/projected/acc94b4c-305b-487d-b17d-fb9a77665bdc-kube-api-access-8sr4t\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104163 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104449 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104169 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104449 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104198 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-config-volume\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104449 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/acc94b4c-305b-487d-b17d-fb9a77665bdc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104449 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acc94b4c-305b-487d-b17d-fb9a77665bdc-config-out\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104449 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acc94b4c-305b-487d-b17d-fb9a77665bdc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.104449 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.104374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc94b4c-305b-487d-b17d-fb9a77665bdc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.105498 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.105471 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/acc94b4c-305b-487d-b17d-fb9a77665bdc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.105616 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.105517 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc94b4c-305b-487d-b17d-fb9a77665bdc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.105616 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.105555 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acc94b4c-305b-487d-b17d-fb9a77665bdc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.107212 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.107141 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.107212 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.107165 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acc94b4c-305b-487d-b17d-fb9a77665bdc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.107387 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.107358 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-config-volume\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.107487 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.107459 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acc94b4c-305b-487d-b17d-fb9a77665bdc-config-out\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.107621 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.107599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.107621 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.107614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.107792 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.107775 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-web-config\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.108500 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.108481 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.108888 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.108872 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/acc94b4c-305b-487d-b17d-fb9a77665bdc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.111983 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.111966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sr4t\" (UniqueName: \"kubernetes.io/projected/acc94b4c-305b-487d-b17d-fb9a77665bdc-kube-api-access-8sr4t\") pod \"alertmanager-main-0\" (UID: \"acc94b4c-305b-487d-b17d-fb9a77665bdc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.269369 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.269320 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 14:54:54.396392 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.396302 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 14:54:54.399138 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:54:54.399098 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc94b4c_305b_487d_b17d_fb9a77665bdc.slice/crio-632285c1c0f1273106070c1a43706c7dd1c3b7c930a76ad0f2e92bfbbb1dd40d WatchSource:0}: Error finding container 632285c1c0f1273106070c1a43706c7dd1c3b7c930a76ad0f2e92bfbbb1dd40d: Status 404 returned error can't find the container with id 632285c1c0f1273106070c1a43706c7dd1c3b7c930a76ad0f2e92bfbbb1dd40d Jul 02 14:54:54.509533 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.509504 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40d3ea41-ec9a-40fa-95c9-f28e096326b6" path="/var/lib/kubelet/pods/40d3ea41-ec9a-40fa-95c9-f28e096326b6/volumes" Jul 02 14:54:54.900078 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.900046 2566 generic.go:356] "Generic (PLEG): container finished" podID="acc94b4c-305b-487d-b17d-fb9a77665bdc" containerID="a74c382be7e76e64fcf29f97498eb85a2d7b983332e1f6ff54b46d95a14044c8" exitCode=0 Jul 02 14:54:54.900488 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.900130 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"acc94b4c-305b-487d-b17d-fb9a77665bdc","Type":"ContainerDied","Data":"a74c382be7e76e64fcf29f97498eb85a2d7b983332e1f6ff54b46d95a14044c8"} Jul 02 14:54:54.900488 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:54.900196 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"acc94b4c-305b-487d-b17d-fb9a77665bdc","Type":"ContainerStarted","Data":"632285c1c0f1273106070c1a43706c7dd1c3b7c930a76ad0f2e92bfbbb1dd40d"} Jul 02 14:54:55.767752 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.767716 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5"] Jul 02 14:54:55.770247 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.770225 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.774001 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.773976 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 14:54:55.774115 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.774041 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 14:54:55.774271 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.774256 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 14:54:55.774374 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.774285 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 14:54:55.774480 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.774465 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7k5v2\"" Jul 02 14:54:55.774949 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.774931 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 14:54:55.781975 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.781955 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 14:54:55.785013 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.784992 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5"] Jul 02 14:54:55.820954 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.820929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-telemeter-client-tls\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.821106 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.820996 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.821106 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.821027 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/835a9847-c4f2-493d-b834-53a23b3dadda-metrics-client-ca\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.821106 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.821066 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/835a9847-c4f2-493d-b834-53a23b3dadda-serving-certs-ca-bundle\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.821106 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.821098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-secret-telemeter-client\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.821266 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.821130 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-federate-client-tls\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.821266 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.821158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/835a9847-c4f2-493d-b834-53a23b3dadda-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.821266 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.821181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cdrf\" (UniqueName: \"kubernetes.io/projected/835a9847-c4f2-493d-b834-53a23b3dadda-kube-api-access-7cdrf\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.907253 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.907223 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"acc94b4c-305b-487d-b17d-fb9a77665bdc","Type":"ContainerStarted","Data":"791909a5047fe8bc632b1bb663f5c675cd0750b92f311821de8d1f10cbf88556"} Jul 02 14:54:55.907626 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.907281 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"acc94b4c-305b-487d-b17d-fb9a77665bdc","Type":"ContainerStarted","Data":"7ab9355939e1e3e98ad992b00d1b145a28fdf76ee1fe3d47e392cdfe5b99dea0"} Jul 02 14:54:55.907626 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.907311 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"acc94b4c-305b-487d-b17d-fb9a77665bdc","Type":"ContainerStarted","Data":"7a6c04b0307db9d51ba619979a44d999bb64bdb67f02a38dbe5f7ab843b9168b"} Jul 02 14:54:55.907626 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.907354 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"acc94b4c-305b-487d-b17d-fb9a77665bdc","Type":"ContainerStarted","Data":"2ac14e3f9f67028bd1364021807d20419918bfe0a00f57ba3ff598cdd1857784"} Jul 02 14:54:55.907626 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.907379 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"acc94b4c-305b-487d-b17d-fb9a77665bdc","Type":"ContainerStarted","Data":"ee116977b29ee3b8f879c5e79f22eed8c0f34609e8b67637d8f69f589f4d64b2"} Jul 02 14:54:55.907626 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.907408 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"acc94b4c-305b-487d-b17d-fb9a77665bdc","Type":"ContainerStarted","Data":"e12e71b196e86f5d0139d80ae19681c0fd3ad2bcef31eeaa64983bf431766b8b"} Jul 02 14:54:55.921948 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.921926 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.922031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.921955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/835a9847-c4f2-493d-b834-53a23b3dadda-metrics-client-ca\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.922031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.921983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/835a9847-c4f2-493d-b834-53a23b3dadda-serving-certs-ca-bundle\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.922031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.922005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-secret-telemeter-client\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.922031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.922024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-federate-client-tls\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.922205 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.922151 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/835a9847-c4f2-493d-b834-53a23b3dadda-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.922258 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.922200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cdrf\" (UniqueName: \"kubernetes.io/projected/835a9847-c4f2-493d-b834-53a23b3dadda-kube-api-access-7cdrf\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.922309 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.922251 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-telemeter-client-tls\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.922801 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.922772 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/835a9847-c4f2-493d-b834-53a23b3dadda-metrics-client-ca\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.922902 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.922801 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/835a9847-c4f2-493d-b834-53a23b3dadda-serving-certs-ca-bundle\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.923060 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.923035 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/835a9847-c4f2-493d-b834-53a23b3dadda-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.924831 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.924804 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-secret-telemeter-client\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.924913 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.924896 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.924986 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.924968 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-telemeter-client-tls\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.925036 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.925022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/835a9847-c4f2-493d-b834-53a23b3dadda-federate-client-tls\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:55.931101 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.931063 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.920319935 podStartE2EDuration="2.931050514s" totalImagesPullingTime="0s" totalInitContainerRuntime="10.730579ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:54:55.929830676 +0000 UTC m=+389.972633083" watchObservedRunningTime="2026-07-02 14:54:55.931050514 +0000 UTC m=+389.973852921" Jul 02 14:54:55.934481 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:55.934465 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cdrf\" (UniqueName: \"kubernetes.io/projected/835a9847-c4f2-493d-b834-53a23b3dadda-kube-api-access-7cdrf\") pod \"telemeter-client-6d6785fb7c-2zbb5\" (UID: \"835a9847-c4f2-493d-b834-53a23b3dadda\") " pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:56.080824 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:56.080748 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" Jul 02 14:54:56.211736 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:56.211715 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5"] Jul 02 14:54:56.213824 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:54:56.213794 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835a9847_c4f2_493d_b834_53a23b3dadda.slice/crio-c6a55c93490777650c00da215a8521746f6057dceb86fe840d4bd137c024408a WatchSource:0}: Error finding container c6a55c93490777650c00da215a8521746f6057dceb86fe840d4bd137c024408a: Status 404 returned error can't find the container with id c6a55c93490777650c00da215a8521746f6057dceb86fe840d4bd137c024408a Jul 02 14:54:56.912099 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:56.912061 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" event={"ID":"835a9847-c4f2-493d-b834-53a23b3dadda","Type":"ContainerStarted","Data":"c6a55c93490777650c00da215a8521746f6057dceb86fe840d4bd137c024408a"} Jul 02 14:54:58.923648 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:58.923564 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" event={"ID":"835a9847-c4f2-493d-b834-53a23b3dadda","Type":"ContainerStarted","Data":"77792b0dabbf4d39b2928a9ab5bcdb48aab170aaeb67fdc4df83d6ff8d73f38d"} Jul 02 14:54:58.923648 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:58.923622 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" event={"ID":"835a9847-c4f2-493d-b834-53a23b3dadda","Type":"ContainerStarted","Data":"11887a112f5aafa2f8b8bf0b1d269bc977dbe2b3991b6a0679e742c2e9604141"} Jul 02 14:54:58.924042 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:58.923651 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" event={"ID":"835a9847-c4f2-493d-b834-53a23b3dadda","Type":"ContainerStarted","Data":"145c207cfc58bf51af04dd2ed8b24a71ae962237fc97776b23b30b783f7782e3"} Jul 02 14:54:58.944227 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:58.944169 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d6785fb7c-2zbb5" podStartSLOduration=1.5731189859999999 podStartE2EDuration="3.944154136s" totalImagesPullingTime="2.37103515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:54:58.941909723 +0000 UTC m=+392.984712129" watchObservedRunningTime="2026-07-02 14:54:58.944154136 +0000 UTC m=+392.986956541" Jul 02 14:54:59.819665 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.819630 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-595f5b6d85-z8qzv"] Jul 02 14:54:59.822372 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.822327 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:54:59.834730 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.834705 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595f5b6d85-z8qzv"] Jul 02 14:54:59.959714 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.959680 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-trusted-ca-bundle\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:54:59.959714 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.959720 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-service-ca\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:54:59.960146 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.959743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-serving-cert\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:54:59.960146 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.959797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89b2n\" (UniqueName: \"kubernetes.io/projected/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-kube-api-access-89b2n\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:54:59.960146 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.959818 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-oauth-serving-cert\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:54:59.960146 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.959860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-config\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:54:59.960146 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:54:59.959882 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-oauth-config\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.060686 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.060641 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-serving-cert\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.060904 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.060719 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89b2n\" (UniqueName: \"kubernetes.io/projected/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-kube-api-access-89b2n\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.060904 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.060806 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-oauth-serving-cert\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.060904 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.060860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-config\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.060904 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.060898 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-oauth-config\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.061124 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.060949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-trusted-ca-bundle\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.061124 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.061025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-service-ca\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.061628 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.061603 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-config\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.061762 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.061744 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-oauth-serving-cert\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.062049 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.062030 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-trusted-ca-bundle\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.062081 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.062044 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-service-ca\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.063550 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.063519 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-oauth-config\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.063658 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.063611 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-serving-cert\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.068591 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.068569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89b2n\" (UniqueName: \"kubernetes.io/projected/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-kube-api-access-89b2n\") pod \"console-595f5b6d85-z8qzv\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.133733 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.133631 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:00.263449 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.263399 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595f5b6d85-z8qzv"] Jul 02 14:55:00.265492 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:55:00.265467 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00cf90da_2570_4e8c_b1c1_b7b1d3e1e9b9.slice/crio-ae6beb06ec6b469b901bcae2e3c136ee5a42415ccdb01cb35a614aa39942ca4c WatchSource:0}: Error finding container ae6beb06ec6b469b901bcae2e3c136ee5a42415ccdb01cb35a614aa39942ca4c: Status 404 returned error can't find the container with id ae6beb06ec6b469b901bcae2e3c136ee5a42415ccdb01cb35a614aa39942ca4c Jul 02 14:55:00.932397 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.932358 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595f5b6d85-z8qzv" event={"ID":"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9","Type":"ContainerStarted","Data":"e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1"} Jul 02 14:55:00.932621 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.932442 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595f5b6d85-z8qzv" event={"ID":"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9","Type":"ContainerStarted","Data":"ae6beb06ec6b469b901bcae2e3c136ee5a42415ccdb01cb35a614aa39942ca4c"} Jul 02 14:55:00.950058 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:00.950013 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-595f5b6d85-z8qzv" podStartSLOduration=1.949996973 podStartE2EDuration="1.949996973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:55:00.948579515 +0000 UTC m=+394.991381921" watchObservedRunningTime="2026-07-02 14:55:00.949996973 +0000 UTC m=+394.992799379" Jul 02 14:55:10.134684 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:10.134643 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:10.135115 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:10.134701 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:10.139641 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:10.139615 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:10.974982 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:10.974948 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:55:11.020001 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:11.019975 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5877966-kzrvt"] Jul 02 14:55:36.048823 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.048754 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5877966-kzrvt" podUID="f25696bc-4780-4866-958f-1a5519139182" containerName="console" containerID="cri-o://19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd" gracePeriod=15 Jul 02 14:55:36.292859 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.292827 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5877966-kzrvt" Jul 02 14:55:36.377394 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377312 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-console-config\") pod \"f25696bc-4780-4866-958f-1a5519139182\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " Jul 02 14:55:36.377394 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377371 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-service-ca\") pod \"f25696bc-4780-4866-958f-1a5519139182\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " Jul 02 14:55:36.377394 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377390 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-trusted-ca-bundle\") pod \"f25696bc-4780-4866-958f-1a5519139182\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " Jul 02 14:55:36.377603 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377419 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-oauth-config\") pod \"f25696bc-4780-4866-958f-1a5519139182\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " Jul 02 14:55:36.377603 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377571 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-oauth-serving-cert\") pod \"f25696bc-4780-4866-958f-1a5519139182\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " Jul 02 14:55:36.377680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377616 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqqmn\" (UniqueName: \"kubernetes.io/projected/f25696bc-4780-4866-958f-1a5519139182-kube-api-access-cqqmn\") pod \"f25696bc-4780-4866-958f-1a5519139182\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " Jul 02 14:55:36.377680 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377647 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-serving-cert\") pod \"f25696bc-4780-4866-958f-1a5519139182\" (UID: \"f25696bc-4780-4866-958f-1a5519139182\") " Jul 02 14:55:36.377780 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377744 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-console-config" (OuterVolumeSpecName: "console-config") pod "f25696bc-4780-4866-958f-1a5519139182" (UID: "f25696bc-4780-4866-958f-1a5519139182"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:55:36.377893 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377864 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-service-ca" (OuterVolumeSpecName: "service-ca") pod "f25696bc-4780-4866-958f-1a5519139182" (UID: "f25696bc-4780-4866-958f-1a5519139182"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:55:36.378015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377891 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f25696bc-4780-4866-958f-1a5519139182" (UID: "f25696bc-4780-4866-958f-1a5519139182"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:55:36.378015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377920 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-console-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:55:36.378015 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.377924 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f25696bc-4780-4866-958f-1a5519139182" (UID: "f25696bc-4780-4866-958f-1a5519139182"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:55:36.379780 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.379753 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f25696bc-4780-4866-958f-1a5519139182" (UID: "f25696bc-4780-4866-958f-1a5519139182"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:55:36.379861 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.379814 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f25696bc-4780-4866-958f-1a5519139182" (UID: "f25696bc-4780-4866-958f-1a5519139182"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:55:36.379861 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.379826 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f25696bc-4780-4866-958f-1a5519139182-kube-api-access-cqqmn" (OuterVolumeSpecName: "kube-api-access-cqqmn") pod "f25696bc-4780-4866-958f-1a5519139182" (UID: "f25696bc-4780-4866-958f-1a5519139182"). InnerVolumeSpecName "kube-api-access-cqqmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:55:36.479102 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.479065 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqqmn\" (UniqueName: \"kubernetes.io/projected/f25696bc-4780-4866-958f-1a5519139182-kube-api-access-cqqmn\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:55:36.479102 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.479097 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-serving-cert\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:55:36.479102 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.479108 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-service-ca\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:55:36.479320 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.479116 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-trusted-ca-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:55:36.479320 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.479125 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f25696bc-4780-4866-958f-1a5519139182-console-oauth-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:55:36.479320 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:36.479133 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f25696bc-4780-4866-958f-1a5519139182-oauth-serving-cert\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:55:37.071896 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:37.071865 2566 generic.go:356] "Generic (PLEG): container finished" podID="f25696bc-4780-4866-958f-1a5519139182" containerID="19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd" exitCode=0 Jul 02 14:55:37.072413 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:37.071915 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5877966-kzrvt" event={"ID":"f25696bc-4780-4866-958f-1a5519139182","Type":"ContainerDied","Data":"19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd"} Jul 02 14:55:37.072413 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:37.071919 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5877966-kzrvt" Jul 02 14:55:37.072413 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:37.071948 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5877966-kzrvt" event={"ID":"f25696bc-4780-4866-958f-1a5519139182","Type":"ContainerDied","Data":"486f030941fb093094cc827b511683fc2b5e7c60e3eeb963c445d3776713d324"} Jul 02 14:55:37.072413 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:37.071967 2566 scope.go:117] "RemoveContainer" containerID="19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd" Jul 02 14:55:37.080031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:37.080001 2566 scope.go:117] "RemoveContainer" containerID="19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd" Jul 02 14:55:37.080286 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:55:37.080264 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd\": container with ID starting with 19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd not found: ID does not exist" containerID="19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd" Jul 02 14:55:37.080354 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:37.080294 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd"} err="failed to get container status \"19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd\": rpc error: code = NotFound desc = could not find container \"19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd\": container with ID starting with 19c9909bd4e0c02bd3788bcc5b874811d0b7ef87a3c776b8f5919237327c00bd not found: ID does not exist" Jul 02 14:55:37.086909 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:37.086890 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5877966-kzrvt"] Jul 02 14:55:37.092492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:37.092473 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5877966-kzrvt"] Jul 02 14:55:38.509028 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:55:38.508991 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f25696bc-4780-4866-958f-1a5519139182" path="/var/lib/kubelet/pods/f25696bc-4780-4866-958f-1a5519139182/volumes" Jul 02 14:56:29.142795 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.142759 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-696df675c8-922lt"] Jul 02 14:56:29.143300 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.143219 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f25696bc-4780-4866-958f-1a5519139182" containerName="console" Jul 02 14:56:29.143300 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.143238 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f25696bc-4780-4866-958f-1a5519139182" containerName="console" Jul 02 14:56:29.143460 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.143369 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f25696bc-4780-4866-958f-1a5519139182" containerName="console" Jul 02 14:56:29.147286 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.147265 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.165617 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.165595 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-696df675c8-922lt"] Jul 02 14:56:29.215312 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.215288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxhgj\" (UniqueName: \"kubernetes.io/projected/7d55b697-c999-448d-bbe6-9031a5b0f594-kube-api-access-rxhgj\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.215445 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.215354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-service-ca\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.215445 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.215408 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-oauth-serving-cert\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.215517 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.215443 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-oauth-config\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.215517 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.215462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-console-config\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.215517 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.215502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-serving-cert\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.215612 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.215527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-trusted-ca-bundle\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.315910 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.315882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-serving-cert\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.315910 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.315915 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-trusted-ca-bundle\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.316141 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.315951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxhgj\" (UniqueName: \"kubernetes.io/projected/7d55b697-c999-448d-bbe6-9031a5b0f594-kube-api-access-rxhgj\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.316141 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.316006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-service-ca\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.316141 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.316051 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-oauth-serving-cert\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.316141 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.316086 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-oauth-config\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.316141 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.316107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-console-config\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.316892 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.316871 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-console-config\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.317031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.316887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-service-ca\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.317031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.316919 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-oauth-serving-cert\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.317031 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.316962 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-trusted-ca-bundle\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.318529 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.318501 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-serving-cert\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.318618 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.318535 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-oauth-config\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.323951 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.323927 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxhgj\" (UniqueName: \"kubernetes.io/projected/7d55b697-c999-448d-bbe6-9031a5b0f594-kube-api-access-rxhgj\") pod \"console-696df675c8-922lt\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.456668 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.456640 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:29.585938 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:29.585914 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-696df675c8-922lt"] Jul 02 14:56:29.588433 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:56:29.588407 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d55b697_c999_448d_bbe6_9031a5b0f594.slice/crio-3ea9b098b67f68c6ab17b22440974d85e4fa3a536030113038f27425c870b725 WatchSource:0}: Error finding container 3ea9b098b67f68c6ab17b22440974d85e4fa3a536030113038f27425c870b725: Status 404 returned error can't find the container with id 3ea9b098b67f68c6ab17b22440974d85e4fa3a536030113038f27425c870b725 Jul 02 14:56:30.287222 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:30.287191 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696df675c8-922lt" event={"ID":"7d55b697-c999-448d-bbe6-9031a5b0f594","Type":"ContainerStarted","Data":"3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5"} Jul 02 14:56:30.287624 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:30.287237 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696df675c8-922lt" event={"ID":"7d55b697-c999-448d-bbe6-9031a5b0f594","Type":"ContainerStarted","Data":"3ea9b098b67f68c6ab17b22440974d85e4fa3a536030113038f27425c870b725"} Jul 02 14:56:30.320209 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:30.320156 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-696df675c8-922lt" podStartSLOduration=1.32014057 podStartE2EDuration="1.32014057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:56:30.31890638 +0000 UTC m=+484.361708785" watchObservedRunningTime="2026-07-02 14:56:30.32014057 +0000 UTC m=+484.362943020" Jul 02 14:56:39.456930 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:39.456897 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:39.457411 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:39.456974 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:39.461755 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:39.461734 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:40.328452 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:40.328425 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-696df675c8-922lt" Jul 02 14:56:40.384673 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:56:40.384635 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595f5b6d85-z8qzv"] Jul 02 14:57:05.406436 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.406387 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-595f5b6d85-z8qzv" podUID="00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" containerName="console" containerID="cri-o://e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1" gracePeriod=15 Jul 02 14:57:05.649439 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.649415 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:57:05.724800 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.724771 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-oauth-serving-cert\") pod \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " Jul 02 14:57:05.724974 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.724813 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-service-ca\") pod \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " Jul 02 14:57:05.724974 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.724832 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-serving-cert\") pod \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " Jul 02 14:57:05.724974 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.724865 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89b2n\" (UniqueName: \"kubernetes.io/projected/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-kube-api-access-89b2n\") pod \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " Jul 02 14:57:05.724974 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.724888 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-oauth-config\") pod \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " Jul 02 14:57:05.724974 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.724914 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-config\") pod \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " Jul 02 14:57:05.725240 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.724978 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-trusted-ca-bundle\") pod \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\" (UID: \"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9\") " Jul 02 14:57:05.725398 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.725359 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" (UID: "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:57:05.725559 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.725373 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-service-ca" (OuterVolumeSpecName: "service-ca") pod "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" (UID: "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:57:05.725559 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.725543 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" (UID: "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:57:05.725695 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.725486 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-config" (OuterVolumeSpecName: "console-config") pod "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" (UID: "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:57:05.727038 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.727006 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" (UID: "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:57:05.727038 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.727027 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" (UID: "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:57:05.727155 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.727059 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-kube-api-access-89b2n" (OuterVolumeSpecName: "kube-api-access-89b2n") pod "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" (UID: "00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9"). InnerVolumeSpecName "kube-api-access-89b2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:57:05.826049 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.826018 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-trusted-ca-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:05.826049 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.826043 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-oauth-serving-cert\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:05.826049 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.826053 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-service-ca\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:05.826267 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.826062 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-serving-cert\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:05.826267 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.826070 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89b2n\" (UniqueName: \"kubernetes.io/projected/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-kube-api-access-89b2n\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:05.826267 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.826081 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-oauth-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:05.826267 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:05.826090 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9-console-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:06.426676 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.426640 2566 generic.go:356] "Generic (PLEG): container finished" podID="00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" containerID="e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1" exitCode=0 Jul 02 14:57:06.427060 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.426688 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595f5b6d85-z8qzv" Jul 02 14:57:06.427060 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.426725 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595f5b6d85-z8qzv" event={"ID":"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9","Type":"ContainerDied","Data":"e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1"} Jul 02 14:57:06.427060 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.426776 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595f5b6d85-z8qzv" event={"ID":"00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9","Type":"ContainerDied","Data":"ae6beb06ec6b469b901bcae2e3c136ee5a42415ccdb01cb35a614aa39942ca4c"} Jul 02 14:57:06.427060 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.426797 2566 scope.go:117] "RemoveContainer" containerID="e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1" Jul 02 14:57:06.435412 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.435390 2566 scope.go:117] "RemoveContainer" containerID="e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1" Jul 02 14:57:06.435656 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:57:06.435639 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1\": container with ID starting with e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1 not found: ID does not exist" containerID="e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1" Jul 02 14:57:06.435702 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.435663 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1"} err="failed to get container status \"e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1\": rpc error: code = NotFound desc = could not find container \"e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1\": container with ID starting with e166a97d0b1b64e5f8d6a02d22458b622b836c3d47b07ed77186997e207f39b1 not found: ID does not exist" Jul 02 14:57:06.446804 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.446778 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595f5b6d85-z8qzv"] Jul 02 14:57:06.450480 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.450459 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-595f5b6d85-z8qzv"] Jul 02 14:57:06.509798 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:06.509767 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" path="/var/lib/kubelet/pods/00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9/volumes" Jul 02 14:57:19.540968 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.540870 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz"] Jul 02 14:57:19.541416 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.541254 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" containerName="console" Jul 02 14:57:19.541416 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.541268 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" containerName="console" Jul 02 14:57:19.541416 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.541326 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="00cf90da-2570-4e8c-b1c1-b7b1d3e1e9b9" containerName="console" Jul 02 14:57:19.544325 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.544309 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.547069 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.547047 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 14:57:19.547196 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.547087 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 14:57:19.551462 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.551429 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-645h8\"" Jul 02 14:57:19.557869 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.557847 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz"] Jul 02 14:57:19.620365 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.620311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.620551 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.620387 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzhrf\" (UniqueName: \"kubernetes.io/projected/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-kube-api-access-qzhrf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.620551 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.620447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.721497 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.721468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.721666 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.721512 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzhrf\" (UniqueName: \"kubernetes.io/projected/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-kube-api-access-qzhrf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.721666 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.721553 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.721927 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.721911 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.721964 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.721910 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.729612 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.729592 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzhrf\" (UniqueName: \"kubernetes.io/projected/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-kube-api-access-qzhrf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.853325 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.853246 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:19.977744 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:19.977719 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz"] Jul 02 14:57:19.980255 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:57:19.980226 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3de2c7_b580_4e8f_91b1_313323a6cbfc.slice/crio-247b89765aa80a73d1057869b15bd8b181abf998692d4c14e79469681ed2d3d3 WatchSource:0}: Error finding container 247b89765aa80a73d1057869b15bd8b181abf998692d4c14e79469681ed2d3d3: Status 404 returned error can't find the container with id 247b89765aa80a73d1057869b15bd8b181abf998692d4c14e79469681ed2d3d3 Jul 02 14:57:20.483280 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:20.483233 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" event={"ID":"6b3de2c7-b580-4e8f-91b1-313323a6cbfc","Type":"ContainerStarted","Data":"247b89765aa80a73d1057869b15bd8b181abf998692d4c14e79469681ed2d3d3"} Jul 02 14:57:28.524182 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:28.524144 2566 generic.go:356] "Generic (PLEG): container finished" podID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerID="f8d617b118222ca6a8cf31b7c3ded56359befd64b7bb2aab0b6e85de36a527f1" exitCode=0 Jul 02 14:57:28.524617 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:28.524235 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" event={"ID":"6b3de2c7-b580-4e8f-91b1-313323a6cbfc","Type":"ContainerDied","Data":"f8d617b118222ca6a8cf31b7c3ded56359befd64b7bb2aab0b6e85de36a527f1"} Jul 02 14:57:30.535130 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:30.535101 2566 generic.go:356] "Generic (PLEG): container finished" podID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerID="583b91b8293ce9199d7dbf0417daeed9ddb8da0ef45a0bbf5195c05c22e13f20" exitCode=0 Jul 02 14:57:30.535477 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:30.535171 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" event={"ID":"6b3de2c7-b580-4e8f-91b1-313323a6cbfc","Type":"ContainerDied","Data":"583b91b8293ce9199d7dbf0417daeed9ddb8da0ef45a0bbf5195c05c22e13f20"} Jul 02 14:57:39.574491 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:39.574454 2566 generic.go:356] "Generic (PLEG): container finished" podID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerID="989f55a58a37d101ed33cb0beeb2a10ab693ed89a39694c30a78d2fc72052773" exitCode=0 Jul 02 14:57:39.574794 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:39.574504 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" event={"ID":"6b3de2c7-b580-4e8f-91b1-313323a6cbfc","Type":"ContainerDied","Data":"989f55a58a37d101ed33cb0beeb2a10ab693ed89a39694c30a78d2fc72052773"} Jul 02 14:57:40.708707 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.708684 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:40.811446 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.811420 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzhrf\" (UniqueName: \"kubernetes.io/projected/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-kube-api-access-qzhrf\") pod \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " Jul 02 14:57:40.811595 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.811497 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-util\") pod \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " Jul 02 14:57:40.811595 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.811551 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-bundle\") pod \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\" (UID: \"6b3de2c7-b580-4e8f-91b1-313323a6cbfc\") " Jul 02 14:57:40.812185 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.812154 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-bundle" (OuterVolumeSpecName: "bundle") pod "6b3de2c7-b580-4e8f-91b1-313323a6cbfc" (UID: "6b3de2c7-b580-4e8f-91b1-313323a6cbfc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:57:40.813502 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.813480 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-kube-api-access-qzhrf" (OuterVolumeSpecName: "kube-api-access-qzhrf") pod "6b3de2c7-b580-4e8f-91b1-313323a6cbfc" (UID: "6b3de2c7-b580-4e8f-91b1-313323a6cbfc"). InnerVolumeSpecName "kube-api-access-qzhrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:57:40.816926 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.816900 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-util" (OuterVolumeSpecName: "util") pod "6b3de2c7-b580-4e8f-91b1-313323a6cbfc" (UID: "6b3de2c7-b580-4e8f-91b1-313323a6cbfc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:57:40.913003 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.912949 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-util\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:40.913003 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.912969 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:40.913003 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:40.912980 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzhrf\" (UniqueName: \"kubernetes.io/projected/6b3de2c7-b580-4e8f-91b1-313323a6cbfc-kube-api-access-qzhrf\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:41.583871 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:41.583837 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" event={"ID":"6b3de2c7-b580-4e8f-91b1-313323a6cbfc","Type":"ContainerDied","Data":"247b89765aa80a73d1057869b15bd8b181abf998692d4c14e79469681ed2d3d3"} Jul 02 14:57:41.583871 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:41.583859 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540297nz" Jul 02 14:57:41.584100 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:41.583888 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="247b89765aa80a73d1057869b15bd8b181abf998692d4c14e79469681ed2d3d3" Jul 02 14:57:47.531691 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.531657 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp"] Jul 02 14:57:47.532161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.532013 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerName="pull" Jul 02 14:57:47.532161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.532026 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerName="pull" Jul 02 14:57:47.532161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.532053 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerName="util" Jul 02 14:57:47.532161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.532061 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerName="util" Jul 02 14:57:47.532161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.532069 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerName="extract" Jul 02 14:57:47.532161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.532075 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerName="extract" Jul 02 14:57:47.532161 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.532118 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3de2c7-b580-4e8f-91b1-313323a6cbfc" containerName="extract" Jul 02 14:57:47.535740 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.535725 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" Jul 02 14:57:47.538065 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.538041 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:57:47.538203 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.538114 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gb9gp\"" Jul 02 14:57:47.538203 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.538167 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 14:57:47.548368 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.548323 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp"] Jul 02 14:57:47.675614 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.675579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5zrq\" (UniqueName: \"kubernetes.io/projected/60c5990d-bdca-4108-a56f-7559cf9deafb-kube-api-access-d5zrq\") pod \"cert-manager-operator-controller-manager-55c444bf86-sw2sp\" (UID: \"60c5990d-bdca-4108-a56f-7559cf9deafb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" Jul 02 14:57:47.675788 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.675622 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60c5990d-bdca-4108-a56f-7559cf9deafb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sw2sp\" (UID: \"60c5990d-bdca-4108-a56f-7559cf9deafb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" Jul 02 14:57:47.776419 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.776385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5zrq\" (UniqueName: \"kubernetes.io/projected/60c5990d-bdca-4108-a56f-7559cf9deafb-kube-api-access-d5zrq\") pod \"cert-manager-operator-controller-manager-55c444bf86-sw2sp\" (UID: \"60c5990d-bdca-4108-a56f-7559cf9deafb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" Jul 02 14:57:47.776545 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.776429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60c5990d-bdca-4108-a56f-7559cf9deafb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sw2sp\" (UID: \"60c5990d-bdca-4108-a56f-7559cf9deafb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" Jul 02 14:57:47.776800 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.776783 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60c5990d-bdca-4108-a56f-7559cf9deafb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sw2sp\" (UID: \"60c5990d-bdca-4108-a56f-7559cf9deafb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" Jul 02 14:57:47.790994 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.790931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5zrq\" (UniqueName: \"kubernetes.io/projected/60c5990d-bdca-4108-a56f-7559cf9deafb-kube-api-access-d5zrq\") pod \"cert-manager-operator-controller-manager-55c444bf86-sw2sp\" (UID: \"60c5990d-bdca-4108-a56f-7559cf9deafb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" Jul 02 14:57:47.845156 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.845131 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" Jul 02 14:57:47.980883 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:47.980859 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp"] Jul 02 14:57:47.983584 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:57:47.983558 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c5990d_bdca_4108_a56f_7559cf9deafb.slice/crio-09f9881ebb48d6764611a9f93800ed5d77fffc006c70a76548304101b40a188d WatchSource:0}: Error finding container 09f9881ebb48d6764611a9f93800ed5d77fffc006c70a76548304101b40a188d: Status 404 returned error can't find the container with id 09f9881ebb48d6764611a9f93800ed5d77fffc006c70a76548304101b40a188d Jul 02 14:57:48.614054 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:48.614005 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" event={"ID":"60c5990d-bdca-4108-a56f-7559cf9deafb","Type":"ContainerStarted","Data":"09f9881ebb48d6764611a9f93800ed5d77fffc006c70a76548304101b40a188d"} Jul 02 14:57:49.620433 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:49.620322 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" event={"ID":"60c5990d-bdca-4108-a56f-7559cf9deafb","Type":"ContainerStarted","Data":"641018f526665aa1e462ba9c57dbaf4ceb5b3a55ee6d33fa49a2c94efd9eca8b"} Jul 02 14:57:49.653266 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:49.653208 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sw2sp" podStartSLOduration=1.364932112 podStartE2EDuration="2.653185413s" totalImagesPullingTime="1.288253301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:57:49.653122512 +0000 UTC m=+563.695924959" watchObservedRunningTime="2026-07-02 14:57:49.653185413 +0000 UTC m=+563.695987820" Jul 02 14:57:51.360512 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.360480 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7"] Jul 02 14:57:51.364908 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.364876 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.372557 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.372533 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-645h8\"" Jul 02 14:57:51.372932 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.372853 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 14:57:51.373147 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.373129 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 14:57:51.389593 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.389559 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7"] Jul 02 14:57:51.508728 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.508695 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjb8f\" (UniqueName: \"kubernetes.io/projected/c993ea89-7c38-46cc-b67c-2b28542a2a9f-kube-api-access-wjb8f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.508728 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.508741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.508959 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.508780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.609608 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.609569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjb8f\" (UniqueName: \"kubernetes.io/projected/c993ea89-7c38-46cc-b67c-2b28542a2a9f-kube-api-access-wjb8f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.609807 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.609618 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.609807 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.609652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.610094 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.610070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.610094 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.610083 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.642419 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.642359 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjb8f\" (UniqueName: \"kubernetes.io/projected/c993ea89-7c38-46cc-b67c-2b28542a2a9f-kube-api-access-wjb8f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.680174 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.680145 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:51.824704 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:51.824673 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7"] Jul 02 14:57:51.827011 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:57:51.826957 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc993ea89_7c38_46cc_b67c_2b28542a2a9f.slice/crio-59d7c2d8c567194141e9eca979fe71008b257ef8be0b24a8b24ea843f8c542bc WatchSource:0}: Error finding container 59d7c2d8c567194141e9eca979fe71008b257ef8be0b24a8b24ea843f8c542bc: Status 404 returned error can't find the container with id 59d7c2d8c567194141e9eca979fe71008b257ef8be0b24a8b24ea843f8c542bc Jul 02 14:57:52.313708 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.313672 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-65f62"] Jul 02 14:57:52.316018 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.315998 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:57:52.318406 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.318388 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 14:57:52.319471 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.319457 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 14:57:52.319765 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.319751 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-86xg8\"" Jul 02 14:57:52.337773 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.337749 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-65f62"] Jul 02 14:57:52.417321 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.417287 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88b35853-b9ff-43f7-b2cd-15c6d5f8bb80-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-65f62\" (UID: \"88b35853-b9ff-43f7-b2cd-15c6d5f8bb80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:57:52.417321 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.417358 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbwvc\" (UniqueName: \"kubernetes.io/projected/88b35853-b9ff-43f7-b2cd-15c6d5f8bb80-kube-api-access-gbwvc\") pod \"cert-manager-webhook-6486ffd997-65f62\" (UID: \"88b35853-b9ff-43f7-b2cd-15c6d5f8bb80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:57:52.518402 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.518374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88b35853-b9ff-43f7-b2cd-15c6d5f8bb80-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-65f62\" (UID: \"88b35853-b9ff-43f7-b2cd-15c6d5f8bb80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:57:52.518557 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.518425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbwvc\" (UniqueName: \"kubernetes.io/projected/88b35853-b9ff-43f7-b2cd-15c6d5f8bb80-kube-api-access-gbwvc\") pod \"cert-manager-webhook-6486ffd997-65f62\" (UID: \"88b35853-b9ff-43f7-b2cd-15c6d5f8bb80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:57:52.527520 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.527492 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88b35853-b9ff-43f7-b2cd-15c6d5f8bb80-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-65f62\" (UID: \"88b35853-b9ff-43f7-b2cd-15c6d5f8bb80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:57:52.527879 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.527862 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbwvc\" (UniqueName: \"kubernetes.io/projected/88b35853-b9ff-43f7-b2cd-15c6d5f8bb80-kube-api-access-gbwvc\") pod \"cert-manager-webhook-6486ffd997-65f62\" (UID: \"88b35853-b9ff-43f7-b2cd-15c6d5f8bb80\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:57:52.635969 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.635885 2566 generic.go:356] "Generic (PLEG): container finished" podID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerID="ae00b4face54ac6d60324df4c1b110a7b2231e0df78c5b4d4e6cadf175c03a60" exitCode=0 Jul 02 14:57:52.635969 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.635933 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" event={"ID":"c993ea89-7c38-46cc-b67c-2b28542a2a9f","Type":"ContainerDied","Data":"ae00b4face54ac6d60324df4c1b110a7b2231e0df78c5b4d4e6cadf175c03a60"} Jul 02 14:57:52.635969 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.635969 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" event={"ID":"c993ea89-7c38-46cc-b67c-2b28542a2a9f","Type":"ContainerStarted","Data":"59d7c2d8c567194141e9eca979fe71008b257ef8be0b24a8b24ea843f8c542bc"} Jul 02 14:57:52.640476 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.640453 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:57:52.776360 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:52.776211 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-65f62"] Jul 02 14:57:52.778785 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:57:52.778756 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88b35853_b9ff_43f7_b2cd_15c6d5f8bb80.slice/crio-3f35a55a8c3cd6afe3737aee834c778f107f1dc7b5cb6beb5c3bbf94bce0d5a3 WatchSource:0}: Error finding container 3f35a55a8c3cd6afe3737aee834c778f107f1dc7b5cb6beb5c3bbf94bce0d5a3: Status 404 returned error can't find the container with id 3f35a55a8c3cd6afe3737aee834c778f107f1dc7b5cb6beb5c3bbf94bce0d5a3 Jul 02 14:57:53.643787 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:53.643728 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" event={"ID":"88b35853-b9ff-43f7-b2cd-15c6d5f8bb80","Type":"ContainerStarted","Data":"3f35a55a8c3cd6afe3737aee834c778f107f1dc7b5cb6beb5c3bbf94bce0d5a3"} Jul 02 14:57:56.660030 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:56.659992 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" event={"ID":"88b35853-b9ff-43f7-b2cd-15c6d5f8bb80","Type":"ContainerStarted","Data":"c11c009017b1f0a2cb54800503cc4bec45967ac9f81fc364da3145ee4dd8daa5"} Jul 02 14:57:56.660512 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:56.660074 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:57:56.661682 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:56.661661 2566 generic.go:356] "Generic (PLEG): container finished" podID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerID="313ef459938d19145eb32872f383c3bc539d1c2699b2addb3715e9d27c69ea1c" exitCode=0 Jul 02 14:57:56.661770 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:56.661690 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" event={"ID":"c993ea89-7c38-46cc-b67c-2b28542a2a9f","Type":"ContainerDied","Data":"313ef459938d19145eb32872f383c3bc539d1c2699b2addb3715e9d27c69ea1c"} Jul 02 14:57:56.679107 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:56.679028 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" podStartSLOduration=1.851788518 podStartE2EDuration="4.679015927s" totalImagesPullingTime="2.827227409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:57:56.677808675 +0000 UTC m=+570.720611082" watchObservedRunningTime="2026-07-02 14:57:56.679015927 +0000 UTC m=+570.721818332" Jul 02 14:57:57.668314 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:57.668278 2566 generic.go:356] "Generic (PLEG): container finished" podID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerID="3774d5eb9091eea84a71f33d6e268cc6f034546f20208b37613daa3c3f7569bb" exitCode=0 Jul 02 14:57:57.668697 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:57.668362 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" event={"ID":"c993ea89-7c38-46cc-b67c-2b28542a2a9f","Type":"ContainerDied","Data":"3774d5eb9091eea84a71f33d6e268cc6f034546f20208b37613daa3c3f7569bb"} Jul 02 14:57:58.800665 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.800644 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:58.878019 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.877988 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjb8f\" (UniqueName: \"kubernetes.io/projected/c993ea89-7c38-46cc-b67c-2b28542a2a9f-kube-api-access-wjb8f\") pod \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " Jul 02 14:57:58.878019 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.878017 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-bundle\") pod \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " Jul 02 14:57:58.878246 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.878036 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-util\") pod \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\" (UID: \"c993ea89-7c38-46cc-b67c-2b28542a2a9f\") " Jul 02 14:57:58.878472 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.878446 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-bundle" (OuterVolumeSpecName: "bundle") pod "c993ea89-7c38-46cc-b67c-2b28542a2a9f" (UID: "c993ea89-7c38-46cc-b67c-2b28542a2a9f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:57:58.880017 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.879996 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c993ea89-7c38-46cc-b67c-2b28542a2a9f-kube-api-access-wjb8f" (OuterVolumeSpecName: "kube-api-access-wjb8f") pod "c993ea89-7c38-46cc-b67c-2b28542a2a9f" (UID: "c993ea89-7c38-46cc-b67c-2b28542a2a9f"). InnerVolumeSpecName "kube-api-access-wjb8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:57:58.884300 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.884277 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-util" (OuterVolumeSpecName: "util") pod "c993ea89-7c38-46cc-b67c-2b28542a2a9f" (UID: "c993ea89-7c38-46cc-b67c-2b28542a2a9f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:57:58.978617 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.978586 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjb8f\" (UniqueName: \"kubernetes.io/projected/c993ea89-7c38-46cc-b67c-2b28542a2a9f-kube-api-access-wjb8f\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:58.978617 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.978617 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:58.978811 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:58.978630 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c993ea89-7c38-46cc-b67c-2b28542a2a9f-util\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:57:59.678681 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:59.678653 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" Jul 02 14:57:59.678681 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:59.678669 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tr7" event={"ID":"c993ea89-7c38-46cc-b67c-2b28542a2a9f","Type":"ContainerDied","Data":"59d7c2d8c567194141e9eca979fe71008b257ef8be0b24a8b24ea843f8c542bc"} Jul 02 14:57:59.678887 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:57:59.678710 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59d7c2d8c567194141e9eca979fe71008b257ef8be0b24a8b24ea843f8c542bc" Jul 02 14:58:02.064280 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.064247 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rcz4s"] Jul 02 14:58:02.064694 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.064565 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerName="util" Jul 02 14:58:02.064694 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.064576 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerName="util" Jul 02 14:58:02.064694 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.064592 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerName="pull" Jul 02 14:58:02.064694 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.064598 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerName="pull" Jul 02 14:58:02.064694 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.064604 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerName="extract" Jul 02 14:58:02.064694 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.064609 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerName="extract" Jul 02 14:58:02.064694 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.064663 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c993ea89-7c38-46cc-b67c-2b28542a2a9f" containerName="extract" Jul 02 14:58:02.070498 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.069223 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rcz4s" Jul 02 14:58:02.072277 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.072255 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-frtwh\"" Jul 02 14:58:02.078142 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.078039 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rcz4s"] Jul 02 14:58:02.101919 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.101888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb-bound-sa-token\") pod \"cert-manager-55b4d954d5-rcz4s\" (UID: \"304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb\") " pod="cert-manager/cert-manager-55b4d954d5-rcz4s" Jul 02 14:58:02.102056 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.101959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b55j5\" (UniqueName: \"kubernetes.io/projected/304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb-kube-api-access-b55j5\") pod \"cert-manager-55b4d954d5-rcz4s\" (UID: \"304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb\") " pod="cert-manager/cert-manager-55b4d954d5-rcz4s" Jul 02 14:58:02.203315 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.203275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b55j5\" (UniqueName: \"kubernetes.io/projected/304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb-kube-api-access-b55j5\") pod \"cert-manager-55b4d954d5-rcz4s\" (UID: \"304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb\") " pod="cert-manager/cert-manager-55b4d954d5-rcz4s" Jul 02 14:58:02.203509 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.203355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb-bound-sa-token\") pod \"cert-manager-55b4d954d5-rcz4s\" (UID: \"304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb\") " pod="cert-manager/cert-manager-55b4d954d5-rcz4s" Jul 02 14:58:02.211545 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.211518 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb-bound-sa-token\") pod \"cert-manager-55b4d954d5-rcz4s\" (UID: \"304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb\") " pod="cert-manager/cert-manager-55b4d954d5-rcz4s" Jul 02 14:58:02.211874 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.211758 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b55j5\" (UniqueName: \"kubernetes.io/projected/304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb-kube-api-access-b55j5\") pod \"cert-manager-55b4d954d5-rcz4s\" (UID: \"304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb\") " pod="cert-manager/cert-manager-55b4d954d5-rcz4s" Jul 02 14:58:02.380853 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.380762 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rcz4s" Jul 02 14:58:02.511709 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.511678 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rcz4s"] Jul 02 14:58:02.512941 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:58:02.512915 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod304d56ec_e6a2_4ca4_a771_3cfd8c7b15eb.slice/crio-b1888e04d35a95b2940fd36b571acf0a9d9fef92f804d6851c2bc1260a2f9eb5 WatchSource:0}: Error finding container b1888e04d35a95b2940fd36b571acf0a9d9fef92f804d6851c2bc1260a2f9eb5: Status 404 returned error can't find the container with id b1888e04d35a95b2940fd36b571acf0a9d9fef92f804d6851c2bc1260a2f9eb5 Jul 02 14:58:02.670806 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.670723 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-65f62" Jul 02 14:58:02.693838 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.693805 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rcz4s" event={"ID":"304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb","Type":"ContainerStarted","Data":"06f8ece45e6c38ad9fb4f8808cfcf80a40c5692686614ed7584de8d0d1ea82b3"} Jul 02 14:58:02.693838 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.693844 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rcz4s" event={"ID":"304d56ec-e6a2-4ca4-a771-3cfd8c7b15eb","Type":"ContainerStarted","Data":"b1888e04d35a95b2940fd36b571acf0a9d9fef92f804d6851c2bc1260a2f9eb5"} Jul 02 14:58:02.714614 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:02.714568 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rcz4s" podStartSLOduration=0.71455234 podStartE2EDuration="714.55234ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:02.71245639 +0000 UTC m=+576.755258796" watchObservedRunningTime="2026-07-02 14:58:02.71455234 +0000 UTC m=+576.757354745" Jul 02 14:58:10.535735 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.535703 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz"] Jul 02 14:58:10.539636 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.539614 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.541871 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.541846 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 14:58:10.541963 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.541852 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-645h8\"" Jul 02 14:58:10.542304 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.542289 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 14:58:10.548270 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.548239 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz"] Jul 02 14:58:10.577603 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.577571 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scsq9\" (UniqueName: \"kubernetes.io/projected/282ff8c9-b069-4cd5-bc57-c833d2818d43-kube-api-access-scsq9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.577707 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.577606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.577707 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.577679 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.679108 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.679072 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scsq9\" (UniqueName: \"kubernetes.io/projected/282ff8c9-b069-4cd5-bc57-c833d2818d43-kube-api-access-scsq9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.679254 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.679115 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.679254 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.679237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.679585 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.679567 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.679630 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.679589 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.692508 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.692478 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scsq9\" (UniqueName: \"kubernetes.io/projected/282ff8c9-b069-4cd5-bc57-c833d2818d43-kube-api-access-scsq9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.849396 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.849298 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:10.982777 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:10.982754 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz"] Jul 02 14:58:10.985184 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:58:10.985148 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282ff8c9_b069_4cd5_bc57_c833d2818d43.slice/crio-aa2ec2a9bfc9faca5cd88ee8568af8fd2b7f3b1833cadd6ddb6046cfc6d19daa WatchSource:0}: Error finding container aa2ec2a9bfc9faca5cd88ee8568af8fd2b7f3b1833cadd6ddb6046cfc6d19daa: Status 404 returned error can't find the container with id aa2ec2a9bfc9faca5cd88ee8568af8fd2b7f3b1833cadd6ddb6046cfc6d19daa Jul 02 14:58:11.736301 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:11.736271 2566 generic.go:356] "Generic (PLEG): container finished" podID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerID="7f97f83ad83751c0d0cb785b09f5365144a0f17186cee65816708e0436378bf0" exitCode=0 Jul 02 14:58:11.736726 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:11.736358 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" event={"ID":"282ff8c9-b069-4cd5-bc57-c833d2818d43","Type":"ContainerDied","Data":"7f97f83ad83751c0d0cb785b09f5365144a0f17186cee65816708e0436378bf0"} Jul 02 14:58:11.736726 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:11.736418 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" event={"ID":"282ff8c9-b069-4cd5-bc57-c833d2818d43","Type":"ContainerStarted","Data":"aa2ec2a9bfc9faca5cd88ee8568af8fd2b7f3b1833cadd6ddb6046cfc6d19daa"} Jul 02 14:58:13.747849 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:13.747816 2566 generic.go:356] "Generic (PLEG): container finished" podID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerID="28740e1c24f7d06b09d44f88d856bef4117f4079af74666d754e4ebcf808fca6" exitCode=0 Jul 02 14:58:13.748300 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:13.747905 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" event={"ID":"282ff8c9-b069-4cd5-bc57-c833d2818d43","Type":"ContainerDied","Data":"28740e1c24f7d06b09d44f88d856bef4117f4079af74666d754e4ebcf808fca6"} Jul 02 14:58:14.755125 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:14.755090 2566 generic.go:356] "Generic (PLEG): container finished" podID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerID="56aedfe211c7687a9a9a8e7751d285a73a1dce704715b1b366bcd8ed00082645" exitCode=0 Jul 02 14:58:14.755565 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:14.755133 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" event={"ID":"282ff8c9-b069-4cd5-bc57-c833d2818d43","Type":"ContainerDied","Data":"56aedfe211c7687a9a9a8e7751d285a73a1dce704715b1b366bcd8ed00082645"} Jul 02 14:58:15.882686 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:15.882665 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:15.926882 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:15.926856 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scsq9\" (UniqueName: \"kubernetes.io/projected/282ff8c9-b069-4cd5-bc57-c833d2818d43-kube-api-access-scsq9\") pod \"282ff8c9-b069-4cd5-bc57-c833d2818d43\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " Jul 02 14:58:15.927013 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:15.926885 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-util\") pod \"282ff8c9-b069-4cd5-bc57-c833d2818d43\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " Jul 02 14:58:15.927013 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:15.926940 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-bundle\") pod \"282ff8c9-b069-4cd5-bc57-c833d2818d43\" (UID: \"282ff8c9-b069-4cd5-bc57-c833d2818d43\") " Jul 02 14:58:15.927673 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:15.927647 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-bundle" (OuterVolumeSpecName: "bundle") pod "282ff8c9-b069-4cd5-bc57-c833d2818d43" (UID: "282ff8c9-b069-4cd5-bc57-c833d2818d43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:58:15.928941 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:15.928920 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/282ff8c9-b069-4cd5-bc57-c833d2818d43-kube-api-access-scsq9" (OuterVolumeSpecName: "kube-api-access-scsq9") pod "282ff8c9-b069-4cd5-bc57-c833d2818d43" (UID: "282ff8c9-b069-4cd5-bc57-c833d2818d43"). InnerVolumeSpecName "kube-api-access-scsq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:58:15.932679 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:15.932657 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-util" (OuterVolumeSpecName: "util") pod "282ff8c9-b069-4cd5-bc57-c833d2818d43" (UID: "282ff8c9-b069-4cd5-bc57-c833d2818d43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:58:16.027524 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:16.027445 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scsq9\" (UniqueName: \"kubernetes.io/projected/282ff8c9-b069-4cd5-bc57-c833d2818d43-kube-api-access-scsq9\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:58:16.027524 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:16.027471 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-util\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:58:16.027524 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:16.027481 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/282ff8c9-b069-4cd5-bc57-c833d2818d43-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 14:58:16.765247 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:16.765223 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" Jul 02 14:58:16.765410 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:16.765251 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn52kz" event={"ID":"282ff8c9-b069-4cd5-bc57-c833d2818d43","Type":"ContainerDied","Data":"aa2ec2a9bfc9faca5cd88ee8568af8fd2b7f3b1833cadd6ddb6046cfc6d19daa"} Jul 02 14:58:16.765410 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:16.765292 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa2ec2a9bfc9faca5cd88ee8568af8fd2b7f3b1833cadd6ddb6046cfc6d19daa" Jul 02 14:58:26.431737 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:26.431711 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 14:58:26.432280 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:26.431805 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 14:58:27.689554 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.689526 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl"] Jul 02 14:58:27.691291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.689856 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerName="pull" Jul 02 14:58:27.691291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.689869 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerName="pull" Jul 02 14:58:27.691291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.689880 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerName="util" Jul 02 14:58:27.691291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.689886 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerName="util" Jul 02 14:58:27.691291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.689909 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerName="extract" Jul 02 14:58:27.691291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.689916 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerName="extract" Jul 02 14:58:27.691291 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.689965 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="282ff8c9-b069-4cd5-bc57-c833d2818d43" containerName="extract" Jul 02 14:58:27.691868 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.691850 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.694737 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.694714 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pkwmq\"" Jul 02 14:58:27.694950 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.694931 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 14:58:27.695047 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.694967 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 14:58:27.695047 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.694971 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 14:58:27.695047 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.694972 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 14:58:27.709859 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.709831 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl"] Jul 02 14:58:27.827658 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.827624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-tmp\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.827824 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.827670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkmn7\" (UniqueName: \"kubernetes.io/projected/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-kube-api-access-wkmn7\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.827824 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.827694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-manifests\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.827824 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.827784 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-webhook-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.827926 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.827823 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-apiservice-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.928950 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.928913 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-tmp\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.929126 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.928964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkmn7\" (UniqueName: \"kubernetes.io/projected/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-kube-api-access-wkmn7\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.929126 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.928988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-manifests\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.929126 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.929035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-webhook-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.929126 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.929064 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-apiservice-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.929464 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.929430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-manifests\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.931094 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.931070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-tmp\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.931347 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.931316 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-apiservice-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.931413 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.931397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-webhook-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:27.936537 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:27.936515 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkmn7\" (UniqueName: \"kubernetes.io/projected/a5296b66-ff86-4ea1-9046-c9a9b1d5c722-kube-api-access-wkmn7\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-dn5gl\" (UID: \"a5296b66-ff86-4ea1-9046-c9a9b1d5c722\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:28.002394 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:28.002314 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:28.144780 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:28.144753 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl"] Jul 02 14:58:28.145980 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:58:28.145951 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5296b66_ff86_4ea1_9046_c9a9b1d5c722.slice/crio-07c0904ee20f4e9dda8f399b40a2c1843eef4c4d0e29537259e6be99291ea1da WatchSource:0}: Error finding container 07c0904ee20f4e9dda8f399b40a2c1843eef4c4d0e29537259e6be99291ea1da: Status 404 returned error can't find the container with id 07c0904ee20f4e9dda8f399b40a2c1843eef4c4d0e29537259e6be99291ea1da Jul 02 14:58:28.822730 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:28.822693 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" event={"ID":"a5296b66-ff86-4ea1-9046-c9a9b1d5c722","Type":"ContainerStarted","Data":"07c0904ee20f4e9dda8f399b40a2c1843eef4c4d0e29537259e6be99291ea1da"} Jul 02 14:58:31.839787 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:31.839737 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" event={"ID":"a5296b66-ff86-4ea1-9046-c9a9b1d5c722","Type":"ContainerStarted","Data":"398f0a926de946d74025d66ce231344b1ae8cf6b9767f7ac6a97ad86defbeee0"} Jul 02 14:58:32.846312 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:32.846277 2566 generic.go:356] "Generic (PLEG): container finished" podID="a5296b66-ff86-4ea1-9046-c9a9b1d5c722" containerID="398f0a926de946d74025d66ce231344b1ae8cf6b9767f7ac6a97ad86defbeee0" exitCode=0 Jul 02 14:58:32.846688 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:32.846367 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" event={"ID":"a5296b66-ff86-4ea1-9046-c9a9b1d5c722","Type":"ContainerDied","Data":"398f0a926de946d74025d66ce231344b1ae8cf6b9767f7ac6a97ad86defbeee0"} Jul 02 14:58:32.846857 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:32.846841 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:58:33.853090 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:33.853056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" event={"ID":"a5296b66-ff86-4ea1-9046-c9a9b1d5c722","Type":"ContainerStarted","Data":"5a9bfca67330c520139a2856619bf43a4d210e5f068334f5c3c47ece8d989837"} Jul 02 14:58:33.853491 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:33.853189 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:33.873966 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:33.873916 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" podStartSLOduration=2.399999538 podStartE2EDuration="6.873902416s" totalImagesPullingTime="3.389667873s" totalInitContainerRuntime="1.084235005s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:33.873296939 +0000 UTC m=+607.916099346" watchObservedRunningTime="2026-07-02 14:58:33.873902416 +0000 UTC m=+607.916704822" Jul 02 14:58:44.860195 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:44.860166 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-dn5gl" Jul 02 14:58:47.115406 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.115373 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-685b948f4-75rzx"] Jul 02 14:58:47.123264 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.123247 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.130646 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.130627 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 14:58:47.130731 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.130717 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 14:58:47.130783 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.130768 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9l2cb\"" Jul 02 14:58:47.140547 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.140528 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685b948f4-75rzx"] Jul 02 14:58:47.202317 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.202276 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60c52977-77f6-451d-a1d4-26955da7314d-tmp\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.202492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.202371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkzcp\" (UniqueName: \"kubernetes.io/projected/60c52977-77f6-451d-a1d4-26955da7314d-kube-api-access-lkzcp\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.202492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.202434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60c52977-77f6-451d-a1d4-26955da7314d-tls-certs\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.303556 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.303520 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60c52977-77f6-451d-a1d4-26955da7314d-tmp\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.303731 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.303665 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkzcp\" (UniqueName: \"kubernetes.io/projected/60c52977-77f6-451d-a1d4-26955da7314d-kube-api-access-lkzcp\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.303731 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.303700 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60c52977-77f6-451d-a1d4-26955da7314d-tls-certs\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.303854 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:58:47.303793 2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 02 14:58:47.303854 ip-10-0-141-121 kubenswrapper[2566]: E0702 14:58:47.303856 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60c52977-77f6-451d-a1d4-26955da7314d-tls-certs podName:60c52977-77f6-451d-a1d4-26955da7314d nodeName:}" failed. No retries permitted until 2026-07-02 14:58:47.803840391 +0000 UTC m=+621.846642776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/60c52977-77f6-451d-a1d4-26955da7314d-tls-certs") pod "kube-auth-proxy-685b948f4-75rzx" (UID: "60c52977-77f6-451d-a1d4-26955da7314d") : secret "kube-auth-proxy-tls" not found Jul 02 14:58:47.305750 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.305726 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60c52977-77f6-451d-a1d4-26955da7314d-tmp\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.320374 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.320347 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkzcp\" (UniqueName: \"kubernetes.io/projected/60c52977-77f6-451d-a1d4-26955da7314d-kube-api-access-lkzcp\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.813629 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.813549 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60c52977-77f6-451d-a1d4-26955da7314d-tls-certs\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:47.815893 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:47.815864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60c52977-77f6-451d-a1d4-26955da7314d-tls-certs\") pod \"kube-auth-proxy-685b948f4-75rzx\" (UID: \"60c52977-77f6-451d-a1d4-26955da7314d\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:48.031890 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:48.031861 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" Jul 02 14:58:48.197141 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:48.197111 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685b948f4-75rzx"] Jul 02 14:58:48.199549 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:58:48.199524 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c52977_77f6_451d_a1d4_26955da7314d.slice/crio-9c110afbede06f06d14d8bcffd60375e53c7932c098b23cd352329c2f294ff48 WatchSource:0}: Error finding container 9c110afbede06f06d14d8bcffd60375e53c7932c098b23cd352329c2f294ff48: Status 404 returned error can't find the container with id 9c110afbede06f06d14d8bcffd60375e53c7932c098b23cd352329c2f294ff48 Jul 02 14:58:48.923180 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:48.923149 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" event={"ID":"60c52977-77f6-451d-a1d4-26955da7314d","Type":"ContainerStarted","Data":"9c110afbede06f06d14d8bcffd60375e53c7932c098b23cd352329c2f294ff48"} Jul 02 14:58:51.939598 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:51.939563 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" event={"ID":"60c52977-77f6-451d-a1d4-26955da7314d","Type":"ContainerStarted","Data":"6f092d80cb406e9e4f1dcb72be72542875611a89add830b05ab66982d838d428"} Jul 02 14:58:51.956972 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:51.956925 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-685b948f4-75rzx" podStartSLOduration=1.550471696 podStartE2EDuration="4.956911823s" totalImagesPullingTime="3.406440127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:51.956407329 +0000 UTC m=+625.999209734" watchObservedRunningTime="2026-07-02 14:58:51.956911823 +0000 UTC m=+625.999714225" Jul 02 14:58:55.726668 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.726639 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs"] Jul 02 14:58:55.730295 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.730275 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.732366 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.732344 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 14:58:55.732759 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.732744 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pgcsn\"" Jul 02 14:58:55.744458 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.744437 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs"] Jul 02 14:58:55.789378 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.789329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.789557 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.789389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7zcb\" (UniqueName: \"kubernetes.io/projected/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-kube-api-access-c7zcb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.789557 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.789450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.789664 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.789548 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.789664 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.789584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.789664 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.789624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.789664 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.789654 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.789844 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.789681 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.789844 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.789743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890306 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890272 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890351 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890377 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890492 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890409 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890701 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7zcb\" (UniqueName: \"kubernetes.io/projected/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-kube-api-access-c7zcb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890701 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890701 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890843 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890843 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890769 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.890843 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.890796 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.891047 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.891026 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.891103 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.891049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.891103 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.891051 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.892720 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.892690 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.892959 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.892939 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.904774 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.904748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.904947 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.904931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7zcb\" (UniqueName: \"kubernetes.io/projected/7146e73f-eb48-4b7b-8714-2c0a6a74fff4-kube-api-access-c7zcb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mn4bs\" (UID: \"7146e73f-eb48-4b7b-8714-2c0a6a74fff4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:55.914115 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.914095 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd"] Jul 02 14:58:55.918584 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.918571 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:55.920505 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.920486 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 14:58:55.920618 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.920602 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 14:58:55.921017 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.920994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dn2z9\"" Jul 02 14:58:55.921117 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.921091 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 14:58:55.933580 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.933559 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd"] Jul 02 14:58:55.991783 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.991711 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:55.991783 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.991740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:55.991783 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.991764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nngzz\" (UniqueName: \"kubernetes.io/projected/ddf28c64-c97a-4161-aa91-660d03835fe7-kube-api-access-nngzz\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:55.991973 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.991855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:55.991973 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.991905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ddf28c64-c97a-4161-aa91-660d03835fe7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:55.992036 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.991990 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:55.992036 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:55.992013 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf28c64-c97a-4161-aa91-660d03835fe7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.040120 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.040091 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:58:56.093419 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.093391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ddf28c64-c97a-4161-aa91-660d03835fe7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.093559 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.093546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.093631 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.093570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf28c64-c97a-4161-aa91-660d03835fe7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.093631 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.093599 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.093631 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.093617 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.093788 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.093644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nngzz\" (UniqueName: \"kubernetes.io/projected/ddf28c64-c97a-4161-aa91-660d03835fe7-kube-api-access-nngzz\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.093788 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.093688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.094504 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.094477 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.095796 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.095774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ddf28c64-c97a-4161-aa91-660d03835fe7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.096185 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.096136 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.096273 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.096210 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf28c64-c97a-4161-aa91-660d03835fe7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.097394 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.097374 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.103967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.103804 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nngzz\" (UniqueName: \"kubernetes.io/projected/ddf28c64-c97a-4161-aa91-660d03835fe7-kube-api-access-nngzz\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.103967 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.103825 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf28c64-c97a-4161-aa91-660d03835fe7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-69fnd\" (UID: \"ddf28c64-c97a-4161-aa91-660d03835fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.191272 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.191244 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs"] Jul 02 14:58:56.191946 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:58:56.191918 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7146e73f_eb48_4b7b_8714_2c0a6a74fff4.slice/crio-a990f62f71f412cf45d3f0b1f252b766a6f96db2a1281f97ec5b535178624476 WatchSource:0}: Error finding container a990f62f71f412cf45d3f0b1f252b766a6f96db2a1281f97ec5b535178624476: Status 404 returned error can't find the container with id a990f62f71f412cf45d3f0b1f252b766a6f96db2a1281f97ec5b535178624476 Jul 02 14:58:56.227497 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.227477 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:58:56.385313 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.385291 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd"] Jul 02 14:58:56.387379 ip-10-0-141-121 kubenswrapper[2566]: W0702 14:58:56.387355 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf28c64_c97a_4161_aa91_660d03835fe7.slice/crio-70f52dc23f71a0863b3577e7b15b0f4a400d7573f80fb0234c1a23d1baa26441 WatchSource:0}: Error finding container 70f52dc23f71a0863b3577e7b15b0f4a400d7573f80fb0234c1a23d1baa26441: Status 404 returned error can't find the container with id 70f52dc23f71a0863b3577e7b15b0f4a400d7573f80fb0234c1a23d1baa26441 Jul 02 14:58:56.964823 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.964781 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" event={"ID":"ddf28c64-c97a-4161-aa91-660d03835fe7","Type":"ContainerStarted","Data":"70f52dc23f71a0863b3577e7b15b0f4a400d7573f80fb0234c1a23d1baa26441"} Jul 02 14:58:56.965993 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:58:56.965970 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" event={"ID":"7146e73f-eb48-4b7b-8714-2c0a6a74fff4","Type":"ContainerStarted","Data":"a990f62f71f412cf45d3f0b1f252b766a6f96db2a1281f97ec5b535178624476"} Jul 02 14:59:00.296234 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:00.296187 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 14:59:00.296651 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:00.296270 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 14:59:00.300860 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:00.300826 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 14:59:00.300950 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:00.300894 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 14:59:00.300950 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:00.300927 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 14:59:00.990717 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:00.990680 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" event={"ID":"ddf28c64-c97a-4161-aa91-660d03835fe7","Type":"ContainerStarted","Data":"5df3abd27481d151d47688f47136643b2cb3ea702854c49285e2873a4e0d6884"} Jul 02 14:59:00.990918 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:00.990844 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 14:59:00.992189 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:00.992159 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" event={"ID":"7146e73f-eb48-4b7b-8714-2c0a6a74fff4","Type":"ContainerStarted","Data":"14697bac9ffa0b96df786c194f4d236ca99cdad247573fd79ba4e7be728aa186"} Jul 02 14:59:01.015735 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:01.015690 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" podStartSLOduration=2.109189813 podStartE2EDuration="6.01567558s" totalImagesPullingTime="3.906485767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:59:01.0146903 +0000 UTC m=+635.057492707" watchObservedRunningTime="2026-07-02 14:59:01.01567558 +0000 UTC m=+635.058477986" Jul 02 14:59:01.040887 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:01.040862 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:59:01.045618 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:01.045598 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:59:01.054406 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:01.054349 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" podStartSLOduration=1.9476481140000002 podStartE2EDuration="6.054311861s" totalImagesPullingTime="4.106663747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:59:01.050196892 +0000 UTC m=+635.092999299" watchObservedRunningTime="2026-07-02 14:59:01.054311861 +0000 UTC m=+635.097114269" Jul 02 14:59:01.997506 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:01.997479 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:59:01.998392 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:01.998369 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mn4bs" Jul 02 14:59:01.999233 ip-10-0-141-121 kubenswrapper[2566]: I0702 14:59:01.999215 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69fnd" Jul 02 15:00:02.038232 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.038182 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b967648b8-5ggp4"] Jul 02 15:00:02.041247 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.041224 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.053961 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.053931 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b967648b8-5ggp4"] Jul 02 15:00:02.183097 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.183061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-console-serving-cert\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.183097 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.183098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-trusted-ca-bundle\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.183304 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.183126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7xmn\" (UniqueName: \"kubernetes.io/projected/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-kube-api-access-k7xmn\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.183304 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.183166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-service-ca\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.183304 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.183193 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-console-config\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.183304 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.183260 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-console-oauth-config\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.183454 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.183310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-oauth-serving-cert\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284014 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.283978 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-service-ca\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284224 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.284033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-console-config\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284224 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.284071 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-console-oauth-config\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284224 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.284108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-oauth-serving-cert\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284224 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.284198 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-console-serving-cert\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284224 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.284222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-trusted-ca-bundle\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284525 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.284256 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7xmn\" (UniqueName: \"kubernetes.io/projected/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-kube-api-access-k7xmn\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284862 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.284834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-service-ca\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284985 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.284877 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-console-config\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.284985 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.284938 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-oauth-serving-cert\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.285088 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.285070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-trusted-ca-bundle\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.287162 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.287138 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-console-oauth-config\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.287277 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.287138 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-console-serving-cert\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.295207 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.295151 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7xmn\" (UniqueName: \"kubernetes.io/projected/ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7-kube-api-access-k7xmn\") pod \"console-7b967648b8-5ggp4\" (UID: \"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7\") " pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.351497 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.351465 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:02.492928 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:02.492903 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b967648b8-5ggp4"] Jul 02 15:00:02.494619 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:00:02.494591 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2210dc_6b49_4dba_94b3_5c36bd2a0ef7.slice/crio-cef38bff67a476eed91e75db14b08d66e076ca35422ba46fc6cb5ccca4ffd9da WatchSource:0}: Error finding container cef38bff67a476eed91e75db14b08d66e076ca35422ba46fc6cb5ccca4ffd9da: Status 404 returned error can't find the container with id cef38bff67a476eed91e75db14b08d66e076ca35422ba46fc6cb5ccca4ffd9da Jul 02 15:00:03.289813 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:03.289780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b967648b8-5ggp4" event={"ID":"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7","Type":"ContainerStarted","Data":"05d034e0f5e401e403fdacd05b7aa7c528404613cbaa7e1671ecbcdededbc5c4"} Jul 02 15:00:03.290170 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:03.289831 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b967648b8-5ggp4" event={"ID":"ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7","Type":"ContainerStarted","Data":"cef38bff67a476eed91e75db14b08d66e076ca35422ba46fc6cb5ccca4ffd9da"} Jul 02 15:00:03.306701 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:03.306657 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b967648b8-5ggp4" podStartSLOduration=1.306644001 podStartE2EDuration="1.306644001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:00:03.305496172 +0000 UTC m=+697.348298579" watchObservedRunningTime="2026-07-02 15:00:03.306644001 +0000 UTC m=+697.349446407" Jul 02 15:00:08.907088 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:08.907052 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q"] Jul 02 15:00:08.909790 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:08.909773 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:08.911945 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:08.911926 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 15:00:08.912476 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:08.912427 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zkdgw\"" Jul 02 15:00:08.912476 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:08.912427 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 15:00:08.918154 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:08.918131 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q"] Jul 02 15:00:08.949209 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:08.949178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:08.949397 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:08.949215 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:08.949397 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:08.949367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn7rd\" (UniqueName: \"kubernetes.io/projected/9414e13b-538a-4c81-8cd7-35263d1a174c-kube-api-access-hn7rd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:09.007642 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.007613 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj"] Jul 02 15:00:09.010228 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.010212 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.021270 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.021179 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj"] Jul 02 15:00:09.049863 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.049833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swdpw\" (UniqueName: \"kubernetes.io/projected/78973339-8fef-481b-947e-9b6eb2702e94-kube-api-access-swdpw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.050036 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.049889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:09.050036 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.049956 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:09.050036 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.049993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.050155 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.050049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn7rd\" (UniqueName: \"kubernetes.io/projected/9414e13b-538a-4c81-8cd7-35263d1a174c-kube-api-access-hn7rd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:09.050155 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.050105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.050292 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.050273 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:09.050349 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.050291 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:09.057902 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.057875 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn7rd\" (UniqueName: \"kubernetes.io/projected/9414e13b-538a-4c81-8cd7-35263d1a174c-kube-api-access-hn7rd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:09.151247 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.151210 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.151450 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.151262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swdpw\" (UniqueName: \"kubernetes.io/projected/78973339-8fef-481b-947e-9b6eb2702e94-kube-api-access-swdpw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.151450 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.151319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.151690 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.151675 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.151730 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.151672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.159293 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.159230 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swdpw\" (UniqueName: \"kubernetes.io/projected/78973339-8fef-481b-947e-9b6eb2702e94-kube-api-access-swdpw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.220814 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.220780 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:09.310918 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.310885 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr"] Jul 02 15:00:09.314519 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.314492 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.320741 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.320276 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:09.322892 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.322862 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr"] Jul 02 15:00:09.353615 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.353586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6dzq\" (UniqueName: \"kubernetes.io/projected/f1bbbcc4-217f-419f-b00c-c804ca3e478d-kube-api-access-q6dzq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.353768 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.353629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.353768 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.353687 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.361098 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.361067 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q"] Jul 02 15:00:09.362862 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:00:09.362830 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9414e13b_538a_4c81_8cd7_35263d1a174c.slice/crio-2ce135df0d06bb6e883f8ea789841120810ae2c3550ca13e42dea5d41c0b68d3 WatchSource:0}: Error finding container 2ce135df0d06bb6e883f8ea789841120810ae2c3550ca13e42dea5d41c0b68d3: Status 404 returned error can't find the container with id 2ce135df0d06bb6e883f8ea789841120810ae2c3550ca13e42dea5d41c0b68d3 Jul 02 15:00:09.455134 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.455097 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.455327 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.455205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6dzq\" (UniqueName: \"kubernetes.io/projected/f1bbbcc4-217f-419f-b00c-c804ca3e478d-kube-api-access-q6dzq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.455327 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.455239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.455500 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.455479 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.455587 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.455564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.464994 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.464969 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj"] Jul 02 15:00:09.466761 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.466735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6dzq\" (UniqueName: \"kubernetes.io/projected/f1bbbcc4-217f-419f-b00c-c804ca3e478d-kube-api-access-q6dzq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.467269 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:00:09.467250 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78973339_8fef_481b_947e_9b6eb2702e94.slice/crio-5d9e4555637a6d7c8119e69b1438e1f924e45b2520c0d94d4dfc586f3958a4b7 WatchSource:0}: Error finding container 5d9e4555637a6d7c8119e69b1438e1f924e45b2520c0d94d4dfc586f3958a4b7: Status 404 returned error can't find the container with id 5d9e4555637a6d7c8119e69b1438e1f924e45b2520c0d94d4dfc586f3958a4b7 Jul 02 15:00:09.628574 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.628546 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:09.711909 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.711884 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l"] Jul 02 15:00:09.715385 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.715365 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:09.722453 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.722432 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l"] Jul 02 15:00:09.757994 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.757947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:09.758161 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.758079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gdcc\" (UniqueName: \"kubernetes.io/projected/2fefcd0a-96a7-4989-a02c-a840cee3480b-kube-api-access-6gdcc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:09.758161 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.758119 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:09.760328 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.760307 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr"] Jul 02 15:00:09.761744 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:00:09.761726 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1bbbcc4_217f_419f_b00c_c804ca3e478d.slice/crio-b0b1b0103259f7772eef130b6bfe0780538f7772c8be034d6f574cd7c1d691ef WatchSource:0}: Error finding container b0b1b0103259f7772eef130b6bfe0780538f7772c8be034d6f574cd7c1d691ef: Status 404 returned error can't find the container with id b0b1b0103259f7772eef130b6bfe0780538f7772c8be034d6f574cd7c1d691ef Jul 02 15:00:09.858882 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.858846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gdcc\" (UniqueName: \"kubernetes.io/projected/2fefcd0a-96a7-4989-a02c-a840cee3480b-kube-api-access-6gdcc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:09.858882 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.858896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:09.859141 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.859047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:09.859302 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.859261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:09.859462 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.859433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:09.866754 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:09.866734 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gdcc\" (UniqueName: \"kubernetes.io/projected/2fefcd0a-96a7-4989-a02c-a840cee3480b-kube-api-access-6gdcc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:10.026944 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.026901 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:10.157268 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.157241 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l"] Jul 02 15:00:10.159185 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:00:10.159158 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fefcd0a_96a7_4989_a02c_a840cee3480b.slice/crio-c880544c5da53bb04bbe9f863603744228baeca034ec89e82871d30b25335d43 WatchSource:0}: Error finding container c880544c5da53bb04bbe9f863603744228baeca034ec89e82871d30b25335d43: Status 404 returned error can't find the container with id c880544c5da53bb04bbe9f863603744228baeca034ec89e82871d30b25335d43 Jul 02 15:00:10.326931 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.326844 2566 generic.go:356] "Generic (PLEG): container finished" podID="78973339-8fef-481b-947e-9b6eb2702e94" containerID="c3ab2e304f4bfbbd66d97d12a8c0eec396ce45d97b3654342be553ef87721f9a" exitCode=0 Jul 02 15:00:10.327082 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.326939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" event={"ID":"78973339-8fef-481b-947e-9b6eb2702e94","Type":"ContainerDied","Data":"c3ab2e304f4bfbbd66d97d12a8c0eec396ce45d97b3654342be553ef87721f9a"} Jul 02 15:00:10.327082 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.326995 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" event={"ID":"78973339-8fef-481b-947e-9b6eb2702e94","Type":"ContainerStarted","Data":"5d9e4555637a6d7c8119e69b1438e1f924e45b2520c0d94d4dfc586f3958a4b7"} Jul 02 15:00:10.328733 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.328709 2566 generic.go:356] "Generic (PLEG): container finished" podID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerID="c48ec6a0e05cbdc42ad5948fc489156d3392632b3354febc226f0f43a3f2031e" exitCode=0 Jul 02 15:00:10.328853 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.328796 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" event={"ID":"9414e13b-538a-4c81-8cd7-35263d1a174c","Type":"ContainerDied","Data":"c48ec6a0e05cbdc42ad5948fc489156d3392632b3354febc226f0f43a3f2031e"} Jul 02 15:00:10.328913 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.328851 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" event={"ID":"9414e13b-538a-4c81-8cd7-35263d1a174c","Type":"ContainerStarted","Data":"2ce135df0d06bb6e883f8ea789841120810ae2c3550ca13e42dea5d41c0b68d3"} Jul 02 15:00:10.330513 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.330490 2566 generic.go:356] "Generic (PLEG): container finished" podID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerID="821d0a0d4eae29b5ee69bd612adf0f15d15988b197838bb4d92396b26ddaa2a9" exitCode=0 Jul 02 15:00:10.330614 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.330596 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" event={"ID":"f1bbbcc4-217f-419f-b00c-c804ca3e478d","Type":"ContainerDied","Data":"821d0a0d4eae29b5ee69bd612adf0f15d15988b197838bb4d92396b26ddaa2a9"} Jul 02 15:00:10.330655 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.330638 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" event={"ID":"f1bbbcc4-217f-419f-b00c-c804ca3e478d","Type":"ContainerStarted","Data":"b0b1b0103259f7772eef130b6bfe0780538f7772c8be034d6f574cd7c1d691ef"} Jul 02 15:00:10.332256 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.332229 2566 generic.go:356] "Generic (PLEG): container finished" podID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerID="4479ebe9f15b94fc27f5ee9aed343ebd06c3807a924c3c0b0218ab9eacd4249f" exitCode=0 Jul 02 15:00:10.332364 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.332267 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" event={"ID":"2fefcd0a-96a7-4989-a02c-a840cee3480b","Type":"ContainerDied","Data":"4479ebe9f15b94fc27f5ee9aed343ebd06c3807a924c3c0b0218ab9eacd4249f"} Jul 02 15:00:10.332364 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:10.332297 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" event={"ID":"2fefcd0a-96a7-4989-a02c-a840cee3480b","Type":"ContainerStarted","Data":"c880544c5da53bb04bbe9f863603744228baeca034ec89e82871d30b25335d43"} Jul 02 15:00:12.344310 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.344225 2566 generic.go:356] "Generic (PLEG): container finished" podID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerID="0a4a0cc074073b309182ccdde5d33871dbaf2ec7ac160b832ebdf485e83bf679" exitCode=0 Jul 02 15:00:12.344733 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.344316 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" event={"ID":"2fefcd0a-96a7-4989-a02c-a840cee3480b","Type":"ContainerDied","Data":"0a4a0cc074073b309182ccdde5d33871dbaf2ec7ac160b832ebdf485e83bf679"} Jul 02 15:00:12.346221 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.346201 2566 generic.go:356] "Generic (PLEG): container finished" podID="78973339-8fef-481b-947e-9b6eb2702e94" containerID="77ae1f7097e21b05174fd1ccb5922d2bc5dab16075697a40e138c273a1120ed0" exitCode=0 Jul 02 15:00:12.346309 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.346282 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" event={"ID":"78973339-8fef-481b-947e-9b6eb2702e94","Type":"ContainerDied","Data":"77ae1f7097e21b05174fd1ccb5922d2bc5dab16075697a40e138c273a1120ed0"} Jul 02 15:00:12.348255 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.348233 2566 generic.go:356] "Generic (PLEG): container finished" podID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerID="564729d091b76a066de4d17ae5967ce34e42308ca4cf5512b64d8df1ec3b3878" exitCode=0 Jul 02 15:00:12.348356 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.348306 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" event={"ID":"9414e13b-538a-4c81-8cd7-35263d1a174c","Type":"ContainerDied","Data":"564729d091b76a066de4d17ae5967ce34e42308ca4cf5512b64d8df1ec3b3878"} Jul 02 15:00:12.350267 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.350243 2566 generic.go:356] "Generic (PLEG): container finished" podID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerID="e7eb2794b3293a4187176b298a00305bee9b2ad2ddd94136c1a1d9e981ce6df0" exitCode=0 Jul 02 15:00:12.350353 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.350303 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" event={"ID":"f1bbbcc4-217f-419f-b00c-c804ca3e478d","Type":"ContainerDied","Data":"e7eb2794b3293a4187176b298a00305bee9b2ad2ddd94136c1a1d9e981ce6df0"} Jul 02 15:00:12.351768 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.351754 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:12.351893 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.351878 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:12.357243 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:12.357223 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:13.357746 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.357709 2566 generic.go:356] "Generic (PLEG): container finished" podID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerID="3e68b71f63f51ae21c8913fa630ea9148072ab7f45e77afe497998d9ffc0be92" exitCode=0 Jul 02 15:00:13.358164 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.357802 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" event={"ID":"2fefcd0a-96a7-4989-a02c-a840cee3480b","Type":"ContainerDied","Data":"3e68b71f63f51ae21c8913fa630ea9148072ab7f45e77afe497998d9ffc0be92"} Jul 02 15:00:13.359718 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.359694 2566 generic.go:356] "Generic (PLEG): container finished" podID="78973339-8fef-481b-947e-9b6eb2702e94" containerID="15efc6264cfc7981fe47010c4fae378f7d089f64341d96c56fa79a69bb0453fb" exitCode=0 Jul 02 15:00:13.359782 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.359743 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" event={"ID":"78973339-8fef-481b-947e-9b6eb2702e94","Type":"ContainerDied","Data":"15efc6264cfc7981fe47010c4fae378f7d089f64341d96c56fa79a69bb0453fb"} Jul 02 15:00:13.361809 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.361784 2566 generic.go:356] "Generic (PLEG): container finished" podID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerID="501ce644fb0f462da8f1ab7038db7bc5f4d0d89d7462439c62e75d1d3ad1c6b9" exitCode=0 Jul 02 15:00:13.361946 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.361883 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" event={"ID":"9414e13b-538a-4c81-8cd7-35263d1a174c","Type":"ContainerDied","Data":"501ce644fb0f462da8f1ab7038db7bc5f4d0d89d7462439c62e75d1d3ad1c6b9"} Jul 02 15:00:13.363843 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.363820 2566 generic.go:356] "Generic (PLEG): container finished" podID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerID="8277db10ad587d2435e3389355797c7b1b10f016fef677d5764ac31790bda7a2" exitCode=0 Jul 02 15:00:13.363960 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.363899 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" event={"ID":"f1bbbcc4-217f-419f-b00c-c804ca3e478d","Type":"ContainerDied","Data":"8277db10ad587d2435e3389355797c7b1b10f016fef677d5764ac31790bda7a2"} Jul 02 15:00:13.367796 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.367778 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b967648b8-5ggp4" Jul 02 15:00:13.472094 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:13.472061 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-696df675c8-922lt"] Jul 02 15:00:14.516461 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.516436 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:14.570774 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.570750 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:14.574116 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.574094 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:14.577965 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.577949 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:14.603123 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603097 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-bundle\") pod \"2fefcd0a-96a7-4989-a02c-a840cee3480b\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " Jul 02 15:00:14.603270 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603136 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-util\") pod \"2fefcd0a-96a7-4989-a02c-a840cee3480b\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " Jul 02 15:00:14.603270 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603155 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gdcc\" (UniqueName: \"kubernetes.io/projected/2fefcd0a-96a7-4989-a02c-a840cee3480b-kube-api-access-6gdcc\") pod \"2fefcd0a-96a7-4989-a02c-a840cee3480b\" (UID: \"2fefcd0a-96a7-4989-a02c-a840cee3480b\") " Jul 02 15:00:14.603270 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603180 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6dzq\" (UniqueName: \"kubernetes.io/projected/f1bbbcc4-217f-419f-b00c-c804ca3e478d-kube-api-access-q6dzq\") pod \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " Jul 02 15:00:14.603459 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603303 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-util\") pod \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " Jul 02 15:00:14.603459 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603369 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swdpw\" (UniqueName: \"kubernetes.io/projected/78973339-8fef-481b-947e-9b6eb2702e94-kube-api-access-swdpw\") pod \"78973339-8fef-481b-947e-9b6eb2702e94\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " Jul 02 15:00:14.603459 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603436 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn7rd\" (UniqueName: \"kubernetes.io/projected/9414e13b-538a-4c81-8cd7-35263d1a174c-kube-api-access-hn7rd\") pod \"9414e13b-538a-4c81-8cd7-35263d1a174c\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " Jul 02 15:00:14.603606 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603469 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-bundle\") pod \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\" (UID: \"f1bbbcc4-217f-419f-b00c-c804ca3e478d\") " Jul 02 15:00:14.603606 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603515 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-bundle\") pod \"9414e13b-538a-4c81-8cd7-35263d1a174c\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " Jul 02 15:00:14.603606 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603564 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-util\") pod \"78973339-8fef-481b-947e-9b6eb2702e94\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " Jul 02 15:00:14.603606 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603599 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-bundle\") pod \"78973339-8fef-481b-947e-9b6eb2702e94\" (UID: \"78973339-8fef-481b-947e-9b6eb2702e94\") " Jul 02 15:00:14.603800 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.603689 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-util\") pod \"9414e13b-538a-4c81-8cd7-35263d1a174c\" (UID: \"9414e13b-538a-4c81-8cd7-35263d1a174c\") " Jul 02 15:00:14.608514 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.604603 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-bundle" (OuterVolumeSpecName: "bundle") pod "2fefcd0a-96a7-4989-a02c-a840cee3480b" (UID: "2fefcd0a-96a7-4989-a02c-a840cee3480b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:00:14.608514 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.604666 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-bundle" (OuterVolumeSpecName: "bundle") pod "9414e13b-538a-4c81-8cd7-35263d1a174c" (UID: "9414e13b-538a-4c81-8cd7-35263d1a174c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:00:14.608514 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.605373 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-bundle" (OuterVolumeSpecName: "bundle") pod "78973339-8fef-481b-947e-9b6eb2702e94" (UID: "78973339-8fef-481b-947e-9b6eb2702e94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:00:14.608514 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.606083 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-bundle" (OuterVolumeSpecName: "bundle") pod "f1bbbcc4-217f-419f-b00c-c804ca3e478d" (UID: "f1bbbcc4-217f-419f-b00c-c804ca3e478d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:00:14.608514 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.607177 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78973339-8fef-481b-947e-9b6eb2702e94-kube-api-access-swdpw" (OuterVolumeSpecName: "kube-api-access-swdpw") pod "78973339-8fef-481b-947e-9b6eb2702e94" (UID: "78973339-8fef-481b-947e-9b6eb2702e94"). InnerVolumeSpecName "kube-api-access-swdpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:00:14.608514 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.607377 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1bbbcc4-217f-419f-b00c-c804ca3e478d-kube-api-access-q6dzq" (OuterVolumeSpecName: "kube-api-access-q6dzq") pod "f1bbbcc4-217f-419f-b00c-c804ca3e478d" (UID: "f1bbbcc4-217f-419f-b00c-c804ca3e478d"). InnerVolumeSpecName "kube-api-access-q6dzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:00:14.611753 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.609441 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9414e13b-538a-4c81-8cd7-35263d1a174c-kube-api-access-hn7rd" (OuterVolumeSpecName: "kube-api-access-hn7rd") pod "9414e13b-538a-4c81-8cd7-35263d1a174c" (UID: "9414e13b-538a-4c81-8cd7-35263d1a174c"). InnerVolumeSpecName "kube-api-access-hn7rd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:00:14.611860 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.611789 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fefcd0a-96a7-4989-a02c-a840cee3480b-kube-api-access-6gdcc" (OuterVolumeSpecName: "kube-api-access-6gdcc") pod "2fefcd0a-96a7-4989-a02c-a840cee3480b" (UID: "2fefcd0a-96a7-4989-a02c-a840cee3480b"). InnerVolumeSpecName "kube-api-access-6gdcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:00:14.612475 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.612410 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-util" (OuterVolumeSpecName: "util") pod "f1bbbcc4-217f-419f-b00c-c804ca3e478d" (UID: "f1bbbcc4-217f-419f-b00c-c804ca3e478d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:00:14.613777 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.613739 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-util" (OuterVolumeSpecName: "util") pod "2fefcd0a-96a7-4989-a02c-a840cee3480b" (UID: "2fefcd0a-96a7-4989-a02c-a840cee3480b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:00:14.614079 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.614064 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-util" (OuterVolumeSpecName: "util") pod "78973339-8fef-481b-947e-9b6eb2702e94" (UID: "78973339-8fef-481b-947e-9b6eb2702e94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:00:14.656356 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.656282 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-util" (OuterVolumeSpecName: "util") pod "9414e13b-538a-4c81-8cd7-35263d1a174c" (UID: "9414e13b-538a-4c81-8cd7-35263d1a174c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:00:14.705081 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705052 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705081 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705078 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-util\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705081 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705087 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705096 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fefcd0a-96a7-4989-a02c-a840cee3480b-util\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705106 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gdcc\" (UniqueName: \"kubernetes.io/projected/2fefcd0a-96a7-4989-a02c-a840cee3480b-kube-api-access-6gdcc\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705117 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6dzq\" (UniqueName: \"kubernetes.io/projected/f1bbbcc4-217f-419f-b00c-c804ca3e478d-kube-api-access-q6dzq\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705127 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-util\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705135 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swdpw\" (UniqueName: \"kubernetes.io/projected/78973339-8fef-481b-947e-9b6eb2702e94-kube-api-access-swdpw\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705143 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn7rd\" (UniqueName: \"kubernetes.io/projected/9414e13b-538a-4c81-8cd7-35263d1a174c-kube-api-access-hn7rd\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705151 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bbbcc4-217f-419f-b00c-c804ca3e478d-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705159 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9414e13b-538a-4c81-8cd7-35263d1a174c-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:14.705265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:14.705166 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78973339-8fef-481b-947e-9b6eb2702e94-util\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:15.378393 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.378356 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" event={"ID":"f1bbbcc4-217f-419f-b00c-c804ca3e478d","Type":"ContainerDied","Data":"b0b1b0103259f7772eef130b6bfe0780538f7772c8be034d6f574cd7c1d691ef"} Jul 02 15:00:15.380012 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.378671 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0b1b0103259f7772eef130b6bfe0780538f7772c8be034d6f574cd7c1d691ef" Jul 02 15:00:15.380012 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.378809 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr" Jul 02 15:00:15.381353 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.381308 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" event={"ID":"2fefcd0a-96a7-4989-a02c-a840cee3480b","Type":"ContainerDied","Data":"c880544c5da53bb04bbe9f863603744228baeca034ec89e82871d30b25335d43"} Jul 02 15:00:15.381510 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.381373 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c880544c5da53bb04bbe9f863603744228baeca034ec89e82871d30b25335d43" Jul 02 15:00:15.381510 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.381315 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l" Jul 02 15:00:15.383358 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.383324 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" Jul 02 15:00:15.383477 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.383365 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj" event={"ID":"78973339-8fef-481b-947e-9b6eb2702e94","Type":"ContainerDied","Data":"5d9e4555637a6d7c8119e69b1438e1f924e45b2520c0d94d4dfc586f3958a4b7"} Jul 02 15:00:15.383477 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.383408 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d9e4555637a6d7c8119e69b1438e1f924e45b2520c0d94d4dfc586f3958a4b7" Jul 02 15:00:15.385620 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.385604 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" Jul 02 15:00:15.385747 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.385665 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q" event={"ID":"9414e13b-538a-4c81-8cd7-35263d1a174c","Type":"ContainerDied","Data":"2ce135df0d06bb6e883f8ea789841120810ae2c3550ca13e42dea5d41c0b68d3"} Jul 02 15:00:15.385747 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:15.385702 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ce135df0d06bb6e883f8ea789841120810ae2c3550ca13e42dea5d41c0b68d3" Jul 02 15:00:29.048822 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.048731 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7"] Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049091 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerName="pull" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049102 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerName="pull" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049114 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerName="pull" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049120 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerName="pull" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049129 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerName="util" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049134 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerName="util" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049142 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78973339-8fef-481b-947e-9b6eb2702e94" containerName="extract" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049150 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="78973339-8fef-481b-947e-9b6eb2702e94" containerName="extract" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049162 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78973339-8fef-481b-947e-9b6eb2702e94" containerName="util" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049169 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="78973339-8fef-481b-947e-9b6eb2702e94" containerName="util" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049192 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerName="util" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049199 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerName="util" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049207 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerName="util" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049212 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerName="util" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049216 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerName="pull" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049221 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerName="pull" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049227 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerName="extract" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049232 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerName="extract" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049241 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerName="extract" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049246 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerName="extract" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049254 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerName="extract" Jul 02 15:00:29.049245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049258 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerName="extract" Jul 02 15:00:29.050016 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049266 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78973339-8fef-481b-947e-9b6eb2702e94" containerName="pull" Jul 02 15:00:29.050016 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049272 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="78973339-8fef-481b-947e-9b6eb2702e94" containerName="pull" Jul 02 15:00:29.050016 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049327 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fefcd0a-96a7-4989-a02c-a840cee3480b" containerName="extract" Jul 02 15:00:29.050016 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049349 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="78973339-8fef-481b-947e-9b6eb2702e94" containerName="extract" Jul 02 15:00:29.050016 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049356 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9414e13b-538a-4c81-8cd7-35263d1a174c" containerName="extract" Jul 02 15:00:29.050016 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.049362 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1bbbcc4-217f-419f-b00c-c804ca3e478d" containerName="extract" Jul 02 15:00:29.052344 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.052316 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" Jul 02 15:00:29.054623 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.054597 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jsvz5\"" Jul 02 15:00:29.055038 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.055016 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 15:00:29.055151 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.055133 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 15:00:29.064380 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.064358 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7"] Jul 02 15:00:29.132673 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.132631 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48jzw\" (UniqueName: \"kubernetes.io/projected/ce1fdff2-e1e1-4a85-af0f-58b36beef0e2-kube-api-access-48jzw\") pod \"authorino-operator-75cc8d5cb7-t5cc7\" (UID: \"ce1fdff2-e1e1-4a85-af0f-58b36beef0e2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" Jul 02 15:00:29.234027 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.233992 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48jzw\" (UniqueName: \"kubernetes.io/projected/ce1fdff2-e1e1-4a85-af0f-58b36beef0e2-kube-api-access-48jzw\") pod \"authorino-operator-75cc8d5cb7-t5cc7\" (UID: \"ce1fdff2-e1e1-4a85-af0f-58b36beef0e2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" Jul 02 15:00:29.250456 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.250425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48jzw\" (UniqueName: \"kubernetes.io/projected/ce1fdff2-e1e1-4a85-af0f-58b36beef0e2-kube-api-access-48jzw\") pod \"authorino-operator-75cc8d5cb7-t5cc7\" (UID: \"ce1fdff2-e1e1-4a85-af0f-58b36beef0e2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" Jul 02 15:00:29.363956 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.363871 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" Jul 02 15:00:29.505511 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:29.505488 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7"] Jul 02 15:00:29.507479 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:00:29.507454 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1fdff2_e1e1_4a85_af0f_58b36beef0e2.slice/crio-3f3f61260cf0b09511b78b592e8fa7414a8713359251c699396e9dd709dbf75e WatchSource:0}: Error finding container 3f3f61260cf0b09511b78b592e8fa7414a8713359251c699396e9dd709dbf75e: Status 404 returned error can't find the container with id 3f3f61260cf0b09511b78b592e8fa7414a8713359251c699396e9dd709dbf75e Jul 02 15:00:30.468681 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:30.468644 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" event={"ID":"ce1fdff2-e1e1-4a85-af0f-58b36beef0e2","Type":"ContainerStarted","Data":"3f3f61260cf0b09511b78b592e8fa7414a8713359251c699396e9dd709dbf75e"} Jul 02 15:00:32.480817 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:32.480780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" event={"ID":"ce1fdff2-e1e1-4a85-af0f-58b36beef0e2","Type":"ContainerStarted","Data":"138c60a47ee1cca01d3dfd08cfaaad237dd805d505cb9f87fcab27104b5dd461"} Jul 02 15:00:32.481189 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:32.480932 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" Jul 02 15:00:32.498351 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:32.498284 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" podStartSLOduration=1.390359575 podStartE2EDuration="3.498268199s" totalImagesPullingTime="2.107908624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:00:32.496757511 +0000 UTC m=+726.539559942" watchObservedRunningTime="2026-07-02 15:00:32.498268199 +0000 UTC m=+726.541070677" Jul 02 15:00:38.500388 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.500298 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-696df675c8-922lt" podUID="7d55b697-c999-448d-bbe6-9031a5b0f594" containerName="console" containerID="cri-o://3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5" gracePeriod=15 Jul 02 15:00:38.757705 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.757646 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696df675c8-922lt" Jul 02 15:00:38.826282 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826250 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-serving-cert\") pod \"7d55b697-c999-448d-bbe6-9031a5b0f594\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " Jul 02 15:00:38.826465 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826361 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxhgj\" (UniqueName: \"kubernetes.io/projected/7d55b697-c999-448d-bbe6-9031a5b0f594-kube-api-access-rxhgj\") pod \"7d55b697-c999-448d-bbe6-9031a5b0f594\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " Jul 02 15:00:38.826465 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826393 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-trusted-ca-bundle\") pod \"7d55b697-c999-448d-bbe6-9031a5b0f594\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " Jul 02 15:00:38.826465 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826420 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-oauth-serving-cert\") pod \"7d55b697-c999-448d-bbe6-9031a5b0f594\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " Jul 02 15:00:38.826465 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826453 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-oauth-config\") pod \"7d55b697-c999-448d-bbe6-9031a5b0f594\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " Jul 02 15:00:38.826732 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826490 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-console-config\") pod \"7d55b697-c999-448d-bbe6-9031a5b0f594\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " Jul 02 15:00:38.826732 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826519 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-service-ca\") pod \"7d55b697-c999-448d-bbe6-9031a5b0f594\" (UID: \"7d55b697-c999-448d-bbe6-9031a5b0f594\") " Jul 02 15:00:38.826842 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826818 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d55b697-c999-448d-bbe6-9031a5b0f594" (UID: "7d55b697-c999-448d-bbe6-9031a5b0f594"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:00:38.826897 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826863 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d55b697-c999-448d-bbe6-9031a5b0f594" (UID: "7d55b697-c999-448d-bbe6-9031a5b0f594"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:00:38.827021 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.826993 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-console-config" (OuterVolumeSpecName: "console-config") pod "7d55b697-c999-448d-bbe6-9031a5b0f594" (UID: "7d55b697-c999-448d-bbe6-9031a5b0f594"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:00:38.827075 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.827056 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d55b697-c999-448d-bbe6-9031a5b0f594" (UID: "7d55b697-c999-448d-bbe6-9031a5b0f594"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:00:38.828651 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.828620 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d55b697-c999-448d-bbe6-9031a5b0f594" (UID: "7d55b697-c999-448d-bbe6-9031a5b0f594"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:00:38.829053 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.829033 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d55b697-c999-448d-bbe6-9031a5b0f594-kube-api-access-rxhgj" (OuterVolumeSpecName: "kube-api-access-rxhgj") pod "7d55b697-c999-448d-bbe6-9031a5b0f594" (UID: "7d55b697-c999-448d-bbe6-9031a5b0f594"). InnerVolumeSpecName "kube-api-access-rxhgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:00:38.829188 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.829170 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d55b697-c999-448d-bbe6-9031a5b0f594" (UID: "7d55b697-c999-448d-bbe6-9031a5b0f594"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:00:38.927884 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.927852 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-trusted-ca-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:38.927884 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.927881 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-oauth-serving-cert\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:38.927884 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.927890 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-oauth-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:38.928114 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.927899 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-console-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:38.928114 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.927908 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d55b697-c999-448d-bbe6-9031a5b0f594-service-ca\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:38.928114 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.927916 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d55b697-c999-448d-bbe6-9031a5b0f594-console-serving-cert\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:38.928114 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:38.927924 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxhgj\" (UniqueName: \"kubernetes.io/projected/7d55b697-c999-448d-bbe6-9031a5b0f594-kube-api-access-rxhgj\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:00:39.519131 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:39.519099 2566 generic.go:356] "Generic (PLEG): container finished" podID="7d55b697-c999-448d-bbe6-9031a5b0f594" containerID="3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5" exitCode=0 Jul 02 15:00:39.519535 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:39.519146 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-696df675c8-922lt" Jul 02 15:00:39.519535 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:39.519182 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696df675c8-922lt" event={"ID":"7d55b697-c999-448d-bbe6-9031a5b0f594","Type":"ContainerDied","Data":"3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5"} Jul 02 15:00:39.519535 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:39.519233 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-696df675c8-922lt" event={"ID":"7d55b697-c999-448d-bbe6-9031a5b0f594","Type":"ContainerDied","Data":"3ea9b098b67f68c6ab17b22440974d85e4fa3a536030113038f27425c870b725"} Jul 02 15:00:39.519535 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:39.519259 2566 scope.go:117] "RemoveContainer" containerID="3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5" Jul 02 15:00:39.529344 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:39.529315 2566 scope.go:117] "RemoveContainer" containerID="3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5" Jul 02 15:00:39.529610 ip-10-0-141-121 kubenswrapper[2566]: E0702 15:00:39.529592 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5\": container with ID starting with 3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5 not found: ID does not exist" containerID="3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5" Jul 02 15:00:39.529663 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:39.529618 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5"} err="failed to get container status \"3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5\": rpc error: code = NotFound desc = could not find container \"3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5\": container with ID starting with 3918b463d0778db2e07b4bd04adad39876feaa26645efc3d03c1aa1e9b411bc5 not found: ID does not exist" Jul 02 15:00:39.541073 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:39.541050 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-696df675c8-922lt"] Jul 02 15:00:39.543322 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:39.543304 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-696df675c8-922lt"] Jul 02 15:00:40.509875 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:40.509846 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d55b697-c999-448d-bbe6-9031a5b0f594" path="/var/lib/kubelet/pods/7d55b697-c999-448d-bbe6-9031a5b0f594/volumes" Jul 02 15:00:43.488674 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:43.488644 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t5cc7" Jul 02 15:00:47.971974 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:47.971940 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4"] Jul 02 15:00:47.972392 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:47.972307 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d55b697-c999-448d-bbe6-9031a5b0f594" containerName="console" Jul 02 15:00:47.972392 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:47.972319 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d55b697-c999-448d-bbe6-9031a5b0f594" containerName="console" Jul 02 15:00:47.972473 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:47.972419 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d55b697-c999-448d-bbe6-9031a5b0f594" containerName="console" Jul 02 15:00:47.976751 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:47.976730 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:00:47.979247 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:47.979225 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rrphb\"" Jul 02 15:00:47.995678 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:47.995650 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4"] Jul 02 15:00:48.113381 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:48.113316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2a4cec4-3e68-4517-ba1d-3e48f34dddf1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hxrj4\" (UID: \"d2a4cec4-3e68-4517-ba1d-3e48f34dddf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:00:48.113566 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:48.113430 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czkpp\" (UniqueName: \"kubernetes.io/projected/d2a4cec4-3e68-4517-ba1d-3e48f34dddf1-kube-api-access-czkpp\") pod \"kuadrant-operator-controller-manager-86878c769f-hxrj4\" (UID: \"d2a4cec4-3e68-4517-ba1d-3e48f34dddf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:00:48.214530 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:48.214491 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czkpp\" (UniqueName: \"kubernetes.io/projected/d2a4cec4-3e68-4517-ba1d-3e48f34dddf1-kube-api-access-czkpp\") pod \"kuadrant-operator-controller-manager-86878c769f-hxrj4\" (UID: \"d2a4cec4-3e68-4517-ba1d-3e48f34dddf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:00:48.214728 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:48.214603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2a4cec4-3e68-4517-ba1d-3e48f34dddf1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hxrj4\" (UID: \"d2a4cec4-3e68-4517-ba1d-3e48f34dddf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:00:48.214980 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:48.214959 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2a4cec4-3e68-4517-ba1d-3e48f34dddf1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hxrj4\" (UID: \"d2a4cec4-3e68-4517-ba1d-3e48f34dddf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:00:48.233462 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:48.233385 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czkpp\" (UniqueName: \"kubernetes.io/projected/d2a4cec4-3e68-4517-ba1d-3e48f34dddf1-kube-api-access-czkpp\") pod \"kuadrant-operator-controller-manager-86878c769f-hxrj4\" (UID: \"d2a4cec4-3e68-4517-ba1d-3e48f34dddf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:00:48.286386 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:48.286354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:00:48.421766 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:48.421742 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4"] Jul 02 15:00:48.423916 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:00:48.423873 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a4cec4_3e68_4517_ba1d_3e48f34dddf1.slice/crio-8eac01ca895f04f32c78ba5e825d5c5065ececb619cdc196a2b2dc6db49d6fcb WatchSource:0}: Error finding container 8eac01ca895f04f32c78ba5e825d5c5065ececb619cdc196a2b2dc6db49d6fcb: Status 404 returned error can't find the container with id 8eac01ca895f04f32c78ba5e825d5c5065ececb619cdc196a2b2dc6db49d6fcb Jul 02 15:00:48.569452 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:48.569363 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" event={"ID":"d2a4cec4-3e68-4517-ba1d-3e48f34dddf1","Type":"ContainerStarted","Data":"8eac01ca895f04f32c78ba5e825d5c5065ececb619cdc196a2b2dc6db49d6fcb"} Jul 02 15:00:54.610662 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:54.610622 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" event={"ID":"d2a4cec4-3e68-4517-ba1d-3e48f34dddf1","Type":"ContainerStarted","Data":"c8439231dcab43139c5b625eb1dff89801a205596a5e2512e2c12f7f1c1cfb8b"} Jul 02 15:00:54.611211 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:54.610719 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:00:54.634314 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:00:54.634250 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" podStartSLOduration=1.809962989 podStartE2EDuration="7.634229043s" totalImagesPullingTime="5.824266054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:00:54.631323991 +0000 UTC m=+748.674126415" watchObservedRunningTime="2026-07-02 15:00:54.634229043 +0000 UTC m=+748.677031451" Jul 02 15:01:05.618982 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:05.618952 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hxrj4" Jul 02 15:01:28.686155 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.686120 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:01:28.690678 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.690657 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:28.692768 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.692750 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zkdgw\"" Jul 02 15:01:28.692768 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.692767 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 15:01:28.697682 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.697656 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:01:28.723433 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.723404 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:01:28.784109 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.784077 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e431430c-6ec1-41bf-91f4-a225883adaef-config-file\") pod \"limitador-limitador-54d6d988d5-2tcx5\" (UID: \"e431430c-6ec1-41bf-91f4-a225883adaef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:28.784298 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.784126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8f7g\" (UniqueName: \"kubernetes.io/projected/e431430c-6ec1-41bf-91f4-a225883adaef-kube-api-access-d8f7g\") pod \"limitador-limitador-54d6d988d5-2tcx5\" (UID: \"e431430c-6ec1-41bf-91f4-a225883adaef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:28.885312 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.885275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e431430c-6ec1-41bf-91f4-a225883adaef-config-file\") pod \"limitador-limitador-54d6d988d5-2tcx5\" (UID: \"e431430c-6ec1-41bf-91f4-a225883adaef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:28.885503 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.885324 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8f7g\" (UniqueName: \"kubernetes.io/projected/e431430c-6ec1-41bf-91f4-a225883adaef-kube-api-access-d8f7g\") pod \"limitador-limitador-54d6d988d5-2tcx5\" (UID: \"e431430c-6ec1-41bf-91f4-a225883adaef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:28.885945 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.885924 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e431430c-6ec1-41bf-91f4-a225883adaef-config-file\") pod \"limitador-limitador-54d6d988d5-2tcx5\" (UID: \"e431430c-6ec1-41bf-91f4-a225883adaef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:28.893635 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:28.893616 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8f7g\" (UniqueName: \"kubernetes.io/projected/e431430c-6ec1-41bf-91f4-a225883adaef-kube-api-access-d8f7g\") pod \"limitador-limitador-54d6d988d5-2tcx5\" (UID: \"e431430c-6ec1-41bf-91f4-a225883adaef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:29.002802 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:29.002703 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:29.142317 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:29.142289 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:01:29.144664 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:01:29.144639 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode431430c_6ec1_41bf_91f4_a225883adaef.slice/crio-c9d62d5f209323ca009b7b43d3a2dfff5ade167356a55faf45d32287137ced98 WatchSource:0}: Error finding container c9d62d5f209323ca009b7b43d3a2dfff5ade167356a55faf45d32287137ced98: Status 404 returned error can't find the container with id c9d62d5f209323ca009b7b43d3a2dfff5ade167356a55faf45d32287137ced98 Jul 02 15:01:29.811572 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:29.811527 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" event={"ID":"e431430c-6ec1-41bf-91f4-a225883adaef","Type":"ContainerStarted","Data":"c9d62d5f209323ca009b7b43d3a2dfff5ade167356a55faf45d32287137ced98"} Jul 02 15:01:31.824372 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:31.824321 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" event={"ID":"e431430c-6ec1-41bf-91f4-a225883adaef","Type":"ContainerStarted","Data":"c7e33b2db5c90cb5123e8f639a6b91a3c23c537a05b2c054c90582d771f8c5fd"} Jul 02 15:01:31.824750 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:31.824401 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:31.841954 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:31.841905 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" podStartSLOduration=1.301129037 podStartE2EDuration="3.841891124s" totalImagesPullingTime="2.540762087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:01:31.840640607 +0000 UTC m=+785.883443013" watchObservedRunningTime="2026-07-02 15:01:31.841891124 +0000 UTC m=+785.884693529" Jul 02 15:01:42.831685 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:42.831651 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2tcx5" Jul 02 15:01:58.995862 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:58.995827 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66"] Jul 02 15:01:58.999546 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:58.999529 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.002098 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.002081 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 15:01:59.002181 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.002163 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-645h8\"" Jul 02 15:01:59.002290 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.002277 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 15:01:59.009036 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.009013 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66"] Jul 02 15:01:59.051915 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.051882 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.052059 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.051932 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwgzd\" (UniqueName: \"kubernetes.io/projected/247c131a-1d0f-4f68-b1ed-cbe060e6a743-kube-api-access-cwgzd\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.052059 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.051980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.152948 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.152903 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwgzd\" (UniqueName: \"kubernetes.io/projected/247c131a-1d0f-4f68-b1ed-cbe060e6a743-kube-api-access-cwgzd\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.153144 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.152963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.153144 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.153052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.153449 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.153430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.153554 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.153445 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.162178 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.162161 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwgzd\" (UniqueName: \"kubernetes.io/projected/247c131a-1d0f-4f68-b1ed-cbe060e6a743-kube-api-access-cwgzd\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.310042 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.309956 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:01:59.444214 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.444187 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66"] Jul 02 15:01:59.445617 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:01:59.445587 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247c131a_1d0f_4f68_b1ed_cbe060e6a743.slice/crio-3bedc58e761fcbe36eb7765b41e231b7267c361390de585608c3f0e2fd833c88 WatchSource:0}: Error finding container 3bedc58e761fcbe36eb7765b41e231b7267c361390de585608c3f0e2fd833c88: Status 404 returned error can't find the container with id 3bedc58e761fcbe36eb7765b41e231b7267c361390de585608c3f0e2fd833c88 Jul 02 15:01:59.975077 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.975041 2566 generic.go:356] "Generic (PLEG): container finished" podID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerID="8d799fc2edc9c80c7730fa826ceb5a73e4db64e543cc37963cb3a79de76cb4f2" exitCode=0 Jul 02 15:01:59.975250 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.975130 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" event={"ID":"247c131a-1d0f-4f68-b1ed-cbe060e6a743","Type":"ContainerDied","Data":"8d799fc2edc9c80c7730fa826ceb5a73e4db64e543cc37963cb3a79de76cb4f2"} Jul 02 15:01:59.975250 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:01:59.975178 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" event={"ID":"247c131a-1d0f-4f68-b1ed-cbe060e6a743","Type":"ContainerStarted","Data":"3bedc58e761fcbe36eb7765b41e231b7267c361390de585608c3f0e2fd833c88"} Jul 02 15:02:00.982578 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:00.982539 2566 generic.go:356] "Generic (PLEG): container finished" podID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerID="614d1b8c24b25d6ef9273d7bc3d83a835ac27b30c6091151d22fcd9806e04515" exitCode=0 Jul 02 15:02:00.982951 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:00.982598 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" event={"ID":"247c131a-1d0f-4f68-b1ed-cbe060e6a743","Type":"ContainerDied","Data":"614d1b8c24b25d6ef9273d7bc3d83a835ac27b30c6091151d22fcd9806e04515"} Jul 02 15:02:01.989835 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:01.989806 2566 generic.go:356] "Generic (PLEG): container finished" podID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerID="9e8510960af24b0413ce21995cd4e601aaef261a19b6ae1c20be848d7ac19373" exitCode=0 Jul 02 15:02:01.990244 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:01.989869 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" event={"ID":"247c131a-1d0f-4f68-b1ed-cbe060e6a743","Type":"ContainerDied","Data":"9e8510960af24b0413ce21995cd4e601aaef261a19b6ae1c20be848d7ac19373"} Jul 02 15:02:03.132610 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.132587 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:02:03.188866 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.188827 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-util\") pod \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " Jul 02 15:02:03.188866 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.188870 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-bundle\") pod \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " Jul 02 15:02:03.189121 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.188951 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwgzd\" (UniqueName: \"kubernetes.io/projected/247c131a-1d0f-4f68-b1ed-cbe060e6a743-kube-api-access-cwgzd\") pod \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\" (UID: \"247c131a-1d0f-4f68-b1ed-cbe060e6a743\") " Jul 02 15:02:03.189434 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.189401 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-bundle" (OuterVolumeSpecName: "bundle") pod "247c131a-1d0f-4f68-b1ed-cbe060e6a743" (UID: "247c131a-1d0f-4f68-b1ed-cbe060e6a743"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:02:03.191001 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.190975 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/247c131a-1d0f-4f68-b1ed-cbe060e6a743-kube-api-access-cwgzd" (OuterVolumeSpecName: "kube-api-access-cwgzd") pod "247c131a-1d0f-4f68-b1ed-cbe060e6a743" (UID: "247c131a-1d0f-4f68-b1ed-cbe060e6a743"). InnerVolumeSpecName "kube-api-access-cwgzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:02:03.197227 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.197201 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-util" (OuterVolumeSpecName: "util") pod "247c131a-1d0f-4f68-b1ed-cbe060e6a743" (UID: "247c131a-1d0f-4f68-b1ed-cbe060e6a743"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:02:03.290264 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.290160 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-util\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:02:03.290264 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.290207 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/247c131a-1d0f-4f68-b1ed-cbe060e6a743-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:02:03.290264 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:03.290219 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwgzd\" (UniqueName: \"kubernetes.io/projected/247c131a-1d0f-4f68-b1ed-cbe060e6a743-kube-api-access-cwgzd\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:02:04.002455 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:04.002427 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" Jul 02 15:02:04.002455 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:04.002443 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8brl66" event={"ID":"247c131a-1d0f-4f68-b1ed-cbe060e6a743","Type":"ContainerDied","Data":"3bedc58e761fcbe36eb7765b41e231b7267c361390de585608c3f0e2fd833c88"} Jul 02 15:02:04.002678 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:02:04.002486 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bedc58e761fcbe36eb7765b41e231b7267c361390de585608c3f0e2fd833c88" Jul 02 15:03:26.469793 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:26.469765 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 15:03:26.470728 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:26.470704 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 15:03:40.439988 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.439955 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5655f8f9fc-thk6x"] Jul 02 15:03:40.442430 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.440369 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerName="util" Jul 02 15:03:40.442430 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.440381 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerName="util" Jul 02 15:03:40.442430 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.440399 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerName="extract" Jul 02 15:03:40.442430 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.440404 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerName="extract" Jul 02 15:03:40.442430 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.440414 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerName="pull" Jul 02 15:03:40.442430 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.440421 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerName="pull" Jul 02 15:03:40.442430 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.440479 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="247c131a-1d0f-4f68-b1ed-cbe060e6a743" containerName="extract" Jul 02 15:03:40.443402 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.443387 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.445575 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.445550 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 02 15:03:40.445718 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.445702 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rvks5\"" Jul 02 15:03:40.454350 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.454312 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5655f8f9fc-thk6x"] Jul 02 15:03:40.602290 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.602244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfe60ee-7848-443c-8750-342605422f3b-openshift-service-ca\") pod \"maas-api-5655f8f9fc-thk6x\" (UID: \"2cfe60ee-7848-443c-8750-342605422f3b\") " pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.602520 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.602316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j88l\" (UniqueName: \"kubernetes.io/projected/2cfe60ee-7848-443c-8750-342605422f3b-kube-api-access-4j88l\") pod \"maas-api-5655f8f9fc-thk6x\" (UID: \"2cfe60ee-7848-443c-8750-342605422f3b\") " pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.602622 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.602592 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cfe60ee-7848-443c-8750-342605422f3b-maas-api-tls\") pod \"maas-api-5655f8f9fc-thk6x\" (UID: \"2cfe60ee-7848-443c-8750-342605422f3b\") " pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.703545 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.703439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j88l\" (UniqueName: \"kubernetes.io/projected/2cfe60ee-7848-443c-8750-342605422f3b-kube-api-access-4j88l\") pod \"maas-api-5655f8f9fc-thk6x\" (UID: \"2cfe60ee-7848-443c-8750-342605422f3b\") " pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.703545 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.703544 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cfe60ee-7848-443c-8750-342605422f3b-maas-api-tls\") pod \"maas-api-5655f8f9fc-thk6x\" (UID: \"2cfe60ee-7848-443c-8750-342605422f3b\") " pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.703736 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.703602 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfe60ee-7848-443c-8750-342605422f3b-openshift-service-ca\") pod \"maas-api-5655f8f9fc-thk6x\" (UID: \"2cfe60ee-7848-443c-8750-342605422f3b\") " pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.704306 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.704284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfe60ee-7848-443c-8750-342605422f3b-openshift-service-ca\") pod \"maas-api-5655f8f9fc-thk6x\" (UID: \"2cfe60ee-7848-443c-8750-342605422f3b\") " pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.706051 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.706028 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cfe60ee-7848-443c-8750-342605422f3b-maas-api-tls\") pod \"maas-api-5655f8f9fc-thk6x\" (UID: \"2cfe60ee-7848-443c-8750-342605422f3b\") " pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.711531 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.711510 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j88l\" (UniqueName: \"kubernetes.io/projected/2cfe60ee-7848-443c-8750-342605422f3b-kube-api-access-4j88l\") pod \"maas-api-5655f8f9fc-thk6x\" (UID: \"2cfe60ee-7848-443c-8750-342605422f3b\") " pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.754880 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.754849 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:40.902818 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.902792 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5655f8f9fc-thk6x"] Jul 02 15:03:40.904129 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:03:40.904099 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfe60ee_7848_443c_8750_342605422f3b.slice/crio-cd89b918e44f202ab9fdfaf8f854581bae422456257c5c2c9cc4955403952756 WatchSource:0}: Error finding container cd89b918e44f202ab9fdfaf8f854581bae422456257c5c2c9cc4955403952756: Status 404 returned error can't find the container with id cd89b918e44f202ab9fdfaf8f854581bae422456257c5c2c9cc4955403952756 Jul 02 15:03:40.905772 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:40.905752 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:03:41.076840 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:41.076751 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:03:41.529304 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:41.529270 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5655f8f9fc-thk6x" event={"ID":"2cfe60ee-7848-443c-8750-342605422f3b","Type":"ContainerStarted","Data":"cd89b918e44f202ab9fdfaf8f854581bae422456257c5c2c9cc4955403952756"} Jul 02 15:03:43.541933 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:43.541896 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5655f8f9fc-thk6x" event={"ID":"2cfe60ee-7848-443c-8750-342605422f3b","Type":"ContainerStarted","Data":"8412ccba64ca5a481639353e223824e7ffcf2dc37cceed125a1f069a04466ff2"} Jul 02 15:03:43.542373 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:43.542020 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:03:43.558265 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:43.558219 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5655f8f9fc-thk6x" podStartSLOduration=1.288399276 podStartE2EDuration="3.558201844s" totalImagesPullingTime="2.269802568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:03:43.557387575 +0000 UTC m=+917.600189979" watchObservedRunningTime="2026-07-02 15:03:43.558201844 +0000 UTC m=+917.601004249" Jul 02 15:03:49.553501 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:03:49.553468 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5655f8f9fc-thk6x" Jul 02 15:04:37.187083 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:37.187049 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:04:51.980522 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:51.980429 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p"] Jul 02 15:04:51.983805 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:51.983786 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:51.986151 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:51.986116 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 15:04:51.986735 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:51.986714 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xv29t\"" Jul 02 15:04:51.987064 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:51.987046 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 15:04:51.987160 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:51.987142 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 02 15:04:51.991488 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:51.991463 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p"] Jul 02 15:04:52.052811 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.052776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.052811 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.052812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grkqm\" (UniqueName: \"kubernetes.io/projected/d5701fe2-9125-4802-9914-ebc682af8560-kube-api-access-grkqm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.053027 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.052834 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.053027 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.052873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.053027 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.052922 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5701fe2-9125-4802-9914-ebc682af8560-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.053027 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.052978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.153961 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.153923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5701fe2-9125-4802-9914-ebc682af8560-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.154144 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.154012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.154144 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.154085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.154144 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.154113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grkqm\" (UniqueName: \"kubernetes.io/projected/d5701fe2-9125-4802-9914-ebc682af8560-kube-api-access-grkqm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.154319 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.154181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.154319 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.154238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.154661 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.154637 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.154661 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.154650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.154802 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.154785 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.156556 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.156537 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5701fe2-9125-4802-9914-ebc682af8560-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.156660 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.156614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5701fe2-9125-4802-9914-ebc682af8560-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.162143 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.162119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grkqm\" (UniqueName: \"kubernetes.io/projected/d5701fe2-9125-4802-9914-ebc682af8560-kube-api-access-grkqm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k7z8p\" (UID: \"d5701fe2-9125-4802-9914-ebc682af8560\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.305213 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.305126 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:04:52.444979 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.444952 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p"] Jul 02 15:04:52.446732 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:04:52.446703 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5701fe2_9125_4802_9914_ebc682af8560.slice/crio-69ea1f08d23d13c30821747f05d53e4d5aeb4f7f614f3c1fdb09f84a86323b9a WatchSource:0}: Error finding container 69ea1f08d23d13c30821747f05d53e4d5aeb4f7f614f3c1fdb09f84a86323b9a: Status 404 returned error can't find the container with id 69ea1f08d23d13c30821747f05d53e4d5aeb4f7f614f3c1fdb09f84a86323b9a Jul 02 15:04:52.787551 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.787514 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:04:52.927761 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:52.927720 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" event={"ID":"d5701fe2-9125-4802-9914-ebc682af8560","Type":"ContainerStarted","Data":"69ea1f08d23d13c30821747f05d53e4d5aeb4f7f614f3c1fdb09f84a86323b9a"} Jul 02 15:04:53.936832 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:53.936795 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" event={"ID":"d5701fe2-9125-4802-9914-ebc682af8560","Type":"ContainerStarted","Data":"c284a9f2bd1bdd13abfe47aef8097e9a949b553ae87b6ca67e965f65c97749aa"} Jul 02 15:04:53.960406 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:53.960357 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" podStartSLOduration=1.864295069 podStartE2EDuration="2.960327059s" totalImagesPullingTime="1.09603199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:04:53.958924232 +0000 UTC m=+988.001726638" watchObservedRunningTime="2026-07-02 15:04:53.960327059 +0000 UTC m=+988.003129464" Jul 02 15:04:59.486534 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:04:59.486496 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:05:02.305494 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:02.305452 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:05:02.305911 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:02.305525 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:05:02.317721 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:02.317695 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:05:02.999767 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:02.999731 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k7z8p" Jul 02 15:05:05.988693 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:05.988655 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:05:15.494434 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:15.494392 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:05:21.379625 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.379587 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx"] Jul 02 15:05:21.387301 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.387277 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.389726 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.389704 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 02 15:05:21.390450 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.390425 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx"] Jul 02 15:05:21.543346 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.543300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.543527 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.543355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.543527 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.543439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4zxs\" (UniqueName: \"kubernetes.io/projected/77a82d1a-af98-40a2-98b9-ff6bcc535816-kube-api-access-v4zxs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.543527 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.543497 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.543649 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.543557 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.543649 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.543587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77a82d1a-af98-40a2-98b9-ff6bcc535816-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.644807 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.644716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zxs\" (UniqueName: \"kubernetes.io/projected/77a82d1a-af98-40a2-98b9-ff6bcc535816-kube-api-access-v4zxs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.644807 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.644794 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.645058 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.644843 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.645058 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.644878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77a82d1a-af98-40a2-98b9-ff6bcc535816-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.645058 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.644972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.645058 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.645005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.645303 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.645279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.645389 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.645289 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.645687 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.645661 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.647389 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.647367 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77a82d1a-af98-40a2-98b9-ff6bcc535816-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.647492 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.647418 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77a82d1a-af98-40a2-98b9-ff6bcc535816-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.652045 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.652021 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4zxs\" (UniqueName: \"kubernetes.io/projected/77a82d1a-af98-40a2-98b9-ff6bcc535816-kube-api-access-v4zxs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx\" (UID: \"77a82d1a-af98-40a2-98b9-ff6bcc535816\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.698210 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.698174 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:21.836786 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:21.836759 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx"] Jul 02 15:05:21.837348 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:05:21.837312 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77a82d1a_af98_40a2_98b9_ff6bcc535816.slice/crio-e0c01ab16ec2971961b8d658021e16e7ec0ede681f18a80eaf8dd883c28ad444 WatchSource:0}: Error finding container e0c01ab16ec2971961b8d658021e16e7ec0ede681f18a80eaf8dd883c28ad444: Status 404 returned error can't find the container with id e0c01ab16ec2971961b8d658021e16e7ec0ede681f18a80eaf8dd883c28ad444 Jul 02 15:05:22.094587 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:22.094551 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" event={"ID":"77a82d1a-af98-40a2-98b9-ff6bcc535816","Type":"ContainerStarted","Data":"e0c01ab16ec2971961b8d658021e16e7ec0ede681f18a80eaf8dd883c28ad444"} Jul 02 15:05:23.102398 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:23.102363 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" event={"ID":"77a82d1a-af98-40a2-98b9-ff6bcc535816","Type":"ContainerStarted","Data":"1dd0325fd849e6d1fb25d8e2cd8c0929d58863aa788f67dcb1df84b848180b85"} Jul 02 15:05:23.120320 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:23.120270 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" podStartSLOduration=1.886338717 podStartE2EDuration="2.120253616s" totalImagesPullingTime="233.914899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:05:23.119543245 +0000 UTC m=+1017.162345651" watchObservedRunningTime="2026-07-02 15:05:23.120253616 +0000 UTC m=+1017.163056021" Jul 02 15:05:24.288111 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:24.288074 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2tcx5"] Jul 02 15:05:31.698806 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:31.698764 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:31.699236 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:31.698828 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:31.711557 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:31.711521 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:05:32.164081 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:05:32.164002 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx" Jul 02 15:07:12.683384 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:12.683344 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5655f8f9fc-thk6x_2cfe60ee-7848-443c-8750-342605422f3b/maas-api/0.log" Jul 02 15:07:13.271720 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:13.271696 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-dn5gl_a5296b66-ff86-4ea1-9046-c9a9b1d5c722/copy-manifests/0.log" Jul 02 15:07:13.278798 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:13.278777 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-dn5gl_a5296b66-ff86-4ea1-9046-c9a9b1d5c722/manager/0.log" Jul 02 15:07:14.277477 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.277449 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr_f1bbbcc4-217f-419f-b00c-c804ca3e478d/util/0.log" Jul 02 15:07:14.286820 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.286783 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr_f1bbbcc4-217f-419f-b00c-c804ca3e478d/pull/0.log" Jul 02 15:07:14.293071 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.293049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr_f1bbbcc4-217f-419f-b00c-c804ca3e478d/extract/0.log" Jul 02 15:07:14.410297 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.410270 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q_9414e13b-538a-4c81-8cd7-35263d1a174c/util/0.log" Jul 02 15:07:14.417089 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.417072 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q_9414e13b-538a-4c81-8cd7-35263d1a174c/pull/0.log" Jul 02 15:07:14.423990 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.423968 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q_9414e13b-538a-4c81-8cd7-35263d1a174c/extract/0.log" Jul 02 15:07:14.531240 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.531161 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj_78973339-8fef-481b-947e-9b6eb2702e94/util/0.log" Jul 02 15:07:14.536711 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.536697 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj_78973339-8fef-481b-947e-9b6eb2702e94/pull/0.log" Jul 02 15:07:14.542296 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.542270 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj_78973339-8fef-481b-947e-9b6eb2702e94/extract/0.log" Jul 02 15:07:14.651057 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.651026 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l_2fefcd0a-96a7-4989-a02c-a840cee3480b/extract/0.log" Jul 02 15:07:14.657307 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.657285 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l_2fefcd0a-96a7-4989-a02c-a840cee3480b/util/0.log" Jul 02 15:07:14.663768 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.663753 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l_2fefcd0a-96a7-4989-a02c-a840cee3480b/pull/0.log" Jul 02 15:07:14.896311 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:14.896236 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t5cc7_ce1fdff2-e1e1-4a85-af0f-58b36beef0e2/manager/0.log" Jul 02 15:07:15.372376 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:15.372342 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hxrj4_d2a4cec4-3e68-4517-ba1d-3e48f34dddf1/manager/0.log" Jul 02 15:07:15.514869 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:15.514842 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2tcx5_e431430c-6ec1-41bf-91f4-a225883adaef/limitador/0.log" Jul 02 15:07:15.966542 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:15.966516 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mn4bs_7146e73f-eb48-4b7b-8714-2c0a6a74fff4/istio-proxy/0.log" Jul 02 15:07:16.086798 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:16.086764 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-69fnd_ddf28c64-c97a-4161-aa91-660d03835fe7/discovery/0.log" Jul 02 15:07:16.196618 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:16.196583 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b948f4-75rzx_60c52977-77f6-451d-a1d4-26955da7314d/kube-auth-proxy/0.log" Jul 02 15:07:16.773138 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:16.773108 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d8647c49-lrt7h_86d096b5-cb22-4fc8-8417-382bc87322c6/router/0.log" Jul 02 15:07:17.216461 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:17.216416 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-k7z8p_d5701fe2-9125-4802-9914-ebc682af8560/main/0.log" Jul 02 15:07:17.673969 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:17.673890 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-r7lbx_77a82d1a-af98-40a2-98b9-ff6bcc535816/main/0.log" Jul 02 15:07:21.494364 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.494315 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t4j7n/must-gather-4jhg7"] Jul 02 15:07:21.498209 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.498184 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4j7n/must-gather-4jhg7" Jul 02 15:07:21.500246 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.500225 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4j7n\"/\"openshift-service-ca.crt\"" Jul 02 15:07:21.500420 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.500383 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4j7n\"/\"kube-root-ca.crt\"" Jul 02 15:07:21.500420 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.500409 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t4j7n\"/\"default-dockercfg-fj28k\"" Jul 02 15:07:21.504759 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.504736 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4j7n/must-gather-4jhg7"] Jul 02 15:07:21.601548 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.601515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3aa13b71-49c9-4e89-a118-a9b0d937b032-must-gather-output\") pod \"must-gather-4jhg7\" (UID: \"3aa13b71-49c9-4e89-a118-a9b0d937b032\") " pod="openshift-must-gather-t4j7n/must-gather-4jhg7" Jul 02 15:07:21.601819 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.601793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swsb9\" (UniqueName: \"kubernetes.io/projected/3aa13b71-49c9-4e89-a118-a9b0d937b032-kube-api-access-swsb9\") pod \"must-gather-4jhg7\" (UID: \"3aa13b71-49c9-4e89-a118-a9b0d937b032\") " pod="openshift-must-gather-t4j7n/must-gather-4jhg7" Jul 02 15:07:21.702673 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.702644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swsb9\" (UniqueName: \"kubernetes.io/projected/3aa13b71-49c9-4e89-a118-a9b0d937b032-kube-api-access-swsb9\") pod \"must-gather-4jhg7\" (UID: \"3aa13b71-49c9-4e89-a118-a9b0d937b032\") " pod="openshift-must-gather-t4j7n/must-gather-4jhg7" Jul 02 15:07:21.702855 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.702697 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3aa13b71-49c9-4e89-a118-a9b0d937b032-must-gather-output\") pod \"must-gather-4jhg7\" (UID: \"3aa13b71-49c9-4e89-a118-a9b0d937b032\") " pod="openshift-must-gather-t4j7n/must-gather-4jhg7" Jul 02 15:07:21.703068 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.703049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3aa13b71-49c9-4e89-a118-a9b0d937b032-must-gather-output\") pod \"must-gather-4jhg7\" (UID: \"3aa13b71-49c9-4e89-a118-a9b0d937b032\") " pod="openshift-must-gather-t4j7n/must-gather-4jhg7" Jul 02 15:07:21.732115 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.732091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swsb9\" (UniqueName: \"kubernetes.io/projected/3aa13b71-49c9-4e89-a118-a9b0d937b032-kube-api-access-swsb9\") pod \"must-gather-4jhg7\" (UID: \"3aa13b71-49c9-4e89-a118-a9b0d937b032\") " pod="openshift-must-gather-t4j7n/must-gather-4jhg7" Jul 02 15:07:21.809815 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.809716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4j7n/must-gather-4jhg7" Jul 02 15:07:21.952281 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:21.952255 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4j7n/must-gather-4jhg7"] Jul 02 15:07:21.954046 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:07:21.954015 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3aa13b71_49c9_4e89_a118_a9b0d937b032.slice/crio-f54a08f4e7610bb8ac67837d123c98261f8799d8be5be3d1589d0da6ef4a8f3c WatchSource:0}: Error finding container f54a08f4e7610bb8ac67837d123c98261f8799d8be5be3d1589d0da6ef4a8f3c: Status 404 returned error can't find the container with id f54a08f4e7610bb8ac67837d123c98261f8799d8be5be3d1589d0da6ef4a8f3c Jul 02 15:07:22.758505 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:22.758467 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4j7n/must-gather-4jhg7" event={"ID":"3aa13b71-49c9-4e89-a118-a9b0d937b032","Type":"ContainerStarted","Data":"f54a08f4e7610bb8ac67837d123c98261f8799d8be5be3d1589d0da6ef4a8f3c"} Jul 02 15:07:23.768494 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:23.768454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4j7n/must-gather-4jhg7" event={"ID":"3aa13b71-49c9-4e89-a118-a9b0d937b032","Type":"ContainerStarted","Data":"b43aa234860cdcb9f8177f346cfb83a444e28af8cc5d9da917f573f02292b56f"} Jul 02 15:07:23.768950 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:23.768510 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4j7n/must-gather-4jhg7" event={"ID":"3aa13b71-49c9-4e89-a118-a9b0d937b032","Type":"ContainerStarted","Data":"67793a742750eb77eb8bb2fd219735c69529be625dcfb8c23a6bcd0d3b9b9596"} Jul 02 15:07:23.789522 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:23.789457 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t4j7n/must-gather-4jhg7" podStartSLOduration=1.9155132849999998 podStartE2EDuration="2.789435269s" totalImagesPullingTime="873.921984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:07:23.785110221 +0000 UTC m=+1137.827912627" watchObservedRunningTime="2026-07-02 15:07:23.789435269 +0000 UTC m=+1137.832237676" Jul 02 15:07:24.532009 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:24.531977 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k5c5h_a430c8b7-7624-4e58-8631-35e012585f01/global-pull-secret-syncer/0.log" Jul 02 15:07:24.638054 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:24.638026 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rcc5v_6553e047-9e28-4ea2-92bc-9110169bb3f5/konnectivity-agent/0.log" Jul 02 15:07:24.705289 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:24.705258 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-121.ec2.internal_ff8112a09a92e79e1fba8f9541e6f8d7/haproxy/0.log" Jul 02 15:07:29.651741 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.651643 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr_f1bbbcc4-217f-419f-b00c-c804ca3e478d/extract/0.log" Jul 02 15:07:29.677169 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.677136 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr_f1bbbcc4-217f-419f-b00c-c804ca3e478d/util/0.log" Jul 02 15:07:29.700470 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.700436 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759w89wr_f1bbbcc4-217f-419f-b00c-c804ca3e478d/pull/0.log" Jul 02 15:07:29.729260 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.729226 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q_9414e13b-538a-4c81-8cd7-35263d1a174c/extract/0.log" Jul 02 15:07:29.762086 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.761959 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q_9414e13b-538a-4c81-8cd7-35263d1a174c/util/0.log" Jul 02 15:07:29.781151 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.781080 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dt9q_9414e13b-538a-4c81-8cd7-35263d1a174c/pull/0.log" Jul 02 15:07:29.817037 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.817003 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj_78973339-8fef-481b-947e-9b6eb2702e94/extract/0.log" Jul 02 15:07:29.841869 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.841801 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj_78973339-8fef-481b-947e-9b6eb2702e94/util/0.log" Jul 02 15:07:29.863125 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.863094 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n6kkj_78973339-8fef-481b-947e-9b6eb2702e94/pull/0.log" Jul 02 15:07:29.892019 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.891992 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l_2fefcd0a-96a7-4989-a02c-a840cee3480b/extract/0.log" Jul 02 15:07:29.913126 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.913049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l_2fefcd0a-96a7-4989-a02c-a840cee3480b/util/0.log" Jul 02 15:07:29.940262 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:29.940220 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzd6l_2fefcd0a-96a7-4989-a02c-a840cee3480b/pull/0.log" Jul 02 15:07:30.034457 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:30.034311 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t5cc7_ce1fdff2-e1e1-4a85-af0f-58b36beef0e2/manager/0.log" Jul 02 15:07:30.164839 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:30.164740 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hxrj4_d2a4cec4-3e68-4517-ba1d-3e48f34dddf1/manager/0.log" Jul 02 15:07:30.195713 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:30.195618 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2tcx5_e431430c-6ec1-41bf-91f4-a225883adaef/limitador/0.log" Jul 02 15:07:31.935076 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:31.934993 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_acc94b4c-305b-487d-b17d-fb9a77665bdc/alertmanager/0.log" Jul 02 15:07:31.966314 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:31.966253 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_acc94b4c-305b-487d-b17d-fb9a77665bdc/config-reloader/0.log" Jul 02 15:07:32.000054 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:32.000029 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_acc94b4c-305b-487d-b17d-fb9a77665bdc/kube-rbac-proxy-web/0.log" Jul 02 15:07:32.029612 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:32.029581 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_acc94b4c-305b-487d-b17d-fb9a77665bdc/kube-rbac-proxy/0.log" Jul 02 15:07:32.064543 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:32.064515 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_acc94b4c-305b-487d-b17d-fb9a77665bdc/kube-rbac-proxy-metric/0.log" Jul 02 15:07:32.096748 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:32.096709 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_acc94b4c-305b-487d-b17d-fb9a77665bdc/prom-label-proxy/0.log" Jul 02 15:07:32.129454 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:32.129424 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_acc94b4c-305b-487d-b17d-fb9a77665bdc/init-config-reloader/0.log" Jul 02 15:07:32.182683 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:32.182642 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-kv6nm_e21a9e03-ccfb-4ede-9c2b-2cbf8815712f/cluster-monitoring-operator/0.log" Jul 02 15:07:32.529789 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:32.529763 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntqtq_94ba87b5-14c2-4609-9d55-6d64c035314b/node-exporter/0.log" Jul 02 15:07:32.558799 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:32.558774 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntqtq_94ba87b5-14c2-4609-9d55-6d64c035314b/kube-rbac-proxy/0.log" Jul 02 15:07:32.581245 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:32.581219 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntqtq_94ba87b5-14c2-4609-9d55-6d64c035314b/init-textfile/0.log" Jul 02 15:07:33.024406 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:33.024371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d6785fb7c-2zbb5_835a9847-c4f2-493d-b834-53a23b3dadda/telemeter-client/0.log" Jul 02 15:07:33.077085 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:33.077011 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d6785fb7c-2zbb5_835a9847-c4f2-493d-b834-53a23b3dadda/reload/0.log" Jul 02 15:07:33.137089 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:33.137058 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d6785fb7c-2zbb5_835a9847-c4f2-493d-b834-53a23b3dadda/kube-rbac-proxy/0.log" Jul 02 15:07:33.189257 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:33.189232 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7869d4594c-p8fvm_181d92f3-861f-455a-8e76-12bf30663c11/thanos-query/0.log" Jul 02 15:07:33.212061 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:33.212034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7869d4594c-p8fvm_181d92f3-861f-455a-8e76-12bf30663c11/kube-rbac-proxy-web/0.log" Jul 02 15:07:33.234024 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:33.233994 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7869d4594c-p8fvm_181d92f3-861f-455a-8e76-12bf30663c11/kube-rbac-proxy/0.log" Jul 02 15:07:33.255047 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:33.255022 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7869d4594c-p8fvm_181d92f3-861f-455a-8e76-12bf30663c11/prom-label-proxy/0.log" Jul 02 15:07:33.278738 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:33.278651 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7869d4594c-p8fvm_181d92f3-861f-455a-8e76-12bf30663c11/kube-rbac-proxy-rules/0.log" Jul 02 15:07:33.305427 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:33.305397 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7869d4594c-p8fvm_181d92f3-861f-455a-8e76-12bf30663c11/kube-rbac-proxy-metrics/0.log" Jul 02 15:07:34.390585 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.390552 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42"] Jul 02 15:07:34.396211 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.396179 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.402031 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.401999 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42"] Jul 02 15:07:34.453387 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.453314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-proc\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.453589 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.453411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-lib-modules\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.453589 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.453475 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-podres\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.453589 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.453543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-sys\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.453773 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.453592 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kmkn\" (UniqueName: \"kubernetes.io/projected/b4e26b5a-963e-41e5-919f-6b3e282b4061-kube-api-access-2kmkn\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.554594 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.554562 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-proc\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.554777 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.554619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-lib-modules\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.554777 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.554687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-podres\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.554777 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.554762 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-sys\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.554944 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.554807 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kmkn\" (UniqueName: \"kubernetes.io/projected/b4e26b5a-963e-41e5-919f-6b3e282b4061-kube-api-access-2kmkn\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.555196 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.555169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-proc\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.555347 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.555176 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-sys\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.555347 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.555263 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-podres\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.555347 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.555266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4e26b5a-963e-41e5-919f-6b3e282b4061-lib-modules\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.563658 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.563618 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kmkn\" (UniqueName: \"kubernetes.io/projected/b4e26b5a-963e-41e5-919f-6b3e282b4061-kube-api-access-2kmkn\") pod \"perf-node-gather-daemonset-4np42\" (UID: \"b4e26b5a-963e-41e5-919f-6b3e282b4061\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.711898 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.711855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:34.910079 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:34.910046 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42"] Jul 02 15:07:34.912725 ip-10-0-141-121 kubenswrapper[2566]: W0702 15:07:34.912689 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb4e26b5a_963e_41e5_919f_6b3e282b4061.slice/crio-3b49eb3ac37c903a9182268dc54d32b6585239d836f6dbb1117d32d03c65361e WatchSource:0}: Error finding container 3b49eb3ac37c903a9182268dc54d32b6585239d836f6dbb1117d32d03c65361e: Status 404 returned error can't find the container with id 3b49eb3ac37c903a9182268dc54d32b6585239d836f6dbb1117d32d03c65361e Jul 02 15:07:35.123443 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:35.123413 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/2.log" Jul 02 15:07:35.130173 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:35.130145 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-b6mdd_baa7b16f-3062-47ee-87b9-b17060a67326/console-operator/3.log" Jul 02 15:07:35.605578 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:35.605547 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b967648b8-5ggp4_ec2210dc-6b49-4dba-94b3-5c36bd2a0ef7/console/0.log" Jul 02 15:07:35.635975 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:35.635946 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-k7jq5_63798f4a-7862-4095-8fb8-0cc9d69f404d/download-server/0.log" Jul 02 15:07:35.892944 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:35.892853 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" event={"ID":"b4e26b5a-963e-41e5-919f-6b3e282b4061","Type":"ContainerStarted","Data":"83c5308ebc3476de4af1a9a5fd12c9ac7ec917a10c297b127e7a80429577def4"} Jul 02 15:07:35.892944 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:35.892911 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" event={"ID":"b4e26b5a-963e-41e5-919f-6b3e282b4061","Type":"ContainerStarted","Data":"3b49eb3ac37c903a9182268dc54d32b6585239d836f6dbb1117d32d03c65361e"} Jul 02 15:07:35.893147 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:35.892946 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:35.911115 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:35.911062 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" podStartSLOduration=1.911045399 podStartE2EDuration="1.911045399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:07:35.908759586 +0000 UTC m=+1149.951561993" watchObservedRunningTime="2026-07-02 15:07:35.911045399 +0000 UTC m=+1149.953847802" Jul 02 15:07:37.256561 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:37.256533 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tbbf_6fca010e-0df5-4240-bcbd-cac7e7702982/dns/0.log" Jul 02 15:07:37.280328 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:37.280302 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tbbf_6fca010e-0df5-4240-bcbd-cac7e7702982/kube-rbac-proxy/0.log" Jul 02 15:07:37.395075 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:37.395047 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-42pcg_d165d31f-741f-45c7-822c-752f0af54a09/dns-node-resolver/0.log" Jul 02 15:07:37.988047 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:37.988017 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59b8c87646-zrqs7_f737c4ee-31dc-4f11-8799-3cdc5381f035/registry/0.log" Jul 02 15:07:38.008907 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:38.008881 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-52d67_7b452d0c-4883-462b-828f-daf3e42d7c08/node-ca/0.log" Jul 02 15:07:38.995116 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:38.995081 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mn4bs_7146e73f-eb48-4b7b-8714-2c0a6a74fff4/istio-proxy/0.log" Jul 02 15:07:39.049436 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:39.049405 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-69fnd_ddf28c64-c97a-4161-aa91-660d03835fe7/discovery/0.log" Jul 02 15:07:39.067906 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:39.067872 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b948f4-75rzx_60c52977-77f6-451d-a1d4-26955da7314d/kube-auth-proxy/0.log" Jul 02 15:07:39.191926 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:39.191894 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d8647c49-lrt7h_86d096b5-cb22-4fc8-8417-382bc87322c6/router/0.log" Jul 02 15:07:39.867547 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:39.867522 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tx475_df366d57-a34a-4207-96fd-1d9555173e23/serve-healthcheck-canary/0.log" Jul 02 15:07:40.533951 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:40.533919 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6dtf_45f46634-ecde-4774-87d0-8112f0a396c7/kube-rbac-proxy/0.log" Jul 02 15:07:40.567960 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:40.567932 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6dtf_45f46634-ecde-4774-87d0-8112f0a396c7/exporter/0.log" Jul 02 15:07:40.593126 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:40.593096 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6dtf_45f46634-ecde-4774-87d0-8112f0a396c7/extractor/0.log" Jul 02 15:07:41.912604 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:41.912573 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-4np42" Jul 02 15:07:42.868493 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:42.868443 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5655f8f9fc-thk6x_2cfe60ee-7848-443c-8750-342605422f3b/maas-api/0.log" Jul 02 15:07:43.086795 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:43.086758 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-dn5gl_a5296b66-ff86-4ea1-9046-c9a9b1d5c722/manager/0.log" Jul 02 15:07:43.107792 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:43.107767 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-dn5gl_a5296b66-ff86-4ea1-9046-c9a9b1d5c722/copy-manifests/0.log" Jul 02 15:07:45.428295 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:45.428253 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mn4bs_7146e73f-eb48-4b7b-8714-2c0a6a74fff4/istio-proxy/0.log" Jul 02 15:07:45.483759 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:45.483729 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-69fnd_ddf28c64-c97a-4161-aa91-660d03835fe7/discovery/0.log" Jul 02 15:07:45.495285 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:45.495256 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b948f4-75rzx_60c52977-77f6-451d-a1d4-26955da7314d/kube-auth-proxy/0.log" Jul 02 15:07:45.575726 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:45.575699 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d8647c49-lrt7h_86d096b5-cb22-4fc8-8417-382bc87322c6/router/0.log" Jul 02 15:07:46.674485 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:46.674456 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mn4bs_7146e73f-eb48-4b7b-8714-2c0a6a74fff4/istio-proxy/0.log" Jul 02 15:07:46.720118 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:46.720092 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-69fnd_ddf28c64-c97a-4161-aa91-660d03835fe7/discovery/0.log" Jul 02 15:07:46.730160 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:46.730136 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b948f4-75rzx_60c52977-77f6-451d-a1d4-26955da7314d/kube-auth-proxy/0.log" Jul 02 15:07:46.806428 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:46.806324 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d8647c49-lrt7h_86d096b5-cb22-4fc8-8417-382bc87322c6/router/0.log" Jul 02 15:07:50.229491 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:50.229422 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-d9x4w_4368dc51-7877-4af3-9623-a28c0d6d3a9d/kube-storage-version-migrator-operator/1.log" Jul 02 15:07:50.230487 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:50.230471 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-d9x4w_4368dc51-7877-4af3-9623-a28c0d6d3a9d/kube-storage-version-migrator-operator/0.log" Jul 02 15:07:51.402018 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.401989 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbjsw_df2cf761-aad7-44b7-8161-2d5fb4811a4b/kube-multus-additional-cni-plugins/0.log" Jul 02 15:07:51.422753 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.422729 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbjsw_df2cf761-aad7-44b7-8161-2d5fb4811a4b/egress-router-binary-copy/0.log" Jul 02 15:07:51.448277 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.448250 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbjsw_df2cf761-aad7-44b7-8161-2d5fb4811a4b/cni-plugins/0.log" Jul 02 15:07:51.470161 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.470130 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbjsw_df2cf761-aad7-44b7-8161-2d5fb4811a4b/bond-cni-plugin/0.log" Jul 02 15:07:51.491112 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.491077 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbjsw_df2cf761-aad7-44b7-8161-2d5fb4811a4b/routeoverride-cni/0.log" Jul 02 15:07:51.514239 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.514214 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbjsw_df2cf761-aad7-44b7-8161-2d5fb4811a4b/whereabouts-cni-bincopy/0.log" Jul 02 15:07:51.535732 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.535707 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbjsw_df2cf761-aad7-44b7-8161-2d5fb4811a4b/whereabouts-cni/0.log" Jul 02 15:07:51.725383 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.725355 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jc929_d262182d-2ff7-4c24-93ee-257f5dc28cb4/kube-multus/0.log" Jul 02 15:07:51.782648 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.782620 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dtbhn_ed7db27e-fa51-4c39-83b3-747609b46f63/network-metrics-daemon/0.log" Jul 02 15:07:51.804620 ip-10-0-141-121 kubenswrapper[2566]: I0702 15:07:51.804592 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dtbhn_ed7db27e-fa51-4c39-83b3-747609b46f63/kube-rbac-proxy/0.log"