Jul 14 15:08:37.866764 ip-10-0-140-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 15:08:37.866777 ip-10-0-140-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 15:08:37.866786 ip-10-0-140-4 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 15:08:37.867103 ip-10-0-140-4 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 15:08:47.877627 ip-10-0-140-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 15:08:47.877646 ip-10-0-140-4 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 13f7044e85cd47cda4b7c882f02c86f8 -- Jul 14 15:10:44.596765 ip-10-0-140-4 systemd[1]: Starting Kubernetes Kubelet... Jul 14 15:10:44.901852 ip-10-0-140-4 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 15:10:44.901852 ip-10-0-140-4 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 15:10:44.901852 ip-10-0-140-4 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 15:10:44.901852 ip-10-0-140-4 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 15:10:44.901852 ip-10-0-140-4 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 15:10:44.901852 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.900373 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906105 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906119 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906123 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906126 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906129 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906132 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906135 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906137 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906140 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906142 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906145 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906148 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906151 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906154 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906157 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906160 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906163 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906165 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906169 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:44.917760 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906176 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906179 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906182 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906185 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906188 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906191 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906194 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906197 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906199 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906202 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906205 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906207 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906210 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906212 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906215 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906218 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906220 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906223 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906225 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:44.919401 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906228 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906230 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906233 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906236 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906238 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906241 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906244 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906246 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906249 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906251 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906254 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906256 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906260 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906262 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906265 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906267 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906270 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906273 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906275 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906278 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:44.921700 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906280 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906283 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906286 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906288 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906292 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906294 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906297 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906299 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906302 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906305 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906309 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906312 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906315 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906317 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906320 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906323 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906325 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906328 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906331 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:44.923766 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906333 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906336 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906338 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906341 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906343 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906346 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906349 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906352 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906354 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906357 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906361 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906364 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906366 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906369 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906372 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906376 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906380 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906383 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906386 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906389 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:44.925953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906392 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.906395 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907090 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907097 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907100 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907103 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907106 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907108 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907111 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907114 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907117 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907119 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907122 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907125 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907127 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907130 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907133 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907135 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907138 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907143 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:44.926775 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907147 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907151 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907155 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907158 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907160 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907163 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907166 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907169 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907171 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907174 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907177 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907180 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907183 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907186 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907189 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907192 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907194 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907197 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907199 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:44.928551 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907202 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907204 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907207 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907209 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907212 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907214 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907217 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907219 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907222 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907225 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907228 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907230 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907233 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907236 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907238 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907241 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907243 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907246 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907249 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:44.930869 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907251 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907254 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907256 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907259 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907261 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907264 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907266 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907269 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907272 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907274 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907277 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907279 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907284 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907289 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907292 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907294 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907298 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907300 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907303 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907306 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:44.931471 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907309 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907311 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907314 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907316 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907320 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907324 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907327 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907330 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907333 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907336 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907338 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907341 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907343 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907346 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907348 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907351 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907353 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907356 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907358 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907361 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:44.936748 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907363 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907365 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907368 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907736 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907741 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907746 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907749 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907752 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907754 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907757 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907759 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907763 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907767 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907770 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907772 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907775 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907778 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907780 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907784 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:44.937749 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907787 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907790 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907793 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907796 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907798 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907801 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907803 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907806 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907808 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907811 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907813 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907816 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907818 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907821 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907823 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907826 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907829 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907831 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907837 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907839 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:44.938563 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907842 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907845 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907847 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907851 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907853 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907856 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907860 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907863 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907866 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907869 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907872 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907875 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907877 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907880 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907883 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907886 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907888 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907891 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907893 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:45.063776 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907895 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:44.967612 ip-10-0-140-4 systemd[1]: Started Kubernetes Kubelet. Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907898 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907900 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907903 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907905 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907910 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907913 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907916 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907919 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907921 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907924 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907928 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907931 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907933 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907936 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907938 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907941 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907943 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907946 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907948 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:45.064629 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907951 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907953 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907956 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907958 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907961 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907963 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907966 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907969 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907971 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907973 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907976 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907978 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907981 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907983 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907986 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907988 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907991 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907993 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907996 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.907998 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:45.065606 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908000 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908003 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908005 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908010 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908077 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908084 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908089 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908094 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908098 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908101 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908105 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908109 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908112 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908115 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908119 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908122 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908125 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908128 2583 flags.go:64] FLAG: --cgroup-root="" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908131 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908135 2583 flags.go:64] FLAG: --client-ca-file="" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908138 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908141 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908146 2583 flags.go:64] FLAG: --cluster-domain="" Jul 14 15:10:45.066205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908149 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908152 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908155 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908159 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908162 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908166 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908169 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908172 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908175 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908178 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908181 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908184 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908189 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908193 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908196 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908199 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908202 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908205 2583 flags.go:64] FLAG: --enable-server="true" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908208 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908212 2583 flags.go:64] FLAG: --event-burst="100" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908215 2583 flags.go:64] FLAG: --event-qps="50" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908218 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908220 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908223 2583 flags.go:64] FLAG: --eviction-hard="" Jul 14 15:10:45.066903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908236 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908240 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908243 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908246 2583 flags.go:64] FLAG: --eviction-soft="" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908249 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908251 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908263 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908266 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908269 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908272 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908274 2583 flags.go:64] FLAG: --feature-gates="" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908282 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908285 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908288 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908291 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908294 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908297 2583 flags.go:64] FLAG: --help="false" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908300 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908303 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908305 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908312 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908315 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908319 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908322 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 15:10:45.067607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908325 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908327 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908330 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908333 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908336 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908339 2583 flags.go:64] FLAG: --kube-reserved="" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908342 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908345 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908348 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908351 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908354 2583 flags.go:64] FLAG: --lock-file="" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908356 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908359 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908362 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908367 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908370 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908373 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908376 2583 flags.go:64] FLAG: --logging-format="text" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908379 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908382 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908385 2583 flags.go:64] FLAG: --manifest-url="" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908388 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908392 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908394 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908398 2583 flags.go:64] FLAG: --max-pods="110" Jul 14 15:10:45.068389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908401 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908404 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908407 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908412 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908415 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908418 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908421 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908430 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908433 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908436 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908439 2583 flags.go:64] FLAG: --pod-cidr="" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908442 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908446 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908449 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908452 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908455 2583 flags.go:64] FLAG: --port="10250" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908458 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908461 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0781d14d22e98e783" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908464 2583 flags.go:64] FLAG: --qos-reserved="" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908467 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908470 2583 flags.go:64] FLAG: --register-node="true" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908473 2583 flags.go:64] FLAG: --register-with-taints="" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908476 2583 flags.go:64] FLAG: --registry-burst="10" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908479 2583 flags.go:64] FLAG: --registry-qps="5" Jul 14 15:10:45.070320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908482 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908485 2583 flags.go:64] FLAG: --reserved-memory="" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908488 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908491 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908494 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908514 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908518 2583 flags.go:64] FLAG: --runonce="false" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908520 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908524 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908527 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908530 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908534 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908539 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908542 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908544 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908547 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908550 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908553 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908556 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908559 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908562 2583 flags.go:64] FLAG: --system-cgroups="" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908564 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908570 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908573 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908575 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 15:10:45.093523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908580 2583 flags.go:64] FLAG: --tls-min-version="" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908583 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908586 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908589 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908591 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908594 2583 flags.go:64] FLAG: --v="2" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908598 2583 flags.go:64] FLAG: --version="false" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908602 2583 flags.go:64] FLAG: --vmodule="" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908606 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.908609 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908715 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908719 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908721 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908726 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908730 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908733 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908736 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908739 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908744 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908748 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908751 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:45.094478 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908754 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908756 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908759 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908762 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908764 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908767 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908770 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908772 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908775 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908777 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908781 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908784 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908787 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908790 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908792 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908795 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908797 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908799 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908802 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908805 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:45.095262 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908808 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908810 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908813 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908816 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908818 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908821 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908824 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908826 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908829 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908833 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908838 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908842 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908846 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908850 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908854 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908859 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908863 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908866 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908868 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:45.095871 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908871 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908874 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908876 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908879 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908881 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908884 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908887 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908889 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908892 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908894 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908897 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908899 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908902 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908905 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908908 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908910 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908913 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908915 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908918 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908920 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:45.096512 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908923 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908925 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908929 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908933 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908936 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908938 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908941 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908944 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908947 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908949 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908952 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908955 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908957 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908960 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908962 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908965 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908968 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908970 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908972 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908975 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:45.097288 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908977 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908980 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908983 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908985 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908988 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908992 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908995 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.908998 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.909001 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.909663 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.916320 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.916341 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.916363 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.916371 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 15:10:45.097914 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916451 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916457 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916464 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916468 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916472 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916477 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916481 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916485 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916488 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916492 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916509 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916514 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916518 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916522 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916526 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916531 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916534 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916538 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916542 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916545 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:45.098307 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916552 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916556 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916562 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916567 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916571 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916576 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916580 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916584 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916589 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916601 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916605 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916609 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916615 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916619 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916624 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916627 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916631 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916635 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916639 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916643 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:45.098899 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916646 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916650 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916654 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916657 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916661 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916664 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916668 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916672 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916675 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916679 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916683 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916686 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916690 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916693 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916697 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916700 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916704 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916707 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916711 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916714 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:45.099739 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916718 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916722 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916734 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916740 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916745 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916749 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916755 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916759 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916764 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916767 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916771 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916775 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916778 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916782 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916785 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916789 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916793 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916796 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916800 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:45.100332 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916804 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916807 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916811 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916815 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916818 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916822 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916826 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916829 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916833 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916836 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916840 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916844 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916848 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916852 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916856 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916860 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916872 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916877 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916881 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:45.248455 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.916886 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.916892 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917080 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917087 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917091 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917095 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917100 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917103 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917107 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917111 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917114 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917118 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917122 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917126 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 15:10:45.249063 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917130 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917133 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917137 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917141 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917145 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917148 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917152 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917155 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917159 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917163 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917167 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917170 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917176 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917182 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917186 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917190 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917204 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917209 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917213 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 15:10:45.249466 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917219 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917222 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917226 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917230 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917234 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917238 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917241 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917245 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917250 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917253 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917257 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917260 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917264 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917267 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917271 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917275 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917279 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917283 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917286 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917290 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917294 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 15:10:45.250026 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917297 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917301 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917305 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917308 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917312 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917316 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917320 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917324 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917329 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917340 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917345 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917352 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917356 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917360 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917364 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917368 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917372 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917376 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917379 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 15:10:45.250593 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917382 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917386 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917390 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917394 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917397 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917401 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917404 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917409 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917413 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917417 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917420 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917424 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917428 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917432 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917435 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917439 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917443 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917446 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917450 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917454 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 15:10:45.251130 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917458 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917464 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917468 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917478 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917483 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917487 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917490 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:44.917494 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.917514 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.917671 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.919956 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.921172 2583 server.go:1019] "Starting client certificate rotation" Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.921279 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 15:10:45.251687 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.921313 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 15:10:45.252083 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.923575 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 15:10:45.252083 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.927286 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 15:10:45.252083 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.940117 2583 log.go:25] "Validated CRI v1 runtime API" Jul 14 15:10:45.252083 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.942084 2583 log.go:25] "Validated CRI v1 image API" Jul 14 15:10:45.252083 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.942917 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 15:10:45.252083 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.944907 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 854227de-f321-4424-93e0-b2cc2739e878:/dev/nvme0n1p4 b5aae444-335f-4ee0-8054-14851ed7f7bf:/dev/nvme0n1p3] Jul 14 15:10:45.252083 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.944926 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.949966 2583 manager.go:216] Machine: {Timestamp:2026-07-14 15:10:44.948673062 +0000 UTC m=+0.257791506 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101128 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23f355cfa5148f23d87d39af50e4a5 SystemUUID:ec23f355-cfa5-148f-23d8-7d39af50e4a5 BootID:13f7044e-85cd-47cd-a4b7-c882f02c86f8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:bd:11:d0:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:bd:11:d0:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:51:06:b9:18:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.950100 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.950212 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.951494 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.952528 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.952556 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.953158 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.953170 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.953180 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.953756 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.954926 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.958556 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.958653 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.958678 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.958687 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.958703 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 15:10:45.252378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.958711 2583 kubelet.go:398] "Adding apiserver pod source" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.958722 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.959046 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.959066 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.960756 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.962449 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.962475 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.962677 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.962691 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.962697 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.962703 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.962713 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.962730 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.963029 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.963034 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.963040 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.963045 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.963058 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.963065 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.963650 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.963658 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.966875 2583 server.go:1268] "Started kubelet" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.967308 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.967998 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.968076 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:44.975551 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.975667 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:44.975810 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.976562 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:44.976969 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.977215 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:44.978983 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-4.ec2.internal.18c2309b11ae1991 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-4.ec2.internal,UID:ip-10-0-140-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-4.ec2.internal,},FirstTimestamp:2026-07-14 15:10:44.966824337 +0000 UTC m=+0.275942755,LastTimestamp:2026-07-14 15:10:44.966824337 +0000 UTC m=+0.275942755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-4.ec2.internal,}" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.980962 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.980970 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:44.981103 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.981480 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.981484 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.981550 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.981673 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.981714 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.983190 2583 factory.go:55] Registering systemd factory Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.983208 2583 factory.go:223] Registration of the systemd container factory successfully Jul 14 15:10:45.252893 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.983836 2583 factory.go:153] Registering CRI-O factory Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.983851 2583 factory.go:223] Registration of the crio container factory successfully Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.983895 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.983917 2583 factory.go:103] Registering Raw factory Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.983931 2583 manager.go:1196] Started watching for new ooms in manager Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:44.984075 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:44.984164 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.990386 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bfx97" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.990810 2583 manager.go:349] Starting recovery of all containers Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:44.994283 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bfx97" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.000295 2583 manager.go:354] Recovery completed Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.004480 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.006117 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.006139 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.006148 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.006550 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.006561 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.006568 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.006578 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.007305 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.007333 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.007342 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.008574 2583 policy_none.go:49] "None policy: Start" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.008586 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.008533 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-4.ec2.internal.18c2309b1405ce69 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-4.ec2.internal,UID:ip-10-0-140-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-4.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-4.ec2.internal,},FirstTimestamp:2026-07-14 15:10:45.006126697 +0000 UTC m=+0.315245114,LastTimestamp:2026-07-14 15:10:45.006126697 +0000 UTC m=+0.315245114,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-4.ec2.internal,}" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.008600 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.010682 2583 policy_none.go:47] "Start" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.060043 2583 manager.go:337] "Starting Device Plugin manager" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.060069 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.060077 2583 server.go:87] "Starting device plugin registration server" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.060291 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.060303 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.060484 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.060576 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.060585 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.060958 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.061072 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.160855 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:45.254023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.161579 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.161602 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.161615 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.161636 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.170968 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.170985 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-4.ec2.internal\": node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.186746 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.187632 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.187885 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.187925 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.187945 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.187981 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 15:10:45.255027 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.189445 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.288286 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal"] Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.288296 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.288354 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.289655 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.289681 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.289694 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.291908 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.292017 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.292051 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.292561 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.292569 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.292585 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.292590 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.292596 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.292603 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.294820 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.294840 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.295374 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientMemory" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.295402 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.295413 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeHasSufficientPID" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.317215 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-4.ec2.internal\" not found" node="ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.322397 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-4.ec2.internal\" not found" node="ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.384943 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e93c6e449763431a56e463a7fa12382c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal\" (UID: \"e93c6e449763431a56e463a7fa12382c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.384969 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e93c6e449763431a56e463a7fa12382c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal\" (UID: \"e93c6e449763431a56e463a7fa12382c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.387655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.384987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d93f0333f4b92614bdbed4b4019a42b1-config\") pod \"kube-apiserver-proxy-ip-10-0-140-4.ec2.internal\" (UID: \"d93f0333f4b92614bdbed4b4019a42b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.389599 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.389008 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.551486 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.485540 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e93c6e449763431a56e463a7fa12382c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal\" (UID: \"e93c6e449763431a56e463a7fa12382c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.551486 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.485565 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e93c6e449763431a56e463a7fa12382c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal\" (UID: \"e93c6e449763431a56e463a7fa12382c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.551486 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.485580 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d93f0333f4b92614bdbed4b4019a42b1-config\") pod \"kube-apiserver-proxy-ip-10-0-140-4.ec2.internal\" (UID: \"d93f0333f4b92614bdbed4b4019a42b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.551486 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.485584 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e93c6e449763431a56e463a7fa12382c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal\" (UID: \"e93c6e449763431a56e463a7fa12382c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.551486 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.485609 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d93f0333f4b92614bdbed4b4019a42b1-config\") pod \"kube-apiserver-proxy-ip-10-0-140-4.ec2.internal\" (UID: \"d93f0333f4b92614bdbed4b4019a42b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.551486 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.485624 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e93c6e449763431a56e463a7fa12382c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal\" (UID: \"e93c6e449763431a56e463a7fa12382c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.551486 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.489615 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.681695 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.589939 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.681695 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.619058 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.681695 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.625454 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal" Jul 14 15:10:45.828634 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.690518 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.828634 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.790857 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.963028 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.846548 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:45.963028 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.891089 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:45.963028 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.921222 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 15:10:45.963028 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.921316 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 15:10:45.963028 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.921311 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 15:10:46.082190 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:45.991440 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:46.082190 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.998043 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 15:05:44 +0000 UTC" deadline="2028-02-20 10:02:13.595138374 +0000 UTC" Jul 14 15:10:46.082190 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:45.998060 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14058h51m27.597079981s" Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:46.092076 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-4.ec2.internal\" not found" Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.164593 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:46.172087 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93f0333f4b92614bdbed4b4019a42b1.slice/crio-3637e8f3e10a8ec446a608a4d79d8ac2b727a09cfe16cbb1ef4c1a248dd47dd5 WatchSource:0}: Error finding container 3637e8f3e10a8ec446a608a4d79d8ac2b727a09cfe16cbb1ef4c1a248dd47dd5: Status 404 returned error can't find the container with id 3637e8f3e10a8ec446a608a4d79d8ac2b727a09cfe16cbb1ef4c1a248dd47dd5 Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.176153 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:46.180489 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93c6e449763431a56e463a7fa12382c.slice/crio-26497d2e40df3ffd9db17daa04e76eb77d532f126a41d1aa9e36caf27844d5c4 WatchSource:0}: Error finding container 26497d2e40df3ffd9db17daa04e76eb77d532f126a41d1aa9e36caf27844d5c4: Status 404 returned error can't find the container with id 26497d2e40df3ffd9db17daa04e76eb77d532f126a41d1aa9e36caf27844d5c4 Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.181066 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.191991 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" event={"ID":"e93c6e449763431a56e463a7fa12382c","Type":"ContainerStarted","Data":"26497d2e40df3ffd9db17daa04e76eb77d532f126a41d1aa9e36caf27844d5c4"} Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.192836 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal" event={"ID":"d93f0333f4b92614bdbed4b4019a42b1","Type":"ContainerStarted","Data":"3637e8f3e10a8ec446a608a4d79d8ac2b727a09cfe16cbb1ef4c1a248dd47dd5"} Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.195560 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 15:10:46.209289 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.196829 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal" Jul 14 15:10:46.209700 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.209375 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 15:10:46.359652 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.302721 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.960672 2583 apiserver.go:52] "Watching apiserver" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.970446 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.971882 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-wj4zb","kube-system/global-pull-secret-syncer-l9h2s","kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89","openshift-dns/node-resolver-l88r6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal","openshift-multus/multus-additional-cni-plugins-mslc2","kube-system/konnectivity-agent-dkl65","openshift-cluster-node-tuning-operator/tuned-pdm2q","openshift-image-registry/node-ca-tnqvx","openshift-multus/multus-92cxj","openshift-multus/network-metrics-daemon-n62q5","openshift-network-diagnostics/network-check-target-7m7vk","openshift-network-operator/iptables-alerter-lw6jr"] Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.974121 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.976556 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.980350 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:46.980397 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.980633 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.982302 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.982823 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.984254 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.986226 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:46.986259 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.988600 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:46.988630 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74pjq\" (UniqueName: \"kubernetes.io/projected/e8b7ef5b-25a0-4dc7-a490-290e827c172d-kube-api-access-74pjq\") pod \"node-ca-tnqvx\" (UID: \"e8b7ef5b-25a0-4dc7-a490-290e827c172d\") " pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991034 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-cni-dir\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991049 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-os-release\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991062 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95da5e03-b6f6-4810-8bb7-46bae5485eac-tmp-dir\") pod \"node-resolver-l88r6\" (UID: \"95da5e03-b6f6-4810-8bb7-46bae5485eac\") " pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991079 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8b7ef5b-25a0-4dc7-a490-290e827c172d-host\") pod \"node-ca-tnqvx\" (UID: \"e8b7ef5b-25a0-4dc7-a490-290e827c172d\") " pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991091 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-run-k8s-cni-cncf-io\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.994084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991103 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-var-lib-cni-bin\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991127 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5206e27-331b-4105-be8c-60d1328f9395-cni-binary-copy\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991142 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-system-cni-dir\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991154 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-var-lib-kubelet\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991167 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-conf-dir\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991179 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-cni-binary-copy\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991191 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-etc-kubernetes\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991203 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991221 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlslj\" (UniqueName: \"kubernetes.io/projected/95da5e03-b6f6-4810-8bb7-46bae5485eac-kube-api-access-hlslj\") pod \"node-resolver-l88r6\" (UID: \"95da5e03-b6f6-4810-8bb7-46bae5485eac\") " pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991244 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-os-release\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991260 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-run-multus-certs\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991277 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-system-cni-dir\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991290 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5206e27-331b-4105-be8c-60d1328f9395-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991304 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e8b7ef5b-25a0-4dc7-a490-290e827c172d-serviceca\") pod \"node-ca-tnqvx\" (UID: \"e8b7ef5b-25a0-4dc7-a490-290e827c172d\") " pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991317 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-socket-dir-parent\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991338 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-var-lib-cni-multus\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.997156 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991353 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-daemon-config\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991369 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nktm\" (UniqueName: \"kubernetes.io/projected/732934da-b301-4135-b617-db1319e77b22-kube-api-access-8nktm\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991382 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-cnibin\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991395 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991408 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5206e27-331b-4105-be8c-60d1328f9395-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991426 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mj7k\" (UniqueName: \"kubernetes.io/projected/a5206e27-331b-4105-be8c-60d1328f9395-kube-api-access-5mj7k\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991439 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95da5e03-b6f6-4810-8bb7-46bae5485eac-hosts-file\") pod \"node-resolver-l88r6\" (UID: \"95da5e03-b6f6-4810-8bb7-46bae5485eac\") " pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991457 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-cnibin\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991470 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-run-netns\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991482 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-hostroot\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.991520 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhmk4\" (UniqueName: \"kubernetes.io/projected/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-kube-api-access-hhmk4\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.992565 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.993195 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.994453 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:10:46.998021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:46.996451 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.025861 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mfsxc\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.025949 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.026112 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.026342 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.026542 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.026601 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.026635 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.027251 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-psnr6\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.027581 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.028073 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.028245 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-br2cp\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.028940 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.028973 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.029038 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.029208 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rb4rl\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.029618 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.029644 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.029720 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.029795 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030007 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030054 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f4lml\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030178 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030330 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030394 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030566 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c28wx\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030602 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030631 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030640 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pt7p7\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030799 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030831 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.030849 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.039256 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.039292 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tlgxs\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.039414 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.039658 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qmtdb\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.039699 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 15:10:47.079331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.049541 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 15:10:47.080582 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.057151 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-drxwc" Jul 14 15:10:47.080582 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.064320 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-drxwc" Jul 14 15:10:47.082843 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.082824 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 15:10:47.094903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.094883 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlslj\" (UniqueName: \"kubernetes.io/projected/95da5e03-b6f6-4810-8bb7-46bae5485eac-kube-api-access-hlslj\") pod \"node-resolver-l88r6\" (UID: \"95da5e03-b6f6-4810-8bb7-46bae5485eac\") " pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:47.094994 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.094908 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-kubelet\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.094994 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.094922 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:47.094994 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.094946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-os-release\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.094994 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.094983 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-run-multus-certs\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.095169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095008 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-system-cni-dir\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.095169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095027 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-os-release\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.095169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095029 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-systemd\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.095169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095069 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-run-ovn\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.095169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095077 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-system-cni-dir\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.095169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095085 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-run-multus-certs\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.095169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-node-log\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.095169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/072b5b8f-b490-426e-8718-92587f39635c-ovnkube-config\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.095169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095150 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swn5q\" (UniqueName: \"kubernetes.io/projected/072b5b8f-b490-426e-8718-92587f39635c-kube-api-access-swn5q\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-socket-dir-parent\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095198 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-log-socket\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095222 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095245 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-daemon-config\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095267 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-cnibin\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095289 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095312 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mj7k\" (UniqueName: \"kubernetes.io/projected/a5206e27-331b-4105-be8c-60d1328f9395-kube-api-access-5mj7k\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095325 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-cnibin\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095332 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-sys\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095343 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-socket-dir-parent\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095366 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e945306f-6eff-4b20-bf7e-fbd54d8f923b-kubelet-config\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095393 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-cnibin\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095414 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-sysctl-d\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095434 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-cni-netd\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095444 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095456 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74pjq\" (UniqueName: \"kubernetes.io/projected/e8b7ef5b-25a0-4dc7-a490-290e827c172d-kube-api-access-74pjq\") pod \"node-ca-tnqvx\" (UID: \"e8b7ef5b-25a0-4dc7-a490-290e827c172d\") " pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:47.095639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095467 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-cnibin\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095494 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-cni-dir\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095540 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rpg8\" (UniqueName: \"kubernetes.io/projected/2b988f47-8c63-4a63-bd58-ee17d0fa0820-kube-api-access-7rpg8\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095562 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-systemd-units\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095582 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-run-openvswitch\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095603 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/072b5b8f-b490-426e-8718-92587f39635c-env-overrides\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095611 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-cni-dir\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b2ffeb5-04a9-4e0e-b24a-9c614095b35f-konnectivity-ca\") pod \"konnectivity-agent-dkl65\" (UID: \"6b2ffeb5-04a9-4e0e-b24a-9c614095b35f\") " pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095653 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e945306f-6eff-4b20-bf7e-fbd54d8f923b-dbus\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095689 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-run-k8s-cni-cncf-io\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095747 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5206e27-331b-4105-be8c-60d1328f9395-cni-binary-copy\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095770 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-run-k8s-cni-cncf-io\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095763 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-daemon-config\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095820 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-etc-openvswitch\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095861 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/072b5b8f-b490-426e-8718-92587f39635c-ovn-node-metrics-cert\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-sys-fs\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095920 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08381f7b-eb19-46f4-8dd8-c31838717d54-host-slash\") pod \"iptables-alerter-lw6jr\" (UID: \"08381f7b-eb19-46f4-8dd8-c31838717d54\") " pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.096291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095944 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-496w8\" (UniqueName: \"kubernetes.io/projected/08381f7b-eb19-46f4-8dd8-c31838717d54-kube-api-access-496w8\") pod \"iptables-alerter-lw6jr\" (UID: \"08381f7b-eb19-46f4-8dd8-c31838717d54\") " pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.095989 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-system-cni-dir\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096015 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-conf-dir\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096037 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-run\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096061 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096065 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-system-cni-dir\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096088 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096145 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08381f7b-eb19-46f4-8dd8-c31838717d54-iptables-alerter-script\") pod \"iptables-alerter-lw6jr\" (UID: \"08381f7b-eb19-46f4-8dd8-c31838717d54\") " pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096183 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-cni-binary-copy\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096188 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-multus-conf-dir\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096222 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-etc-kubernetes\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096246 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5206e27-331b-4105-be8c-60d1328f9395-cni-binary-copy\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096256 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-etc-kubernetes\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096277 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096306 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-sysctl-conf\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096329 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmlw9\" (UniqueName: \"kubernetes.io/projected/744d690d-0ef8-41a2-b217-dd157b89a70b-kube-api-access-tmlw9\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.096399 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:47.096867 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5206e27-331b-4105-be8c-60d1328f9395-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.096459 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs podName:732934da-b301-4135-b617-db1319e77b22 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:47.596440695 +0000 UTC m=+2.905559110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs") pod "network-metrics-daemon-n62q5" (UID: "732934da-b301-4135-b617-db1319e77b22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096611 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-cni-binary-copy\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096670 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-modprobe-d\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096701 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-run-netns\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096727 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-run-systemd\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096752 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-cni-bin\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096767 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e8b7ef5b-25a0-4dc7-a490-290e827c172d-serviceca\") pod \"node-ca-tnqvx\" (UID: \"e8b7ef5b-25a0-4dc7-a490-290e827c172d\") " pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096788 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-var-lib-cni-multus\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096809 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-kubernetes\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096830 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-run-ovn-kubernetes\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096865 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b2ffeb5-04a9-4e0e-b24a-9c614095b35f-agent-certs\") pod \"konnectivity-agent-dkl65\" (UID: \"6b2ffeb5-04a9-4e0e-b24a-9c614095b35f\") " pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-tuned\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096908 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5206e27-331b-4105-be8c-60d1328f9395-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096916 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-slash\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096933 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nktm\" (UniqueName: \"kubernetes.io/projected/732934da-b301-4135-b617-db1319e77b22-kube-api-access-8nktm\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:47.097343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096947 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5206e27-331b-4105-be8c-60d1328f9395-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096968 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-var-lib-cni-multus\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.096961 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95da5e03-b6f6-4810-8bb7-46bae5485eac-hosts-file\") pod \"node-resolver-l88r6\" (UID: \"95da5e03-b6f6-4810-8bb7-46bae5485eac\") " pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097011 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-registration-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097033 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-device-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097056 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-run-netns\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097077 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-hostroot\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097098 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhmk4\" (UniqueName: \"kubernetes.io/projected/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-kube-api-access-hhmk4\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097118 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-host\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097139 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-os-release\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097145 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e8b7ef5b-25a0-4dc7-a490-290e827c172d-serviceca\") pod \"node-ca-tnqvx\" (UID: \"e8b7ef5b-25a0-4dc7-a490-290e827c172d\") " pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097162 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95da5e03-b6f6-4810-8bb7-46bae5485eac-tmp-dir\") pod \"node-resolver-l88r6\" (UID: \"95da5e03-b6f6-4810-8bb7-46bae5485eac\") " pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097183 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-var-lib-openvswitch\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-socket-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097228 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8b7ef5b-25a0-4dc7-a490-290e827c172d-host\") pod \"node-ca-tnqvx\" (UID: \"e8b7ef5b-25a0-4dc7-a490-290e827c172d\") " pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-var-lib-cni-bin\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097271 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b988f47-8c63-4a63-bd58-ee17d0fa0820-tmp\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.097951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097291 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-var-lib-kubelet\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097353 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95da5e03-b6f6-4810-8bb7-46bae5485eac-hosts-file\") pod \"node-resolver-l88r6\" (UID: \"95da5e03-b6f6-4810-8bb7-46bae5485eac\") " pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097352 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-sysconfig\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097380 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5206e27-331b-4105-be8c-60d1328f9395-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097393 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-lib-modules\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097413 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5206e27-331b-4105-be8c-60d1328f9395-os-release\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097415 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-var-lib-kubelet\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097444 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8b7ef5b-25a0-4dc7-a490-290e827c172d-host\") pod \"node-ca-tnqvx\" (UID: \"e8b7ef5b-25a0-4dc7-a490-290e827c172d\") " pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097449 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/072b5b8f-b490-426e-8718-92587f39635c-ovnkube-script-lib\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097524 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-var-lib-kubelet\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097531 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-run-netns\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097536 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-hostroot\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097557 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-host-var-lib-cni-bin\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.098641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.097738 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95da5e03-b6f6-4810-8bb7-46bae5485eac-tmp-dir\") pod \"node-resolver-l88r6\" (UID: \"95da5e03-b6f6-4810-8bb7-46bae5485eac\") " pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:47.140992 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.140936 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 15:10:47.144448 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.144429 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mj7k\" (UniqueName: \"kubernetes.io/projected/a5206e27-331b-4105-be8c-60d1328f9395-kube-api-access-5mj7k\") pod \"multus-additional-cni-plugins-mslc2\" (UID: \"a5206e27-331b-4105-be8c-60d1328f9395\") " pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.144804 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.144787 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74pjq\" (UniqueName: \"kubernetes.io/projected/e8b7ef5b-25a0-4dc7-a490-290e827c172d-kube-api-access-74pjq\") pod \"node-ca-tnqvx\" (UID: \"e8b7ef5b-25a0-4dc7-a490-290e827c172d\") " pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:47.144888 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.144833 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlslj\" (UniqueName: \"kubernetes.io/projected/95da5e03-b6f6-4810-8bb7-46bae5485eac-kube-api-access-hlslj\") pod \"node-resolver-l88r6\" (UID: \"95da5e03-b6f6-4810-8bb7-46bae5485eac\") " pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:47.144927 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.144892 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhmk4\" (UniqueName: \"kubernetes.io/projected/722b7bc2-356d-4e48-ba4c-b4767c6b3e14-kube-api-access-hhmk4\") pod \"multus-92cxj\" (UID: \"722b7bc2-356d-4e48-ba4c-b4767c6b3e14\") " pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.144927 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.144913 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nktm\" (UniqueName: \"kubernetes.io/projected/732934da-b301-4135-b617-db1319e77b22-kube-api-access-8nktm\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:47.198511 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198478 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e945306f-6eff-4b20-bf7e-fbd54d8f923b-kubelet-config\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:47.198614 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-sysctl-d\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.198614 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-cni-netd\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.198614 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198577 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rpg8\" (UniqueName: \"kubernetes.io/projected/2b988f47-8c63-4a63-bd58-ee17d0fa0820-kube-api-access-7rpg8\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.198614 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198599 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-systemd-units\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198619 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-run-openvswitch\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198631 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-cni-netd\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198639 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/072b5b8f-b490-426e-8718-92587f39635c-env-overrides\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198652 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-sysctl-d\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198663 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b2ffeb5-04a9-4e0e-b24a-9c614095b35f-konnectivity-ca\") pod \"konnectivity-agent-dkl65\" (UID: \"6b2ffeb5-04a9-4e0e-b24a-9c614095b35f\") " pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198568 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e945306f-6eff-4b20-bf7e-fbd54d8f923b-kubelet-config\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198679 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-systemd-units\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198690 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e945306f-6eff-4b20-bf7e-fbd54d8f923b-dbus\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-etc-openvswitch\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198718 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-run-openvswitch\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.198802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/072b5b8f-b490-426e-8718-92587f39635c-ovn-node-metrics-cert\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198815 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e945306f-6eff-4b20-bf7e-fbd54d8f923b-dbus\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198862 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-etc-openvswitch\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198890 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-sys-fs\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198915 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08381f7b-eb19-46f4-8dd8-c31838717d54-host-slash\") pod \"iptables-alerter-lw6jr\" (UID: \"08381f7b-eb19-46f4-8dd8-c31838717d54\") " pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198937 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-496w8\" (UniqueName: \"kubernetes.io/projected/08381f7b-eb19-46f4-8dd8-c31838717d54-kube-api-access-496w8\") pod \"iptables-alerter-lw6jr\" (UID: \"08381f7b-eb19-46f4-8dd8-c31838717d54\") " pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198960 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-run\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.198984 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199028 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08381f7b-eb19-46f4-8dd8-c31838717d54-iptables-alerter-script\") pod \"iptables-alerter-lw6jr\" (UID: \"08381f7b-eb19-46f4-8dd8-c31838717d54\") " pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199060 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-sysctl-conf\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199082 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmlw9\" (UniqueName: \"kubernetes.io/projected/744d690d-0ef8-41a2-b217-dd157b89a70b-kube-api-access-tmlw9\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.199122 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199115 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-run\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199106 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-modprobe-d\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199120 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/072b5b8f-b490-426e-8718-92587f39635c-env-overrides\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199168 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-run-netns\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199176 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08381f7b-eb19-46f4-8dd8-c31838717d54-host-slash\") pod \"iptables-alerter-lw6jr\" (UID: \"08381f7b-eb19-46f4-8dd8-c31838717d54\") " pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199191 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-run-systemd\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-cni-bin\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199229 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-sys-fs\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199236 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-kubernetes\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199268 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-run-ovn-kubernetes\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199281 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-kubernetes\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199284 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-run-systemd\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199295 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b2ffeb5-04a9-4e0e-b24a-9c614095b35f-agent-certs\") pod \"konnectivity-agent-dkl65\" (UID: \"6b2ffeb5-04a9-4e0e-b24a-9c614095b35f\") " pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199296 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-modprobe-d\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199316 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-tuned\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199324 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-cni-bin\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199341 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-slash\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199345 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-run-netns\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.199633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199347 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199366 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-registration-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199371 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199409 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-slash\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199411 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-device-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199441 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-run-ovn-kubernetes\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199486 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-device-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199515 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-host\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199552 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-var-lib-openvswitch\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199562 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-host\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199575 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-socket-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199592 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08381f7b-eb19-46f4-8dd8-c31838717d54-iptables-alerter-script\") pod \"iptables-alerter-lw6jr\" (UID: \"08381f7b-eb19-46f4-8dd8-c31838717d54\") " pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199607 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b988f47-8c63-4a63-bd58-ee17d0fa0820-tmp\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199618 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-registration-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199630 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199652 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-sysconfig\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199663 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b2ffeb5-04a9-4e0e-b24a-9c614095b35f-konnectivity-ca\") pod \"konnectivity-agent-dkl65\" (UID: \"6b2ffeb5-04a9-4e0e-b24a-9c614095b35f\") " pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:10:47.200403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199673 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-sysctl-conf\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199676 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-lib-modules\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199698 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-socket-dir\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199710 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-var-lib-openvswitch\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199738 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-var-lib-kubelet\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199756 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-sysconfig\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199761 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/072b5b8f-b490-426e-8718-92587f39635c-ovnkube-script-lib\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199768 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-lib-modules\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199759 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/744d690d-0ef8-41a2-b217-dd157b89a70b-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199800 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-var-lib-kubelet\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199806 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-kubelet\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199836 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-host-kubelet\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199885 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-systemd\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199907 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-run-ovn\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-node-log\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/072b5b8f-b490-426e-8718-92587f39635c-ovnkube-config\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swn5q\" (UniqueName: \"kubernetes.io/projected/072b5b8f-b490-426e-8718-92587f39635c-kube-api-access-swn5q\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.199990 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-log-socket\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.200043 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-run-ovn\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.200051 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-log-socket\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.200055 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-systemd\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.200148 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/072b5b8f-b490-426e-8718-92587f39635c-node-log\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.200207 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/072b5b8f-b490-426e-8718-92587f39635c-ovnkube-script-lib\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.200792 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.200958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-sys\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.201054 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b988f47-8c63-4a63-bd58-ee17d0fa0820-sys\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.201091 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/072b5b8f-b490-426e-8718-92587f39635c-ovnkube-config\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.201231 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.201289 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret podName:e945306f-6eff-4b20-bf7e-fbd54d8f923b nodeName:}" failed. No retries permitted until 2026-07-14 15:10:47.70127184 +0000 UTC m=+3.010390253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret") pod "global-pull-secret-syncer-l9h2s" (UID: "e945306f-6eff-4b20-bf7e-fbd54d8f923b") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:47.201805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.201772 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b2ffeb5-04a9-4e0e-b24a-9c614095b35f-agent-certs\") pod \"konnectivity-agent-dkl65\" (UID: \"6b2ffeb5-04a9-4e0e-b24a-9c614095b35f\") " pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:10:47.203918 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.203890 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b988f47-8c63-4a63-bd58-ee17d0fa0820-tmp\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.204393 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.204372 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b988f47-8c63-4a63-bd58-ee17d0fa0820-etc-tuned\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.205689 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.205622 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/072b5b8f-b490-426e-8718-92587f39635c-ovn-node-metrics-cert\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.207780 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.207759 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-496w8\" (UniqueName: \"kubernetes.io/projected/08381f7b-eb19-46f4-8dd8-c31838717d54-kube-api-access-496w8\") pod \"iptables-alerter-lw6jr\" (UID: \"08381f7b-eb19-46f4-8dd8-c31838717d54\") " pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.208355 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.208323 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:47.208355 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.208354 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:47.208516 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.208372 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9n24n for pod openshift-network-diagnostics/network-check-target-7m7vk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:47.208516 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.208429 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n podName:f6d4e233-b66a-4c0b-9516-c6aa913dd474 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:47.708411249 +0000 UTC m=+3.017529715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9n24n" (UniqueName: "kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n") pod "network-check-target-7m7vk" (UID: "f6d4e233-b66a-4c0b-9516-c6aa913dd474") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:47.209895 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.209873 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rpg8\" (UniqueName: \"kubernetes.io/projected/2b988f47-8c63-4a63-bd58-ee17d0fa0820-kube-api-access-7rpg8\") pod \"tuned-pdm2q\" (UID: \"2b988f47-8c63-4a63-bd58-ee17d0fa0820\") " pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.210466 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.210449 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmlw9\" (UniqueName: \"kubernetes.io/projected/744d690d-0ef8-41a2-b217-dd157b89a70b-kube-api-access-tmlw9\") pod \"aws-ebs-csi-driver-node-tbw89\" (UID: \"744d690d-0ef8-41a2-b217-dd157b89a70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.211408 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.211390 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swn5q\" (UniqueName: \"kubernetes.io/projected/072b5b8f-b490-426e-8718-92587f39635c-kube-api-access-swn5q\") pod \"ovnkube-node-wj4zb\" (UID: \"072b5b8f-b490-426e-8718-92587f39635c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.287920 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.287896 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tnqvx" Jul 14 15:10:47.294594 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.294579 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-92cxj" Jul 14 15:10:47.301178 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.301159 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mslc2" Jul 14 15:10:47.307536 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.307517 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l88r6" Jul 14 15:10:47.313923 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.313907 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" Jul 14 15:10:47.319349 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.319333 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:10:47.326757 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.326739 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" Jul 14 15:10:47.343031 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.343011 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:10:47.344089 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.344072 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lw6jr" Jul 14 15:10:47.464710 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.464649 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:47.604009 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.603980 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:47.604136 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.604078 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:47.604136 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.604127 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs podName:732934da-b301-4135-b617-db1319e77b22 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:48.604114826 +0000 UTC m=+3.913233229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs") pod "network-metrics-daemon-n62q5" (UID: "732934da-b301-4135-b617-db1319e77b22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:47.704704 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.704673 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:47.704822 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.704792 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:47.704884 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.704862 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret podName:e945306f-6eff-4b20-bf7e-fbd54d8f923b nodeName:}" failed. No retries permitted until 2026-07-14 15:10:48.704841847 +0000 UTC m=+4.013960263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret") pod "global-pull-secret-syncer-l9h2s" (UID: "e945306f-6eff-4b20-bf7e-fbd54d8f923b") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:47.805490 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.805418 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:47.805648 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.805555 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:47.805648 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.805576 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:47.805648 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.805586 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9n24n for pod openshift-network-diagnostics/network-check-target-7m7vk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:47.805648 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:47.805631 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n podName:f6d4e233-b66a-4c0b-9516-c6aa913dd474 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:48.805617953 +0000 UTC m=+4.114736357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9n24n" (UniqueName: "kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n") pod "network-check-target-7m7vk" (UID: "f6d4e233-b66a-4c0b-9516-c6aa913dd474") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:47.863724 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:47.863703 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5206e27_331b_4105_be8c_60d1328f9395.slice/crio-c621bb7b0aa1ad031ca2103de2606355154b22d19b705a44430936df37816266 WatchSource:0}: Error finding container c621bb7b0aa1ad031ca2103de2606355154b22d19b705a44430936df37816266: Status 404 returned error can't find the container with id c621bb7b0aa1ad031ca2103de2606355154b22d19b705a44430936df37816266 Jul 14 15:10:47.865436 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:47.865411 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b988f47_8c63_4a63_bd58_ee17d0fa0820.slice/crio-2c213733515ad20bfa96397018efed3984c9f40ad451bd9cc2de99e665b5ff04 WatchSource:0}: Error finding container 2c213733515ad20bfa96397018efed3984c9f40ad451bd9cc2de99e665b5ff04: Status 404 returned error can't find the container with id 2c213733515ad20bfa96397018efed3984c9f40ad451bd9cc2de99e665b5ff04 Jul 14 15:10:47.867990 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:47.867972 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95da5e03_b6f6_4810_8bb7_46bae5485eac.slice/crio-fd156393b8a71d32900ca67ba69cf4003e9143054b581e2e33a44c6db658e83a WatchSource:0}: Error finding container fd156393b8a71d32900ca67ba69cf4003e9143054b581e2e33a44c6db658e83a: Status 404 returned error can't find the container with id fd156393b8a71d32900ca67ba69cf4003e9143054b581e2e33a44c6db658e83a Jul 14 15:10:47.888349 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:47.888327 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722b7bc2_356d_4e48_ba4c_b4767c6b3e14.slice/crio-fad8af7b671470b5a7e984c2bd3137e5ce80f66252d4a344e7feb446af2c048c WatchSource:0}: Error finding container fad8af7b671470b5a7e984c2bd3137e5ce80f66252d4a344e7feb446af2c048c: Status 404 returned error can't find the container with id fad8af7b671470b5a7e984c2bd3137e5ce80f66252d4a344e7feb446af2c048c Jul 14 15:10:47.889233 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:47.889214 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744d690d_0ef8_41a2_b217_dd157b89a70b.slice/crio-7d7a829e3fbfcbd9dbb88cd34e2dd671659ef172c9bcd4c8ef9d0cb793540100 WatchSource:0}: Error finding container 7d7a829e3fbfcbd9dbb88cd34e2dd671659ef172c9bcd4c8ef9d0cb793540100: Status 404 returned error can't find the container with id 7d7a829e3fbfcbd9dbb88cd34e2dd671659ef172c9bcd4c8ef9d0cb793540100 Jul 14 15:10:47.890292 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:47.890268 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08381f7b_eb19_46f4_8dd8_c31838717d54.slice/crio-530b6da9b8219d1d6429e394edc01b3d0f4c56053eca1589489482b623cd8e07 WatchSource:0}: Error finding container 530b6da9b8219d1d6429e394edc01b3d0f4c56053eca1589489482b623cd8e07: Status 404 returned error can't find the container with id 530b6da9b8219d1d6429e394edc01b3d0f4c56053eca1589489482b623cd8e07 Jul 14 15:10:47.891104 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:47.891077 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072b5b8f_b490_426e_8718_92587f39635c.slice/crio-e786ed42366af4679c5f573710e6414c45616bbe43566a238df62e77bc95d13c WatchSource:0}: Error finding container e786ed42366af4679c5f573710e6414c45616bbe43566a238df62e77bc95d13c: Status 404 returned error can't find the container with id e786ed42366af4679c5f573710e6414c45616bbe43566a238df62e77bc95d13c Jul 14 15:10:47.892681 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:47.892662 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b7ef5b_25a0_4dc7_a490_290e827c172d.slice/crio-73e735cd2c282476aa2150bfc9fe1ed35ab9cc2e7ad4665c16e904ffe4d9490f WatchSource:0}: Error finding container 73e735cd2c282476aa2150bfc9fe1ed35ab9cc2e7ad4665c16e904ffe4d9490f: Status 404 returned error can't find the container with id 73e735cd2c282476aa2150bfc9fe1ed35ab9cc2e7ad4665c16e904ffe4d9490f Jul 14 15:10:47.893956 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:10:47.893746 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2ffeb5_04a9_4e0e_b24a_9c614095b35f.slice/crio-99a17566a48a770ec2725b31d26a0db83387c870f20caed90b89fe3e33566216 WatchSource:0}: Error finding container 99a17566a48a770ec2725b31d26a0db83387c870f20caed90b89fe3e33566216: Status 404 returned error can't find the container with id 99a17566a48a770ec2725b31d26a0db83387c870f20caed90b89fe3e33566216 Jul 14 15:10:47.986249 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:47.986230 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 15:10:48.067650 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.067491 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 15:05:46 +0000 UTC" deadline="2028-04-13 02:42:04.423902046 +0000 UTC" Jul 14 15:10:48.067650 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.067618 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15323h31m16.3562872s" Jul 14 15:10:48.188664 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.188640 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:48.188759 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:48.188737 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:10:48.196745 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.196666 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerStarted","Data":"e786ed42366af4679c5f573710e6414c45616bbe43566a238df62e77bc95d13c"} Jul 14 15:10:48.197851 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.197831 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lw6jr" event={"ID":"08381f7b-eb19-46f4-8dd8-c31838717d54","Type":"ContainerStarted","Data":"530b6da9b8219d1d6429e394edc01b3d0f4c56053eca1589489482b623cd8e07"} Jul 14 15:10:48.198902 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.198878 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" event={"ID":"744d690d-0ef8-41a2-b217-dd157b89a70b","Type":"ContainerStarted","Data":"7d7a829e3fbfcbd9dbb88cd34e2dd671659ef172c9bcd4c8ef9d0cb793540100"} Jul 14 15:10:48.200023 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.199979 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l88r6" event={"ID":"95da5e03-b6f6-4810-8bb7-46bae5485eac","Type":"ContainerStarted","Data":"fd156393b8a71d32900ca67ba69cf4003e9143054b581e2e33a44c6db658e83a"} Jul 14 15:10:48.202281 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.202251 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal" event={"ID":"d93f0333f4b92614bdbed4b4019a42b1","Type":"ContainerStarted","Data":"41c74f1172858e227bb987975bf0bdc435c3ac3baead9e5d87044c6cbf3eb97e"} Jul 14 15:10:48.205756 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.205729 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-92cxj" event={"ID":"722b7bc2-356d-4e48-ba4c-b4767c6b3e14","Type":"ContainerStarted","Data":"fad8af7b671470b5a7e984c2bd3137e5ce80f66252d4a344e7feb446af2c048c"} Jul 14 15:10:48.206953 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.206924 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" event={"ID":"2b988f47-8c63-4a63-bd58-ee17d0fa0820","Type":"ContainerStarted","Data":"2c213733515ad20bfa96397018efed3984c9f40ad451bd9cc2de99e665b5ff04"} Jul 14 15:10:48.208060 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.208036 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mslc2" event={"ID":"a5206e27-331b-4105-be8c-60d1328f9395","Type":"ContainerStarted","Data":"c621bb7b0aa1ad031ca2103de2606355154b22d19b705a44430936df37816266"} Jul 14 15:10:48.209058 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.209036 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dkl65" event={"ID":"6b2ffeb5-04a9-4e0e-b24a-9c614095b35f","Type":"ContainerStarted","Data":"99a17566a48a770ec2725b31d26a0db83387c870f20caed90b89fe3e33566216"} Jul 14 15:10:48.210197 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.210168 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tnqvx" event={"ID":"e8b7ef5b-25a0-4dc7-a490-290e827c172d","Type":"ContainerStarted","Data":"73e735cd2c282476aa2150bfc9fe1ed35ab9cc2e7ad4665c16e904ffe4d9490f"} Jul 14 15:10:48.217523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.217469 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-4.ec2.internal" podStartSLOduration=2.217455351 podStartE2EDuration="2.217455351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:10:48.216738607 +0000 UTC m=+3.525857033" watchObservedRunningTime="2026-07-14 15:10:48.217455351 +0000 UTC m=+3.526573766" Jul 14 15:10:48.612081 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.612046 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:48.612329 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:48.612181 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:48.612329 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:48.612228 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs podName:732934da-b301-4135-b617-db1319e77b22 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:50.612215302 +0000 UTC m=+5.921333707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs") pod "network-metrics-daemon-n62q5" (UID: "732934da-b301-4135-b617-db1319e77b22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:48.713025 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.712986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:48.713204 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:48.713148 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:48.713261 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:48.713221 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret podName:e945306f-6eff-4b20-bf7e-fbd54d8f923b nodeName:}" failed. No retries permitted until 2026-07-14 15:10:50.713200333 +0000 UTC m=+6.022318738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret") pod "global-pull-secret-syncer-l9h2s" (UID: "e945306f-6eff-4b20-bf7e-fbd54d8f923b") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:48.813757 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:48.813720 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:48.813917 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:48.813881 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:48.813989 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:48.813937 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:48.813989 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:48.813952 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9n24n for pod openshift-network-diagnostics/network-check-target-7m7vk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:48.814092 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:48.814012 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n podName:f6d4e233-b66a-4c0b-9516-c6aa913dd474 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:50.813994385 +0000 UTC m=+6.123112792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9n24n" (UniqueName: "kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n") pod "network-check-target-7m7vk" (UID: "f6d4e233-b66a-4c0b-9516-c6aa913dd474") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:49.068146 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:49.068047 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 15:05:46 +0000 UTC" deadline="2028-02-28 13:32:40.535652828 +0000 UTC" Jul 14 15:10:49.068146 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:49.068110 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14254h21m51.467546698s" Jul 14 15:10:49.189363 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:49.188762 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:49.189363 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:49.188895 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:10:49.189363 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:49.188774 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:49.189363 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:49.189325 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:10:50.189130 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:50.189097 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:50.189573 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:50.189254 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:10:50.630381 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:50.630302 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:50.630552 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:50.630522 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:50.630618 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:50.630581 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs podName:732934da-b301-4135-b617-db1319e77b22 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:54.630563073 +0000 UTC m=+9.939681480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs") pod "network-metrics-daemon-n62q5" (UID: "732934da-b301-4135-b617-db1319e77b22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:50.731139 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:50.731109 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:50.731315 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:50.731262 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:50.731379 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:50.731331 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret podName:e945306f-6eff-4b20-bf7e-fbd54d8f923b nodeName:}" failed. No retries permitted until 2026-07-14 15:10:54.731311554 +0000 UTC m=+10.040429963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret") pod "global-pull-secret-syncer-l9h2s" (UID: "e945306f-6eff-4b20-bf7e-fbd54d8f923b") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:50.832361 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:50.832321 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:50.832549 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:50.832533 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:50.832628 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:50.832558 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:50.832628 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:50.832571 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9n24n for pod openshift-network-diagnostics/network-check-target-7m7vk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:50.832757 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:50.832634 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n podName:f6d4e233-b66a-4c0b-9516-c6aa913dd474 nodeName:}" failed. No retries permitted until 2026-07-14 15:10:54.832614973 +0000 UTC m=+10.141733392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9n24n" (UniqueName: "kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n") pod "network-check-target-7m7vk" (UID: "f6d4e233-b66a-4c0b-9516-c6aa913dd474") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:51.188944 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:51.188903 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:51.189118 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:51.189051 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:10:51.189378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:51.188911 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:51.189378 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:51.189328 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:10:52.188168 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:52.188135 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:52.188352 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:52.188265 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:10:53.188632 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:53.188594 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:53.189022 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:53.188594 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:53.189022 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:53.188735 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:10:53.189022 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:53.188778 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:10:54.188519 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:54.188475 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:54.188715 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:54.188632 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:10:54.660886 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:54.660801 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:54.661044 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:54.660954 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:54.661044 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:54.661035 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs podName:732934da-b301-4135-b617-db1319e77b22 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:02.66101277 +0000 UTC m=+17.970131178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs") pod "network-metrics-daemon-n62q5" (UID: "732934da-b301-4135-b617-db1319e77b22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:10:54.761815 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:54.761779 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:54.761988 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:54.761922 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:54.762049 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:54.761990 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret podName:e945306f-6eff-4b20-bf7e-fbd54d8f923b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:02.761971271 +0000 UTC m=+18.071089688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret") pod "global-pull-secret-syncer-l9h2s" (UID: "e945306f-6eff-4b20-bf7e-fbd54d8f923b") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:10:54.862740 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:54.862707 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:54.862915 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:54.862879 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:10:54.862915 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:54.862899 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:10:54.862915 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:54.862911 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9n24n for pod openshift-network-diagnostics/network-check-target-7m7vk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:54.863061 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:54.862967 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n podName:f6d4e233-b66a-4c0b-9516-c6aa913dd474 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:02.862948595 +0000 UTC m=+18.172067002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9n24n" (UniqueName: "kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n") pod "network-check-target-7m7vk" (UID: "f6d4e233-b66a-4c0b-9516-c6aa913dd474") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:10:55.189314 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:55.189284 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:55.189783 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:55.189394 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:10:55.189783 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:55.189430 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:55.189783 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:55.189527 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:10:56.188720 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:56.188685 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:56.188885 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:56.188816 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:10:57.188316 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:57.188282 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:57.188316 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:57.188299 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:57.188822 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:57.188409 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:10:57.188822 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:57.188545 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:10:58.189135 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:58.189098 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:10:58.189531 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:58.189211 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:10:59.189184 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:59.189108 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:10:59.189602 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:59.189241 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:10:59.189602 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:10:59.189271 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:10:59.189602 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:10:59.189395 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:00.188404 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:00.188370 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:00.188587 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:00.188490 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:01.189144 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:01.189115 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:01.189584 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:01.189232 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:01.189584 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:01.189306 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:01.189584 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:01.189422 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:02.188838 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:02.188808 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:02.189023 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:02.188909 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:02.727603 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:02.727571 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:02.728033 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:02.727690 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:11:02.728033 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:02.727759 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs podName:732934da-b301-4135-b617-db1319e77b22 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:18.727738864 +0000 UTC m=+34.036857270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs") pod "network-metrics-daemon-n62q5" (UID: "732934da-b301-4135-b617-db1319e77b22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:11:02.827819 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:02.827791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:02.827979 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:02.827957 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:11:02.828056 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:02.828025 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret podName:e945306f-6eff-4b20-bf7e-fbd54d8f923b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:18.828004821 +0000 UTC m=+34.137123228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret") pod "global-pull-secret-syncer-l9h2s" (UID: "e945306f-6eff-4b20-bf7e-fbd54d8f923b") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:11:02.928256 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:02.928223 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:02.928404 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:02.928385 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:11:02.928448 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:02.928411 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:11:02.928448 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:02.928421 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9n24n for pod openshift-network-diagnostics/network-check-target-7m7vk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:11:02.928548 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:02.928465 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n podName:f6d4e233-b66a-4c0b-9516-c6aa913dd474 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:18.928453299 +0000 UTC m=+34.237571703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9n24n" (UniqueName: "kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n") pod "network-check-target-7m7vk" (UID: "f6d4e233-b66a-4c0b-9516-c6aa913dd474") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:11:03.189049 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:03.188976 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:03.189197 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:03.188984 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:03.189197 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:03.189093 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:03.189307 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:03.189198 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:04.188768 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:04.188739 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:04.189219 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:04.188842 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:05.189657 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:05.189623 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:05.190078 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:05.189710 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:05.190078 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:05.189799 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:05.190078 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:05.189922 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:06.188727 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:06.188693 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:06.188901 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:06.188800 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:07.189513 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:07.189250 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:07.189885 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:07.189814 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:07.189951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:07.189910 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:07.190019 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:07.189998 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:07.248883 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:07.248823 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-92cxj" event={"ID":"722b7bc2-356d-4e48-ba4c-b4767c6b3e14","Type":"ContainerStarted","Data":"4fdb622066710f0869572dcc1bc5a2bf4ebaed8c1e05233cf0dffe1770a1bf60"} Jul 14 15:11:07.250877 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:07.250852 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" event={"ID":"2b988f47-8c63-4a63-bd58-ee17d0fa0820","Type":"ContainerStarted","Data":"cafc0e9ab28fa42efb3f2831d34bcd35c97b842f77f09f218980deb87362f3d5"} Jul 14 15:11:07.253514 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:07.253477 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerStarted","Data":"4dec632816c3d6deb30505fed41421244321fd3e773d0849f222cf6b81935a24"} Jul 14 15:11:07.272960 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:07.272631 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-92cxj" podStartSLOduration=4.414718939 podStartE2EDuration="23.272616597s" totalImagesPullingTime="18.857897658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:07.272163305 +0000 UTC m=+22.581281732" watchObservedRunningTime="2026-07-14 15:11:07.272616597 +0000 UTC m=+22.581735022" Jul 14 15:11:07.296453 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:07.294921 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pdm2q" podStartSLOduration=4.437790791 podStartE2EDuration="23.294899777s" totalImagesPullingTime="18.857108986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:07.294334718 +0000 UTC m=+22.603453145" watchObservedRunningTime="2026-07-14 15:11:07.294899777 +0000 UTC m=+22.604018205" Jul 14 15:11:08.188817 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.188638 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:08.189040 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:08.188887 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:08.257201 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.257174 2583 generic.go:356] "Generic (PLEG): container finished" podID="a5206e27-331b-4105-be8c-60d1328f9395" containerID="359ee8c2adf987400fa9358c2b227d1960e6579d1e43329c78c8d2d3899420b7" exitCode=0 Jul 14 15:11:08.257904 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.257244 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mslc2" event={"ID":"a5206e27-331b-4105-be8c-60d1328f9395","Type":"ContainerDied","Data":"359ee8c2adf987400fa9358c2b227d1960e6579d1e43329c78c8d2d3899420b7"} Jul 14 15:11:08.258625 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.258602 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dkl65" event={"ID":"6b2ffeb5-04a9-4e0e-b24a-9c614095b35f","Type":"ContainerStarted","Data":"2e2f94465b2f54a74f2bb78a3e55e807bf657dd2de1c3d480f3ca64c7c9acf55"} Jul 14 15:11:08.259805 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.259782 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tnqvx" event={"ID":"e8b7ef5b-25a0-4dc7-a490-290e827c172d","Type":"ContainerStarted","Data":"96eb16cd2e4f5df2e0b81d26f2d4eee881309b71d47ea908ddcec1ad7fab5ff2"} Jul 14 15:11:08.262226 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.262210 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:11:08.262551 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.262535 2583 generic.go:356] "Generic (PLEG): container finished" podID="072b5b8f-b490-426e-8718-92587f39635c" containerID="02133371d518b7f6f62ee29a5a7268f461c67f7ead00a33ee7d8cb49368d1413" exitCode=1 Jul 14 15:11:08.262606 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.262595 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerStarted","Data":"2e1d861c990295500e80bfc0a695adf6038acf93943d98673890711468d83869"} Jul 14 15:11:08.262654 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.262647 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerStarted","Data":"1cde385c2657172b75676ff63a47d4cb091651b354fea50a1383aedb4caa06b7"} Jul 14 15:11:08.262707 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.262680 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerStarted","Data":"5241ba27c4f390753deb45e52edc526c7ae91a997725aca0924b11ee0cae658d"} Jul 14 15:11:08.262763 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.262729 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerStarted","Data":"b2f7cf33926b48ffe295ddda4cf48579f65c429f1087d52b492fbe205f4e2ec6"} Jul 14 15:11:08.262810 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.262765 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerDied","Data":"02133371d518b7f6f62ee29a5a7268f461c67f7ead00a33ee7d8cb49368d1413"} Jul 14 15:11:08.263896 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.263876 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lw6jr" event={"ID":"08381f7b-eb19-46f4-8dd8-c31838717d54","Type":"ContainerStarted","Data":"1da11d8f4058add47b4f56d8f25ca1e7d94f7e3adc8548fed9914e82af07e2cc"} Jul 14 15:11:08.265166 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.265148 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" event={"ID":"744d690d-0ef8-41a2-b217-dd157b89a70b","Type":"ContainerStarted","Data":"f029d3bb72e5bdb623f59ce681e897d685a396aa6b5d50ec905600c8de2a2762"} Jul 14 15:11:08.266339 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.266320 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l88r6" event={"ID":"95da5e03-b6f6-4810-8bb7-46bae5485eac","Type":"ContainerStarted","Data":"611be2f12188ee16aa05e208664121442ac626f22ceb45e1c934163ec066db2f"} Jul 14 15:11:08.267621 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.267602 2583 generic.go:356] "Generic (PLEG): container finished" podID="e93c6e449763431a56e463a7fa12382c" containerID="7b38d457d259608ccb832bd9fd40b11501c5372941e916b8b634d30eb5976fe6" exitCode=0 Jul 14 15:11:08.267710 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.267682 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" event={"ID":"e93c6e449763431a56e463a7fa12382c","Type":"ContainerDied","Data":"7b38d457d259608ccb832bd9fd40b11501c5372941e916b8b634d30eb5976fe6"} Jul 14 15:11:08.324979 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.324937 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dkl65" podStartSLOduration=4.49654637 podStartE2EDuration="23.324923238s" totalImagesPullingTime="18.828376868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:08.310145389 +0000 UTC m=+23.619263851" watchObservedRunningTime="2026-07-14 15:11:08.324923238 +0000 UTC m=+23.634041722" Jul 14 15:11:08.325186 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.325167 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lw6jr" podStartSLOduration=4.494842326 podStartE2EDuration="23.325162912s" totalImagesPullingTime="18.830320586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:08.324883161 +0000 UTC m=+23.634001587" watchObservedRunningTime="2026-07-14 15:11:08.325162912 +0000 UTC m=+23.634281338" Jul 14 15:11:08.340803 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.340767 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tnqvx" podStartSLOduration=14.997761236 podStartE2EDuration="24.340756079s" totalImagesPullingTime="9.342994843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:08.340274174 +0000 UTC m=+23.649392604" watchObservedRunningTime="2026-07-14 15:11:08.340756079 +0000 UTC m=+23.649874547" Jul 14 15:11:08.356099 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.356058 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l88r6" podStartSLOduration=5.845263843 podStartE2EDuration="24.356047112s" totalImagesPullingTime="18.510783269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:08.355629261 +0000 UTC m=+23.664747686" watchObservedRunningTime="2026-07-14 15:11:08.356047112 +0000 UTC m=+23.665165538" Jul 14 15:11:08.464770 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.464737 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:08.534633 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.534593 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 15:11:08.541020 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:08.540990 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:09.004254 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.004141 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:09.071197 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.071045 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T15:11:08.534609741Z","UUID":"0fee1b5a-a799-4e6f-b5d4-d9d8a77e7843","Handler":null,"Name":"","Endpoint":""} Jul 14 15:11:09.072736 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.072709 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 15:11:09.072863 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.072751 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 15:11:09.103049 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.103021 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:09.188259 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.188238 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:09.188414 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:09.188349 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:09.188486 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.188456 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:09.188614 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:09.188590 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:09.272607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.272531 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" event={"ID":"744d690d-0ef8-41a2-b217-dd157b89a70b","Type":"ContainerStarted","Data":"d35ccb6d8cb4eabcb93d6e28783f3fea5a9aad0d225938ba733769fc0b228b30"} Jul 14 15:11:09.274909 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.274867 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" event={"ID":"e93c6e449763431a56e463a7fa12382c","Type":"ContainerStarted","Data":"d9c48abcb70f08c7bb9b8d6cbf84b0beeeca9db542b38da616e77c9845b8a3d0"} Jul 14 15:11:09.293299 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.293251 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-4.ec2.internal" podStartSLOduration=23.293233711 podStartE2EDuration="23.293233711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:09.292848725 +0000 UTC m=+24.601967182" watchObservedRunningTime="2026-07-14 15:11:09.293233711 +0000 UTC m=+24.602352138" Jul 14 15:11:09.566239 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:09.566147 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:11:10.188881 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:10.188675 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:10.189130 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:10.188990 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:10.279177 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:10.279140 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" event={"ID":"744d690d-0ef8-41a2-b217-dd157b89a70b","Type":"ContainerStarted","Data":"da4f79487a402ff905a0a7778c8c0eed0ce0e5aa467a608b3f6922bfaaff089f"} Jul 14 15:11:10.282524 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:10.282482 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:11:10.282906 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:10.282870 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerStarted","Data":"636440c4fbe73e57b365ff2143955ca698a6f46701eba33ff11b1aeaaa291770"} Jul 14 15:11:10.298124 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:10.298084 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbw89" podStartSLOduration=4.122990468 podStartE2EDuration="25.298071815s" totalImagesPullingTime="21.175081347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:10.297823557 +0000 UTC m=+25.606942008" watchObservedRunningTime="2026-07-14 15:11:10.298071815 +0000 UTC m=+25.607190238" Jul 14 15:11:11.188416 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:11.188388 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:11.188416 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:11.188412 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:11.188658 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:11.188532 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:11.188658 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:11.188612 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:11.808951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:11.808918 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:11:11.809668 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:11.809645 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:11:11.984102 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:11.984071 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:12.189044 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:12.189018 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:12.189221 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:12.189124 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:12.286996 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:12.286970 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dkl65" Jul 14 15:11:12.350059 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:12.350032 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:12.973056 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:12.972848 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:13.074083 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.074008 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:13.175195 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.175169 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:13.188198 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.188176 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:13.188283 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:13.188266 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:13.188389 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.188373 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:13.188526 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:13.188487 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:13.291753 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.291733 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:11:13.292115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.292089 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerStarted","Data":"5203ad1446cd7d29414fd6451f9cdd4b44e86b1c6e8444955d903f2102ead28e"} Jul 14 15:11:13.292239 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.292224 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:11:13.292318 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.292297 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:11:13.292374 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.292347 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:11:13.292527 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.292496 2583 scope.go:117] "RemoveContainer" containerID="02133371d518b7f6f62ee29a5a7268f461c67f7ead00a33ee7d8cb49368d1413" Jul 14 15:11:13.294083 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.294061 2583 generic.go:356] "Generic (PLEG): container finished" podID="a5206e27-331b-4105-be8c-60d1328f9395" containerID="694769bb7da9a22f7c13b8ff9885d5c46daacd9215dbefacbc86715866c1281e" exitCode=0 Jul 14 15:11:13.294192 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.294147 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mslc2" event={"ID":"a5206e27-331b-4105-be8c-60d1328f9395","Type":"ContainerDied","Data":"694769bb7da9a22f7c13b8ff9885d5c46daacd9215dbefacbc86715866c1281e"} Jul 14 15:11:13.308225 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.308202 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:11:13.311919 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:13.311902 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:11:14.188409 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.188381 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:14.188899 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:14.188523 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:14.300031 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.300006 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:11:14.300416 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.300393 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" event={"ID":"072b5b8f-b490-426e-8718-92587f39635c","Type":"ContainerStarted","Data":"e65c2cf66d9248573834398f3f5150982a03a5ebc771fc42be08bc16136e532e"} Jul 14 15:11:14.710417 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.710211 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" podStartSLOduration=10.495622192 podStartE2EDuration="29.710193502s" totalImagesPullingTime="19.21457131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:14.35216136 +0000 UTC m=+29.661279786" watchObservedRunningTime="2026-07-14 15:11:14.710193502 +0000 UTC m=+30.019311927" Jul 14 15:11:14.710765 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.710748 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l9h2s"] Jul 14 15:11:14.710832 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.710822 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:14.710912 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:14.710897 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:14.712599 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.712530 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7m7vk"] Jul 14 15:11:14.712716 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.712633 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:14.712716 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:14.712705 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:14.713203 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.713186 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n62q5"] Jul 14 15:11:14.713305 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:14.713293 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:14.713417 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:14.713399 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:15.304020 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:15.303993 2583 generic.go:356] "Generic (PLEG): container finished" podID="a5206e27-331b-4105-be8c-60d1328f9395" containerID="656770fa7a65cb7707bc0b1729d57d5c42f4fe79aad127dac5f5fbee32d3fee8" exitCode=0 Jul 14 15:11:15.304468 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:15.304060 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mslc2" event={"ID":"a5206e27-331b-4105-be8c-60d1328f9395","Type":"ContainerDied","Data":"656770fa7a65cb7707bc0b1729d57d5c42f4fe79aad127dac5f5fbee32d3fee8"} Jul 14 15:11:16.188711 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:16.188682 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:16.188820 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:16.188783 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:16.188820 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:16.188798 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:16.188885 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:16.188874 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:16.188932 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:16.188788 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:16.188994 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:16.188944 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:16.309346 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:16.309319 2583 generic.go:356] "Generic (PLEG): container finished" podID="a5206e27-331b-4105-be8c-60d1328f9395" containerID="02eee24224f57ab18dc926f05785a358e24baf4565b10274b22b34304b037e72" exitCode=0 Jul 14 15:11:16.310013 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:16.309369 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mslc2" event={"ID":"a5206e27-331b-4105-be8c-60d1328f9395","Type":"ContainerDied","Data":"02eee24224f57ab18dc926f05785a358e24baf4565b10274b22b34304b037e72"} Jul 14 15:11:16.571444 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:16.571415 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:16.668163 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:16.668136 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:18.188386 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:18.188320 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:18.188386 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:18.188342 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:18.188826 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:18.188320 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:18.188826 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.188423 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n62q5" podUID="732934da-b301-4135-b617-db1319e77b22" Jul 14 15:11:18.188826 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.188569 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m7vk" podUID="f6d4e233-b66a-4c0b-9516-c6aa913dd474" Jul 14 15:11:18.188826 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.188668 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l9h2s" podUID="e945306f-6eff-4b20-bf7e-fbd54d8f923b" Jul 14 15:11:18.749684 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:18.749651 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:18.749684 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.749780 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:11:18.750100 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.749839 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs podName:732934da-b301-4135-b617-db1319e77b22 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:50.749822066 +0000 UTC m=+66.058940472 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs") pod "network-metrics-daemon-n62q5" (UID: "732934da-b301-4135-b617-db1319e77b22") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 15:11:18.850198 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:18.850163 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:18.850328 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.850296 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 15:11:18.850368 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.850351 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret podName:e945306f-6eff-4b20-bf7e-fbd54d8f923b nodeName:}" failed. No retries permitted until 2026-07-14 15:11:50.85033527 +0000 UTC m=+66.159453683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret") pod "global-pull-secret-syncer-l9h2s" (UID: "e945306f-6eff-4b20-bf7e-fbd54d8f923b") : object "kube-system"/"original-pull-secret" not registered Jul 14 15:11:18.950677 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:18.950650 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:18.950798 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.950776 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 15:11:18.950798 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.950788 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 15:11:18.950798 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.950798 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9n24n for pod openshift-network-diagnostics/network-check-target-7m7vk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:11:18.950913 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:18.950837 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n podName:f6d4e233-b66a-4c0b-9516-c6aa913dd474 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:50.950825651 +0000 UTC m=+66.259944056 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9n24n" (UniqueName: "kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n") pod "network-check-target-7m7vk" (UID: "f6d4e233-b66a-4c0b-9516-c6aa913dd474") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 15:11:19.537817 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.537612 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-4.ec2.internal" event="NodeReady" Jul 14 15:11:19.538157 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.537930 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 15:11:19.590021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.589993 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mw8jr"] Jul 14 15:11:19.594097 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.594077 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kr2kb"] Jul 14 15:11:19.594215 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.594197 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.596865 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.596846 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kr2kb" Jul 14 15:11:19.604998 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.604980 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 15:11:19.619312 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.619176 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 15:11:19.619312 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.619206 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 15:11:19.619312 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.619247 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 15:11:19.619312 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.619296 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 15:11:19.619710 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.619688 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xkwnw\"" Jul 14 15:11:19.628748 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.628722 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlfph\"" Jul 14 15:11:19.646992 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.646968 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kr2kb"] Jul 14 15:11:19.647825 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.647802 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mw8jr"] Jul 14 15:11:19.754871 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.754775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvnh\" (UniqueName: \"kubernetes.io/projected/7c3b2da0-c21a-497c-9850-ed0363bf823a-kube-api-access-zvvnh\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.754871 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.754832 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bd375ca-1be0-4c01-a6b4-b86d75e506a9-cert\") pod \"ingress-canary-kr2kb\" (UID: \"0bd375ca-1be0-4c01-a6b4-b86d75e506a9\") " pod="openshift-ingress-canary/ingress-canary-kr2kb" Jul 14 15:11:19.755035 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.754898 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.755035 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.754922 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3b2da0-c21a-497c-9850-ed0363bf823a-tmp-dir\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.755035 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.754946 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t79c\" (UniqueName: \"kubernetes.io/projected/0bd375ca-1be0-4c01-a6b4-b86d75e506a9-kube-api-access-2t79c\") pod \"ingress-canary-kr2kb\" (UID: \"0bd375ca-1be0-4c01-a6b4-b86d75e506a9\") " pod="openshift-ingress-canary/ingress-canary-kr2kb" Jul 14 15:11:19.755035 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.754987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c3b2da0-c21a-497c-9850-ed0363bf823a-config-volume\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.856257 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.856230 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.856400 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.856262 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3b2da0-c21a-497c-9850-ed0363bf823a-tmp-dir\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.856400 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.856281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t79c\" (UniqueName: \"kubernetes.io/projected/0bd375ca-1be0-4c01-a6b4-b86d75e506a9-kube-api-access-2t79c\") pod \"ingress-canary-kr2kb\" (UID: \"0bd375ca-1be0-4c01-a6b4-b86d75e506a9\") " pod="openshift-ingress-canary/ingress-canary-kr2kb" Jul 14 15:11:19.856400 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.856299 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c3b2da0-c21a-497c-9850-ed0363bf823a-config-volume\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.856400 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.856360 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvnh\" (UniqueName: \"kubernetes.io/projected/7c3b2da0-c21a-497c-9850-ed0363bf823a-kube-api-access-zvvnh\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.856697 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:19.856400 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:19.856697 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:19.856480 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls podName:7c3b2da0-c21a-497c-9850-ed0363bf823a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:20.356455863 +0000 UTC m=+35.665574275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls") pod "dns-default-mw8jr" (UID: "7c3b2da0-c21a-497c-9850-ed0363bf823a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:19.856697 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.856405 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bd375ca-1be0-4c01-a6b4-b86d75e506a9-cert\") pod \"ingress-canary-kr2kb\" (UID: \"0bd375ca-1be0-4c01-a6b4-b86d75e506a9\") " pod="openshift-ingress-canary/ingress-canary-kr2kb" Jul 14 15:11:19.856697 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.856637 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c3b2da0-c21a-497c-9850-ed0363bf823a-tmp-dir\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.856999 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.856970 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c3b2da0-c21a-497c-9850-ed0363bf823a-config-volume\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.861087 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.861067 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bd375ca-1be0-4c01-a6b4-b86d75e506a9-cert\") pod \"ingress-canary-kr2kb\" (UID: \"0bd375ca-1be0-4c01-a6b4-b86d75e506a9\") " pod="openshift-ingress-canary/ingress-canary-kr2kb" Jul 14 15:11:19.868338 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.868295 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvnh\" (UniqueName: \"kubernetes.io/projected/7c3b2da0-c21a-497c-9850-ed0363bf823a-kube-api-access-zvvnh\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:19.868478 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.868455 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t79c\" (UniqueName: \"kubernetes.io/projected/0bd375ca-1be0-4c01-a6b4-b86d75e506a9-kube-api-access-2t79c\") pod \"ingress-canary-kr2kb\" (UID: \"0bd375ca-1be0-4c01-a6b4-b86d75e506a9\") " pod="openshift-ingress-canary/ingress-canary-kr2kb" Jul 14 15:11:19.911634 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:19.911612 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kr2kb" Jul 14 15:11:20.188402 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.188368 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:20.188596 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.188414 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:20.188596 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.188368 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:20.191735 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.191715 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 15:11:20.191869 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.191715 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pkcw\"" Jul 14 15:11:20.191869 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.191789 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 15:11:20.192643 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.192622 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 15:11:20.192738 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.192673 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 15:11:20.192738 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.192679 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5qssq\"" Jul 14 15:11:20.360281 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.360248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:20.360433 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:20.360364 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:20.360433 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:20.360414 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls podName:7c3b2da0-c21a-497c-9850-ed0363bf823a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:21.360400768 +0000 UTC m=+36.669519172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls") pod "dns-default-mw8jr" (UID: "7c3b2da0-c21a-497c-9850-ed0363bf823a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:20.668541 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:20.668517 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kr2kb"] Jul 14 15:11:20.752605 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:20.752580 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd375ca_1be0_4c01_a6b4_b86d75e506a9.slice/crio-5fd9eff9f76d2a447df4bdd177b2fd4908a4e48045c8c7a32f3a976ea275803c WatchSource:0}: Error finding container 5fd9eff9f76d2a447df4bdd177b2fd4908a4e48045c8c7a32f3a976ea275803c: Status 404 returned error can't find the container with id 5fd9eff9f76d2a447df4bdd177b2fd4908a4e48045c8c7a32f3a976ea275803c Jul 14 15:11:21.322767 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:21.322522 2583 generic.go:356] "Generic (PLEG): container finished" podID="a5206e27-331b-4105-be8c-60d1328f9395" containerID="a407e12cfa7b9ffb0583e7ed7b71de512780fe21ae0fa2957e92213487f3a302" exitCode=0 Jul 14 15:11:21.322873 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:21.322602 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mslc2" event={"ID":"a5206e27-331b-4105-be8c-60d1328f9395","Type":"ContainerDied","Data":"a407e12cfa7b9ffb0583e7ed7b71de512780fe21ae0fa2957e92213487f3a302"} Jul 14 15:11:21.324003 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:21.323982 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kr2kb" event={"ID":"0bd375ca-1be0-4c01-a6b4-b86d75e506a9","Type":"ContainerStarted","Data":"5fd9eff9f76d2a447df4bdd177b2fd4908a4e48045c8c7a32f3a976ea275803c"} Jul 14 15:11:21.366718 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:21.366699 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:21.366823 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:21.366806 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:21.366885 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:21.366874 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls podName:7c3b2da0-c21a-497c-9850-ed0363bf823a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:23.366856623 +0000 UTC m=+38.675975027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls") pod "dns-default-mw8jr" (UID: "7c3b2da0-c21a-497c-9850-ed0363bf823a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:22.328427 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.328385 2583 generic.go:356] "Generic (PLEG): container finished" podID="a5206e27-331b-4105-be8c-60d1328f9395" containerID="fc6f26f3d7c91c84420c00ba3a27bff83e1e3c14d451e2dd4686f06f6de3b981" exitCode=0 Jul 14 15:11:22.328791 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.328450 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mslc2" event={"ID":"a5206e27-331b-4105-be8c-60d1328f9395","Type":"ContainerDied","Data":"fc6f26f3d7c91c84420c00ba3a27bff83e1e3c14d451e2dd4686f06f6de3b981"} Jul 14 15:11:22.745279 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.745249 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7bwf9"] Jul 14 15:11:22.781079 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.781051 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7bwf9"] Jul 14 15:11:22.781232 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.781182 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.783742 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.783723 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 15:11:22.783879 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.783816 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 15:11:22.783936 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.783818 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 15:11:22.783991 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.783818 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmzk8\"" Jul 14 15:11:22.784160 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.784143 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 15:11:22.877941 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.877915 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.878066 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.877945 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45jk\" (UniqueName: \"kubernetes.io/projected/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-api-access-j45jk\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.878066 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.877993 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-data-volume\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.878066 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.878045 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.878190 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.878106 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-crio-socket\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.979057 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.979027 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-data-volume\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.979214 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.979075 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.979214 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.979112 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-crio-socket\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.979214 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.979160 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.979214 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.979187 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45jk\" (UniqueName: \"kubernetes.io/projected/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-api-access-j45jk\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.979418 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:22.979273 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:22.979418 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:22.979348 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:23.479325682 +0000 UTC m=+38.788444099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:22.979418 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:22.979283 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:22.979418 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.979398 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-crio-socket\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.979637 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.979416 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-data-volume\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:22.979637 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:22.979426 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:23.47940836 +0000 UTC m=+38.788526789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : configmap "kube-rbac-proxy" not found Jul 14 15:11:22.990544 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:22.990516 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45jk\" (UniqueName: \"kubernetes.io/projected/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-api-access-j45jk\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:23.335394 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:23.335359 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mslc2" event={"ID":"a5206e27-331b-4105-be8c-60d1328f9395","Type":"ContainerStarted","Data":"f671a30f726d1e87e70eec00b184de2fca911011a1598a1d32843209ace79dc3"} Jul 14 15:11:23.364026 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:23.363971 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mslc2" podStartSLOduration=10.014494024 podStartE2EDuration="39.363956894s" totalImagesPullingTime="29.34946287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:23.362645364 +0000 UTC m=+38.671763825" watchObservedRunningTime="2026-07-14 15:11:23.363956894 +0000 UTC m=+38.673075319" Jul 14 15:11:23.383093 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:23.383062 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:23.383249 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:23.383184 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:23.383249 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:23.383246 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls podName:7c3b2da0-c21a-497c-9850-ed0363bf823a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:27.38322892 +0000 UTC m=+42.692347329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls") pod "dns-default-mw8jr" (UID: "7c3b2da0-c21a-497c-9850-ed0363bf823a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:23.484019 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:23.483994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:23.484165 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:23.484068 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:23.484165 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:23.484155 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:23.484281 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:23.484200 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:24.484189467 +0000 UTC m=+39.793307870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:23.484338 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:23.484322 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:23.484407 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:23.484394 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:24.484364487 +0000 UTC m=+39.793482951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : configmap "kube-rbac-proxy" not found Jul 14 15:11:24.339087 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.339056 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kr2kb" event={"ID":"0bd375ca-1be0-4c01-a6b4-b86d75e506a9","Type":"ContainerStarted","Data":"f7511d30aaf7e93e150639b66d8310eff31eec062f8347a1b10f67460055a151"} Jul 14 15:11:24.357642 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.357603 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kr2kb" podStartSLOduration=2.320396661 podStartE2EDuration="5.357588235s" totalImagesPullingTime="3.037191574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:24.356752673 +0000 UTC m=+39.665871093" watchObservedRunningTime="2026-07-14 15:11:24.357588235 +0000 UTC m=+39.666706660" Jul 14 15:11:24.402197 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.402172 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv"] Jul 14 15:11:24.416713 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.416694 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv" Jul 14 15:11:24.419951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.419818 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 15:11:24.419951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.419840 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7fflm\"" Jul 14 15:11:24.419951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.419900 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:11:24.420130 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.420060 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv"] Jul 14 15:11:24.492949 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.492674 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:24.492949 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:24.492736 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:24.492949 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.492785 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:24.492949 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:24.492815 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:26.492796478 +0000 UTC m=+41.801914901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : configmap "kube-rbac-proxy" not found Jul 14 15:11:24.492949 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:24.492867 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:24.492949 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:24.492924 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:26.492908177 +0000 UTC m=+41.802026583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:24.506649 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.506629 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z"] Jul 14 15:11:24.529819 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.529775 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l88r6_95da5e03-b6f6-4810-8bb7-46bae5485eac/dns-node-resolver/0.log" Jul 14 15:11:24.532606 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.532589 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z"] Jul 14 15:11:24.532678 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.532668 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:24.535258 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.535239 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:11:24.535354 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.535273 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 15:11:24.535422 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.535403 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jnq6p\"" Jul 14 15:11:24.535422 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.535413 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 15:11:24.593425 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.593399 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmvql\" (UniqueName: \"kubernetes.io/projected/89ca2fcb-7311-480a-9927-57cad1818f65-kube-api-access-pmvql\") pod \"volume-data-source-validator-78495597f6-t6sfv\" (UID: \"89ca2fcb-7311-480a-9927-57cad1818f65\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv" Jul 14 15:11:24.694811 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.694675 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb844\" (UniqueName: \"kubernetes.io/projected/03684fc7-9207-44f2-bbc2-bfac7f89ece9-kube-api-access-hb844\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:24.694892 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.694853 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmvql\" (UniqueName: \"kubernetes.io/projected/89ca2fcb-7311-480a-9927-57cad1818f65-kube-api-access-pmvql\") pod \"volume-data-source-validator-78495597f6-t6sfv\" (UID: \"89ca2fcb-7311-480a-9927-57cad1818f65\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv" Jul 14 15:11:24.694949 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.694901 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:24.702871 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.702850 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmvql\" (UniqueName: \"kubernetes.io/projected/89ca2fcb-7311-480a-9927-57cad1818f65-kube-api-access-pmvql\") pod \"volume-data-source-validator-78495597f6-t6sfv\" (UID: \"89ca2fcb-7311-480a-9927-57cad1818f65\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv" Jul 14 15:11:24.727067 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.727048 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv" Jul 14 15:11:24.795519 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.795477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:24.795647 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.795530 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb844\" (UniqueName: \"kubernetes.io/projected/03684fc7-9207-44f2-bbc2-bfac7f89ece9-kube-api-access-hb844\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:24.795647 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:24.795610 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 15:11:24.795749 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:24.795683 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls podName:03684fc7-9207-44f2-bbc2-bfac7f89ece9 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:25.295664899 +0000 UTC m=+40.604783326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls") pod "cluster-samples-operator-65db858894-46r6z" (UID: "03684fc7-9207-44f2-bbc2-bfac7f89ece9") : secret "samples-operator-tls" not found Jul 14 15:11:24.809215 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.809190 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb844\" (UniqueName: \"kubernetes.io/projected/03684fc7-9207-44f2-bbc2-bfac7f89ece9-kube-api-access-hb844\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:24.877951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:24.877921 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv"] Jul 14 15:11:24.881970 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:24.881939 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ca2fcb_7311_480a_9927_57cad1818f65.slice/crio-0da461d5e1ceeed1bf59e6e4a3b983d5d3d55f968050ec91d0adb91ce99ee8c9 WatchSource:0}: Error finding container 0da461d5e1ceeed1bf59e6e4a3b983d5d3d55f968050ec91d0adb91ce99ee8c9: Status 404 returned error can't find the container with id 0da461d5e1ceeed1bf59e6e4a3b983d5d3d55f968050ec91d0adb91ce99ee8c9 Jul 14 15:11:25.299422 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.299398 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:25.299572 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:25.299550 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 15:11:25.299620 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:25.299611 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls podName:03684fc7-9207-44f2-bbc2-bfac7f89ece9 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:26.299596185 +0000 UTC m=+41.608714589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls") pod "cluster-samples-operator-65db858894-46r6z" (UID: "03684fc7-9207-44f2-bbc2-bfac7f89ece9") : secret "samples-operator-tls" not found Jul 14 15:11:25.328814 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.328796 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tnqvx_e8b7ef5b-25a0-4dc7-a490-290e827c172d/node-ca/0.log" Jul 14 15:11:25.342359 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.342336 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv" event={"ID":"89ca2fcb-7311-480a-9927-57cad1818f65","Type":"ContainerStarted","Data":"0da461d5e1ceeed1bf59e6e4a3b983d5d3d55f968050ec91d0adb91ce99ee8c9"} Jul 14 15:11:25.404307 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.404287 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-mmhjl"] Jul 14 15:11:25.434780 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.434759 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mmhjl"] Jul 14 15:11:25.434863 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.434829 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.437378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.437361 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 15:11:25.437617 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.437602 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:11:25.437681 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.437618 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qw2xg\"" Jul 14 15:11:25.437718 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.437619 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 15:11:25.438779 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.438760 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 15:11:25.444564 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.444544 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 15:11:25.600811 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.600766 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-serving-cert\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.600811 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.600793 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8cb\" (UniqueName: \"kubernetes.io/projected/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-kube-api-access-sl8cb\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.600911 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.600878 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-config\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.600911 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.600899 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-trusted-ca\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.701390 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.701374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-serving-cert\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.701459 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.701401 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8cb\" (UniqueName: \"kubernetes.io/projected/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-kube-api-access-sl8cb\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.701524 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.701488 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-config\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.701565 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.701535 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-trusted-ca\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.702117 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.702098 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-config\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.702325 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.702308 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-trusted-ca\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.704165 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.704146 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-serving-cert\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.709832 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.709811 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8cb\" (UniqueName: \"kubernetes.io/projected/e4a182e2-2de6-4d3a-b1c1-4d52c051bd28-kube-api-access-sl8cb\") pod \"console-operator-7866497494-mmhjl\" (UID: \"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28\") " pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.744766 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.744744 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:25.877080 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.877060 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mmhjl"] Jul 14 15:11:25.879851 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:25.879826 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a182e2_2de6_4d3a_b1c1_4d52c051bd28.slice/crio-91d128ea389c6799942691e9755f55473b62c71b117cfad6cffd60a0697898aa WatchSource:0}: Error finding container 91d128ea389c6799942691e9755f55473b62c71b117cfad6cffd60a0697898aa: Status 404 returned error can't find the container with id 91d128ea389c6799942691e9755f55473b62c71b117cfad6cffd60a0697898aa Jul 14 15:11:25.929091 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:25.929065 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kr2kb_0bd375ca-1be0-4c01-a6b4-b86d75e506a9/serve-healthcheck-canary/0.log" Jul 14 15:11:26.305841 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.305775 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:26.305965 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:26.305901 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 15:11:26.305965 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:26.305946 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls podName:03684fc7-9207-44f2-bbc2-bfac7f89ece9 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:28.30593381 +0000 UTC m=+43.615052215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls") pod "cluster-samples-operator-65db858894-46r6z" (UID: "03684fc7-9207-44f2-bbc2-bfac7f89ece9") : secret "samples-operator-tls" not found Jul 14 15:11:26.345932 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.345904 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mmhjl" event={"ID":"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28","Type":"ContainerStarted","Data":"91d128ea389c6799942691e9755f55473b62c71b117cfad6cffd60a0697898aa"} Jul 14 15:11:26.416204 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.416179 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb"] Jul 14 15:11:26.447840 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.447815 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.447840 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.447819 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6"] Jul 14 15:11:26.450730 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.450709 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 15:11:26.450823 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.450729 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:11:26.450823 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.450752 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-b4rbs\"" Jul 14 15:11:26.450966 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.450950 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 15:11:26.451093 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.451075 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 15:11:26.466069 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.466052 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6"] Jul 14 15:11:26.466135 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.466079 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb"] Jul 14 15:11:26.466180 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.466135 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.469077 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.469058 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 15:11:26.469244 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.469229 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 15:11:26.469375 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.469359 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 15:11:26.469445 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.469411 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:11:26.469554 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.469537 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wmvzl\"" Jul 14 15:11:26.506650 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.506626 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:26.506726 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.506685 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:26.506776 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:26.506762 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:26.506811 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:26.506778 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:26.506847 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:26.506824 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:30.506802889 +0000 UTC m=+45.815921308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:26.506886 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:26.506857 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:30.50684553 +0000 UTC m=+45.815963933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : configmap "kube-rbac-proxy" not found Jul 14 15:11:26.607697 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.607643 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13a08c00-c3d1-4b6e-acfe-f16bc76b5406-config\") pod \"service-ca-operator-7695fc6c8c-p4zpb\" (UID: \"13a08c00-c3d1-4b6e-acfe-f16bc76b5406\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.607697 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.607677 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9c9h\" (UniqueName: \"kubernetes.io/projected/13a08c00-c3d1-4b6e-acfe-f16bc76b5406-kube-api-access-q9c9h\") pod \"service-ca-operator-7695fc6c8c-p4zpb\" (UID: \"13a08c00-c3d1-4b6e-acfe-f16bc76b5406\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.607819 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.607738 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c6ebeba-e9b2-4e7f-b7e6-3acee821b686-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xs9k6\" (UID: \"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.607870 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.607830 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqld8\" (UniqueName: \"kubernetes.io/projected/2c6ebeba-e9b2-4e7f-b7e6-3acee821b686-kube-api-access-qqld8\") pod \"kube-storage-version-migrator-operator-799cb7f958-xs9k6\" (UID: \"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.607870 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.607863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13a08c00-c3d1-4b6e-acfe-f16bc76b5406-serving-cert\") pod \"service-ca-operator-7695fc6c8c-p4zpb\" (UID: \"13a08c00-c3d1-4b6e-acfe-f16bc76b5406\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.607940 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.607886 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c6ebeba-e9b2-4e7f-b7e6-3acee821b686-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xs9k6\" (UID: \"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.708806 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.708776 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13a08c00-c3d1-4b6e-acfe-f16bc76b5406-config\") pod \"service-ca-operator-7695fc6c8c-p4zpb\" (UID: \"13a08c00-c3d1-4b6e-acfe-f16bc76b5406\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.708936 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.708818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9c9h\" (UniqueName: \"kubernetes.io/projected/13a08c00-c3d1-4b6e-acfe-f16bc76b5406-kube-api-access-q9c9h\") pod \"service-ca-operator-7695fc6c8c-p4zpb\" (UID: \"13a08c00-c3d1-4b6e-acfe-f16bc76b5406\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.708936 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.708868 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c6ebeba-e9b2-4e7f-b7e6-3acee821b686-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xs9k6\" (UID: \"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.709596 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.709571 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13a08c00-c3d1-4b6e-acfe-f16bc76b5406-config\") pod \"service-ca-operator-7695fc6c8c-p4zpb\" (UID: \"13a08c00-c3d1-4b6e-acfe-f16bc76b5406\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.709709 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.709684 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqld8\" (UniqueName: \"kubernetes.io/projected/2c6ebeba-e9b2-4e7f-b7e6-3acee821b686-kube-api-access-qqld8\") pod \"kube-storage-version-migrator-operator-799cb7f958-xs9k6\" (UID: \"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.709835 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.709734 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13a08c00-c3d1-4b6e-acfe-f16bc76b5406-serving-cert\") pod \"service-ca-operator-7695fc6c8c-p4zpb\" (UID: \"13a08c00-c3d1-4b6e-acfe-f16bc76b5406\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.709835 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.709770 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c6ebeba-e9b2-4e7f-b7e6-3acee821b686-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xs9k6\" (UID: \"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.710324 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.710296 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c6ebeba-e9b2-4e7f-b7e6-3acee821b686-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xs9k6\" (UID: \"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.712092 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.712051 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c6ebeba-e9b2-4e7f-b7e6-3acee821b686-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xs9k6\" (UID: \"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.712610 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.712585 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13a08c00-c3d1-4b6e-acfe-f16bc76b5406-serving-cert\") pod \"service-ca-operator-7695fc6c8c-p4zpb\" (UID: \"13a08c00-c3d1-4b6e-acfe-f16bc76b5406\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.718920 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.718896 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqld8\" (UniqueName: \"kubernetes.io/projected/2c6ebeba-e9b2-4e7f-b7e6-3acee821b686-kube-api-access-qqld8\") pod \"kube-storage-version-migrator-operator-799cb7f958-xs9k6\" (UID: \"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.719009 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.718949 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9c9h\" (UniqueName: \"kubernetes.io/projected/13a08c00-c3d1-4b6e-acfe-f16bc76b5406-kube-api-access-q9c9h\") pod \"service-ca-operator-7695fc6c8c-p4zpb\" (UID: \"13a08c00-c3d1-4b6e-acfe-f16bc76b5406\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.757117 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.757091 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" Jul 14 15:11:26.774233 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.774213 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" Jul 14 15:11:26.938223 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.938185 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb"] Jul 14 15:11:26.965166 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:26.965137 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6"] Jul 14 15:11:26.968521 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:26.968475 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6ebeba_e9b2_4e7f_b7e6_3acee821b686.slice/crio-7ba47503190c154efaf7a0857e1f01cede7ff3bd7574538674939940f8a3440f WatchSource:0}: Error finding container 7ba47503190c154efaf7a0857e1f01cede7ff3bd7574538674939940f8a3440f: Status 404 returned error can't find the container with id 7ba47503190c154efaf7a0857e1f01cede7ff3bd7574538674939940f8a3440f Jul 14 15:11:27.350378 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.350321 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" event={"ID":"13a08c00-c3d1-4b6e-acfe-f16bc76b5406","Type":"ContainerStarted","Data":"c0b4375b9ed04bf63ad10679ba3c27ab27c7c2896ac907029c0668e3ae2518e7"} Jul 14 15:11:27.351914 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.351878 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" event={"ID":"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686","Type":"ContainerStarted","Data":"7ba47503190c154efaf7a0857e1f01cede7ff3bd7574538674939940f8a3440f"} Jul 14 15:11:27.387344 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.387316 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f9fb64c4c-c9wp5"] Jul 14 15:11:27.410210 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.410187 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f9fb64c4c-c9wp5"] Jul 14 15:11:27.410335 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.410278 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.413035 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.413017 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 15:11:27.413203 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.413184 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 15:11:27.413325 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.413310 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 15:11:27.413615 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.413602 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-flhw9\"" Jul 14 15:11:27.418728 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.418708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:27.418865 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:27.418849 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:27.418937 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:27.418913 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls podName:7c3b2da0-c21a-497c-9850-ed0363bf823a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:35.418892807 +0000 UTC m=+50.728011216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls") pod "dns-default-mw8jr" (UID: "7c3b2da0-c21a-497c-9850-ed0363bf823a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:27.432636 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.432617 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 15:11:27.519514 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.519470 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsp5n\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-kube-api-access-qsp5n\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.519599 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.519523 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-trusted-ca\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.519698 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.519666 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-image-registry-private-configuration\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.519804 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.519727 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.519804 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.519761 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-bound-sa-token\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.519804 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.519792 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/accfb66a-f258-49c4-a080-2ddda1dff328-ca-trust-extracted\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.519943 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.519828 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-installation-pull-secrets\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.519943 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.519855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-registry-certificates\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621065 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621004 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-image-registry-private-configuration\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621065 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621051 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621211 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621081 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-bound-sa-token\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621211 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621113 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/accfb66a-f258-49c4-a080-2ddda1dff328-ca-trust-extracted\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621211 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621150 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-installation-pull-secrets\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621211 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:27.621170 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:27.621211 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:27.621200 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9fb64c4c-c9wp5: secret "image-registry-tls" not found Jul 14 15:11:27.621444 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:27.621253 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls podName:accfb66a-f258-49c4-a080-2ddda1dff328 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:28.1212349 +0000 UTC m=+43.430353309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls") pod "image-registry-f9fb64c4c-c9wp5" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328") : secret "image-registry-tls" not found Jul 14 15:11:27.621444 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-registry-certificates\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621444 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621365 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsp5n\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-kube-api-access-qsp5n\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621444 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621401 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-trusted-ca\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621689 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621579 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/accfb66a-f258-49c4-a080-2ddda1dff328-ca-trust-extracted\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.621788 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.621767 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-registry-certificates\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.622204 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.622187 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-trusted-ca\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.623363 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.623336 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-image-registry-private-configuration\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.623363 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.623357 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-installation-pull-secrets\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.632041 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.632015 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsp5n\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-kube-api-access-qsp5n\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:27.632117 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:27.632060 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-bound-sa-token\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:28.124343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:28.124298 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:28.124592 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:28.124559 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:28.124592 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:28.124576 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9fb64c4c-c9wp5: secret "image-registry-tls" not found Jul 14 15:11:28.124727 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:28.124649 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls podName:accfb66a-f258-49c4-a080-2ddda1dff328 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:29.124628352 +0000 UTC m=+44.433746759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls") pod "image-registry-f9fb64c4c-c9wp5" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328") : secret "image-registry-tls" not found Jul 14 15:11:28.325987 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:28.325918 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:28.326214 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:28.326105 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 15:11:28.326214 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:28.326204 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls podName:03684fc7-9207-44f2-bbc2-bfac7f89ece9 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:32.326180468 +0000 UTC m=+47.635298895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls") pod "cluster-samples-operator-65db858894-46r6z" (UID: "03684fc7-9207-44f2-bbc2-bfac7f89ece9") : secret "samples-operator-tls" not found Jul 14 15:11:29.134788 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:29.134764 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:29.135096 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:29.134880 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:29.135096 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:29.134891 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9fb64c4c-c9wp5: secret "image-registry-tls" not found Jul 14 15:11:29.135096 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:29.134941 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls podName:accfb66a-f258-49c4-a080-2ddda1dff328 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:31.134924895 +0000 UTC m=+46.444043299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls") pod "image-registry-f9fb64c4c-c9wp5" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328") : secret "image-registry-tls" not found Jul 14 15:11:29.358622 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:29.358597 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/0.log" Jul 14 15:11:29.358768 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:29.358638 2583 generic.go:356] "Generic (PLEG): container finished" podID="e4a182e2-2de6-4d3a-b1c1-4d52c051bd28" containerID="e0edc03df30defbcd18cb0904e1f248b51f8bda1fa5fae69c6873658291db8a9" exitCode=255 Jul 14 15:11:29.358768 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:29.358739 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mmhjl" event={"ID":"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28","Type":"ContainerDied","Data":"e0edc03df30defbcd18cb0904e1f248b51f8bda1fa5fae69c6873658291db8a9"} Jul 14 15:11:29.359024 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:29.359004 2583 scope.go:117] "RemoveContainer" containerID="e0edc03df30defbcd18cb0904e1f248b51f8bda1fa5fae69c6873658291db8a9" Jul 14 15:11:29.360169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:29.360146 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv" event={"ID":"89ca2fcb-7311-480a-9927-57cad1818f65","Type":"ContainerStarted","Data":"3eb933c6a85390a222dd8fe7da272e769e38325514d7f9b5810e2164028b5263"} Jul 14 15:11:29.392976 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:29.392887 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t6sfv" podStartSLOduration=1.7935952149999999 podStartE2EDuration="5.39287399s" totalImagesPullingTime="3.599278775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:29.392291321 +0000 UTC m=+44.701409758" watchObservedRunningTime="2026-07-14 15:11:29.39287399 +0000 UTC m=+44.701992417" Jul 14 15:11:30.544420 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:30.544388 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:30.544831 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:30.544449 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:30.544831 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:30.544535 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:30.544831 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:30.544597 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:38.54458269 +0000 UTC m=+53.853701094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:30.544831 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:30.544543 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 15:11:30.544831 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:30.544668 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:38.544656098 +0000 UTC m=+53.853774502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : configmap "kube-rbac-proxy" not found Jul 14 15:11:31.149197 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.149163 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:31.149350 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:31.149307 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:31.149350 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:31.149325 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9fb64c4c-c9wp5: secret "image-registry-tls" not found Jul 14 15:11:31.149461 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:31.149376 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls podName:accfb66a-f258-49c4-a080-2ddda1dff328 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:35.149358244 +0000 UTC m=+50.458476648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls") pod "image-registry-f9fb64c4c-c9wp5" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328") : secret "image-registry-tls" not found Jul 14 15:11:31.368314 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.368292 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:11:31.368709 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.368694 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/0.log" Jul 14 15:11:31.368793 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.368726 2583 generic.go:356] "Generic (PLEG): container finished" podID="e4a182e2-2de6-4d3a-b1c1-4d52c051bd28" containerID="6b9796a57890ff3dcf4f487fdf7b38021c9081da56f720ac45c051b137cce37c" exitCode=255 Jul 14 15:11:31.368793 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.368780 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mmhjl" event={"ID":"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28","Type":"ContainerDied","Data":"6b9796a57890ff3dcf4f487fdf7b38021c9081da56f720ac45c051b137cce37c"} Jul 14 15:11:31.368896 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.368837 2583 scope.go:117] "RemoveContainer" containerID="e0edc03df30defbcd18cb0904e1f248b51f8bda1fa5fae69c6873658291db8a9" Jul 14 15:11:31.369081 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.369052 2583 scope.go:117] "RemoveContainer" containerID="6b9796a57890ff3dcf4f487fdf7b38021c9081da56f720ac45c051b137cce37c" Jul 14 15:11:31.369248 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:31.369216 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mmhjl_openshift-console-operator(e4a182e2-2de6-4d3a-b1c1-4d52c051bd28)\"" pod="openshift-console-operator/console-operator-7866497494-mmhjl" podUID="e4a182e2-2de6-4d3a-b1c1-4d52c051bd28" Jul 14 15:11:31.370430 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.370405 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" event={"ID":"13a08c00-c3d1-4b6e-acfe-f16bc76b5406","Type":"ContainerStarted","Data":"f406ff8169dde4942e274b9fae087c7cee19977cdd12c9652fc51b2ecbdead61"} Jul 14 15:11:31.371931 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.371906 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" event={"ID":"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686","Type":"ContainerStarted","Data":"e16039a81b13dc5ae236f9ff63b6d63b4638a281c0acd9b7a1c0570fa9ea8f43"} Jul 14 15:11:31.406738 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.406663 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" podStartSLOduration=1.5046137050000001 podStartE2EDuration="5.406648042s" totalImagesPullingTime="3.902034337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:31.406358764 +0000 UTC m=+46.715477191" watchObservedRunningTime="2026-07-14 15:11:31.406648042 +0000 UTC m=+46.715766468" Jul 14 15:11:31.422793 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:31.422757 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" podStartSLOduration=1.497850304 podStartE2EDuration="5.42274433s" totalImagesPullingTime="3.924894026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:31.421942707 +0000 UTC m=+46.731061133" watchObservedRunningTime="2026-07-14 15:11:31.42274433 +0000 UTC m=+46.731862793" Jul 14 15:11:32.357287 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:32.357257 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:32.357650 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:32.357375 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 15:11:32.357650 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:32.357432 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls podName:03684fc7-9207-44f2-bbc2-bfac7f89ece9 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:40.357417577 +0000 UTC m=+55.666535981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls") pod "cluster-samples-operator-65db858894-46r6z" (UID: "03684fc7-9207-44f2-bbc2-bfac7f89ece9") : secret "samples-operator-tls" not found Jul 14 15:11:32.379888 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:32.379864 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:11:32.380158 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:32.380143 2583 scope.go:117] "RemoveContainer" containerID="6b9796a57890ff3dcf4f487fdf7b38021c9081da56f720ac45c051b137cce37c" Jul 14 15:11:32.380313 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:32.380295 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mmhjl_openshift-console-operator(e4a182e2-2de6-4d3a-b1c1-4d52c051bd28)\"" pod="openshift-console-operator/console-operator-7866497494-mmhjl" podUID="e4a182e2-2de6-4d3a-b1c1-4d52c051bd28" Jul 14 15:11:35.174392 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:35.174361 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:35.174824 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:35.174532 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:35.174824 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:35.174553 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9fb64c4c-c9wp5: secret "image-registry-tls" not found Jul 14 15:11:35.174824 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:35.174613 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls podName:accfb66a-f258-49c4-a080-2ddda1dff328 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:43.174594328 +0000 UTC m=+58.483712746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls") pod "image-registry-f9fb64c4c-c9wp5" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328") : secret "image-registry-tls" not found Jul 14 15:11:35.476232 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:35.476163 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:35.476356 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:35.476278 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 15:11:35.476356 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:35.476343 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls podName:7c3b2da0-c21a-497c-9850-ed0363bf823a nodeName:}" failed. No retries permitted until 2026-07-14 15:11:51.476328745 +0000 UTC m=+66.785447163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls") pod "dns-default-mw8jr" (UID: "7c3b2da0-c21a-497c-9850-ed0363bf823a") : secret "dns-default-metrics-tls" not found Jul 14 15:11:35.745344 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:35.745290 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:35.745344 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:35.745335 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:35.745624 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:35.745613 2583 scope.go:117] "RemoveContainer" containerID="6b9796a57890ff3dcf4f487fdf7b38021c9081da56f720ac45c051b137cce37c" Jul 14 15:11:35.745748 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:35.745731 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mmhjl_openshift-console-operator(e4a182e2-2de6-4d3a-b1c1-4d52c051bd28)\"" pod="openshift-console-operator/console-operator-7866497494-mmhjl" podUID="e4a182e2-2de6-4d3a-b1c1-4d52c051bd28" Jul 14 15:11:38.599168 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:38.599133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:38.599594 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:38.599189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:38.599594 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:38.599265 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 15:11:38.599594 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:38.599330 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls podName:dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:54.599315109 +0000 UTC m=+69.908433516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bwf9" (UID: "dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0") : secret "insights-runtime-extractor-tls" not found Jul 14 15:11:38.599723 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:38.599637 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:40.411673 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:40.411647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:40.412020 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:40.411788 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 15:11:40.412020 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:40.411841 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls podName:03684fc7-9207-44f2-bbc2-bfac7f89ece9 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:56.411827639 +0000 UTC m=+71.720946043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls") pod "cluster-samples-operator-65db858894-46r6z" (UID: "03684fc7-9207-44f2-bbc2-bfac7f89ece9") : secret "samples-operator-tls" not found Jul 14 15:11:43.235401 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:43.235368 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls\") pod \"image-registry-f9fb64c4c-c9wp5\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:43.235790 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:43.235516 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 15:11:43.235790 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:43.235534 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f9fb64c4c-c9wp5: secret "image-registry-tls" not found Jul 14 15:11:43.235790 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:43.235581 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls podName:accfb66a-f258-49c4-a080-2ddda1dff328 nodeName:}" failed. No retries permitted until 2026-07-14 15:11:59.235566578 +0000 UTC m=+74.544684982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls") pod "image-registry-f9fb64c4c-c9wp5" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328") : secret "image-registry-tls" not found Jul 14 15:11:45.314222 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:45.314196 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wj4zb" Jul 14 15:11:46.188755 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:46.188730 2583 scope.go:117] "RemoveContainer" containerID="6b9796a57890ff3dcf4f487fdf7b38021c9081da56f720ac45c051b137cce37c" Jul 14 15:11:46.421787 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:46.421765 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:11:46.422138 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:46.421827 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mmhjl" event={"ID":"e4a182e2-2de6-4d3a-b1c1-4d52c051bd28","Type":"ContainerStarted","Data":"3349fe898ecf3314377250047cd1eda188ab85bd419a0b0e06d6238003f992f8"} Jul 14 15:11:46.422138 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:46.422082 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:46.454974 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:46.454886 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-mmhjl" podStartSLOduration=18.515126554 podStartE2EDuration="21.454870152s" totalImagesPullingTime="2.939743598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:46.454663776 +0000 UTC m=+61.763782219" watchObservedRunningTime="2026-07-14 15:11:46.454870152 +0000 UTC m=+61.763988578" Jul 14 15:11:46.639296 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:46.639271 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-mmhjl" Jul 14 15:11:50.789699 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:50.789672 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:50.792452 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:50.792436 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 15:11:50.802724 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:50.802695 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732934da-b301-4135-b617-db1319e77b22-metrics-certs\") pod \"network-metrics-daemon-n62q5\" (UID: \"732934da-b301-4135-b617-db1319e77b22\") " pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:50.890473 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:50.890451 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:50.893166 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:50.893152 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 15:11:50.903046 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:50.903026 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e945306f-6eff-4b20-bf7e-fbd54d8f923b-original-pull-secret\") pod \"global-pull-secret-syncer-l9h2s\" (UID: \"e945306f-6eff-4b20-bf7e-fbd54d8f923b\") " pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:50.991784 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:50.991764 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:50.994261 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:50.994245 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 15:11:51.004649 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.004632 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 15:11:51.014620 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.014605 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n24n\" (UniqueName: \"kubernetes.io/projected/f6d4e233-b66a-4c0b-9516-c6aa913dd474-kube-api-access-9n24n\") pod \"network-check-target-7m7vk\" (UID: \"f6d4e233-b66a-4c0b-9516-c6aa913dd474\") " pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:51.103153 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.103107 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pkcw\"" Jul 14 15:11:51.109653 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.109636 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5qssq\"" Jul 14 15:11:51.111587 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.111565 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n62q5" Jul 14 15:11:51.113744 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.113728 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l9h2s" Jul 14 15:11:51.117862 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.117847 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:51.267760 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.267710 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n62q5"] Jul 14 15:11:51.271381 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:51.271343 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732934da_b301_4135_b617_db1319e77b22.slice/crio-13c14e7784c981a56ea100242639b9a875182c2cd5319114901811b39d2f0723 WatchSource:0}: Error finding container 13c14e7784c981a56ea100242639b9a875182c2cd5319114901811b39d2f0723: Status 404 returned error can't find the container with id 13c14e7784c981a56ea100242639b9a875182c2cd5319114901811b39d2f0723 Jul 14 15:11:51.289961 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.289927 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l9h2s"] Jul 14 15:11:51.292127 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:51.292105 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode945306f_6eff_4b20_bf7e_fbd54d8f923b.slice/crio-2954b8d8393a230849324be36d8e1a1d7816185875148db1454d63a9bd1c5010 WatchSource:0}: Error finding container 2954b8d8393a230849324be36d8e1a1d7816185875148db1454d63a9bd1c5010: Status 404 returned error can't find the container with id 2954b8d8393a230849324be36d8e1a1d7816185875148db1454d63a9bd1c5010 Jul 14 15:11:51.306038 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.306006 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7m7vk"] Jul 14 15:11:51.307744 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:51.307724 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d4e233_b66a_4c0b_9516_c6aa913dd474.slice/crio-6e1ce9988f1496047289b115bc0607ffd8f338792fcb33b409efef03e0fef968 WatchSource:0}: Error finding container 6e1ce9988f1496047289b115bc0607ffd8f338792fcb33b409efef03e0fef968: Status 404 returned error can't find the container with id 6e1ce9988f1496047289b115bc0607ffd8f338792fcb33b409efef03e0fef968 Jul 14 15:11:51.437123 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.437093 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n62q5" event={"ID":"732934da-b301-4135-b617-db1319e77b22","Type":"ContainerStarted","Data":"13c14e7784c981a56ea100242639b9a875182c2cd5319114901811b39d2f0723"} Jul 14 15:11:51.438165 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.438144 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7m7vk" event={"ID":"f6d4e233-b66a-4c0b-9516-c6aa913dd474","Type":"ContainerStarted","Data":"6e1ce9988f1496047289b115bc0607ffd8f338792fcb33b409efef03e0fef968"} Jul 14 15:11:51.439181 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.439162 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l9h2s" event={"ID":"e945306f-6eff-4b20-bf7e-fbd54d8f923b","Type":"ContainerStarted","Data":"2954b8d8393a230849324be36d8e1a1d7816185875148db1454d63a9bd1c5010"} Jul 14 15:11:51.495707 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.495683 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:51.497758 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.497739 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c3b2da0-c21a-497c-9850-ed0363bf823a-metrics-tls\") pod \"dns-default-mw8jr\" (UID: \"7c3b2da0-c21a-497c-9850-ed0363bf823a\") " pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:51.708455 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.708415 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlfph\"" Jul 14 15:11:51.715721 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.715704 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:51.871433 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:51.871405 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mw8jr"] Jul 14 15:11:51.874937 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:51.874893 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3b2da0_c21a_497c_9850_ed0363bf823a.slice/crio-8e5e4d3af76b8531666e5c2a320fad26c62bc28a4b64b8f12f2dc5a3bb208ca6 WatchSource:0}: Error finding container 8e5e4d3af76b8531666e5c2a320fad26c62bc28a4b64b8f12f2dc5a3bb208ca6: Status 404 returned error can't find the container with id 8e5e4d3af76b8531666e5c2a320fad26c62bc28a4b64b8f12f2dc5a3bb208ca6 Jul 14 15:11:52.446738 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:52.446699 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mw8jr" event={"ID":"7c3b2da0-c21a-497c-9850-ed0363bf823a","Type":"ContainerStarted","Data":"8e5e4d3af76b8531666e5c2a320fad26c62bc28a4b64b8f12f2dc5a3bb208ca6"} Jul 14 15:11:54.622235 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:54.622200 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:54.624820 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:54.624737 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bwf9\" (UID: \"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0\") " pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:54.894093 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:54.894063 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmzk8\"" Jul 14 15:11:54.901532 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:54.901491 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7bwf9" Jul 14 15:11:56.436968 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.436930 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:56.439642 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.439614 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03684fc7-9207-44f2-bbc2-bfac7f89ece9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-46r6z\" (UID: \"03684fc7-9207-44f2-bbc2-bfac7f89ece9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:56.548187 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.548102 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2"] Jul 14 15:11:56.551431 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.550947 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" Jul 14 15:11:56.555041 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.555018 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 15:11:56.557189 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.556785 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 15:11:56.557189 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.556810 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 15:11:56.557189 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.556977 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 15:11:56.557189 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.557068 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5j6xt\"" Jul 14 15:11:56.585585 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.585256 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2"] Jul 14 15:11:56.638840 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.638662 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0ba9fd9-3c50-4204-8b9f-547ca0725cd3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5847ccc9fd-z25f2\" (UID: \"a0ba9fd9-3c50-4204-8b9f-547ca0725cd3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" Jul 14 15:11:56.638840 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.638719 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sp7p\" (UniqueName: \"kubernetes.io/projected/a0ba9fd9-3c50-4204-8b9f-547ca0725cd3-kube-api-access-9sp7p\") pod \"managed-serviceaccount-addon-agent-5847ccc9fd-z25f2\" (UID: \"a0ba9fd9-3c50-4204-8b9f-547ca0725cd3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" Jul 14 15:11:56.646265 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.646078 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jnq6p\"" Jul 14 15:11:56.651464 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.651251 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" Jul 14 15:11:56.685477 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.684351 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-k2fzq"] Jul 14 15:11:56.693569 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.692579 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-b5k6z"] Jul 14 15:11:56.694543 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.693851 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" Jul 14 15:11:56.720540 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.708460 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 15:11:56.720540 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.708731 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fwv4x\"" Jul 14 15:11:56.720540 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.708923 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 15:11:56.720540 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.711979 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-b5k6z" Jul 14 15:11:56.720540 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.718927 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7bwf9"] Jul 14 15:11:56.720540 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.718994 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-k2fzq"] Jul 14 15:11:56.721953 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:56.721555 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4e651b_aa06_4c03_bcbf_d090fb1dd8e0.slice/crio-0a8f41f75dd1aee0cb34952588281ea4605bc0f1a2ca498457ce513803340bfd WatchSource:0}: Error finding container 0a8f41f75dd1aee0cb34952588281ea4605bc0f1a2ca498457ce513803340bfd: Status 404 returned error can't find the container with id 0a8f41f75dd1aee0cb34952588281ea4605bc0f1a2ca498457ce513803340bfd Jul 14 15:11:56.721953 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.721733 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wnxwv\"" Jul 14 15:11:56.721953 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.721742 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 15:11:56.721953 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.721770 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 15:11:56.725539 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.723601 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-b5k6z"] Jul 14 15:11:56.725539 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.724632 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f9fb64c4c-c9wp5"] Jul 14 15:11:56.725539 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:11:56.724871 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" podUID="accfb66a-f258-49c4-a080-2ddda1dff328" Jul 14 15:11:56.739233 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.739097 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0ba9fd9-3c50-4204-8b9f-547ca0725cd3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5847ccc9fd-z25f2\" (UID: \"a0ba9fd9-3c50-4204-8b9f-547ca0725cd3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" Jul 14 15:11:56.739233 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.739153 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sp7p\" (UniqueName: \"kubernetes.io/projected/a0ba9fd9-3c50-4204-8b9f-547ca0725cd3-kube-api-access-9sp7p\") pod \"managed-serviceaccount-addon-agent-5847ccc9fd-z25f2\" (UID: \"a0ba9fd9-3c50-4204-8b9f-547ca0725cd3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" Jul 14 15:11:56.739233 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.739221 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed801a8f-da34-4e49-8544-8a726033bd5f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-k2fzq\" (UID: \"ed801a8f-da34-4e49-8544-8a726033bd5f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" Jul 14 15:11:56.739411 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.739251 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed801a8f-da34-4e49-8544-8a726033bd5f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-k2fzq\" (UID: \"ed801a8f-da34-4e49-8544-8a726033bd5f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" Jul 14 15:11:56.744344 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.743927 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0ba9fd9-3c50-4204-8b9f-547ca0725cd3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5847ccc9fd-z25f2\" (UID: \"a0ba9fd9-3c50-4204-8b9f-547ca0725cd3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" Jul 14 15:11:56.759566 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.759480 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sp7p\" (UniqueName: \"kubernetes.io/projected/a0ba9fd9-3c50-4204-8b9f-547ca0725cd3-kube-api-access-9sp7p\") pod \"managed-serviceaccount-addon-agent-5847ccc9fd-z25f2\" (UID: \"a0ba9fd9-3c50-4204-8b9f-547ca0725cd3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" Jul 14 15:11:56.772726 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.771880 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56749f8f64-wjg2c"] Jul 14 15:11:56.776951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.776805 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.792030 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.791970 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56749f8f64-wjg2c"] Jul 14 15:11:56.840477 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840446 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f00781f-f61f-405d-99b8-a5074942d31f-trusted-ca\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.840591 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed801a8f-da34-4e49-8544-8a726033bd5f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-k2fzq\" (UID: \"ed801a8f-da34-4e49-8544-8a726033bd5f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" Jul 14 15:11:56.840591 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840558 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f00781f-f61f-405d-99b8-a5074942d31f-bound-sa-token\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.840711 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840694 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f00781f-f61f-405d-99b8-a5074942d31f-registry-tls\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.840746 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840732 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed801a8f-da34-4e49-8544-8a726033bd5f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-k2fzq\" (UID: \"ed801a8f-da34-4e49-8544-8a726033bd5f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" Jul 14 15:11:56.840778 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840759 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnkfj\" (UniqueName: \"kubernetes.io/projected/016ae7b4-b656-453a-af91-be514f5dcdaf-kube-api-access-rnkfj\") pod \"downloads-68c9cbb497-b5k6z\" (UID: \"016ae7b4-b656-453a-af91-be514f5dcdaf\") " pod="openshift-console/downloads-68c9cbb497-b5k6z" Jul 14 15:11:56.840820 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840806 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wdbd\" (UniqueName: \"kubernetes.io/projected/9f00781f-f61f-405d-99b8-a5074942d31f-kube-api-access-6wdbd\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.840854 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840840 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f00781f-f61f-405d-99b8-a5074942d31f-image-registry-private-configuration\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.840887 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840866 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f00781f-f61f-405d-99b8-a5074942d31f-registry-certificates\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.840941 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.840927 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f00781f-f61f-405d-99b8-a5074942d31f-ca-trust-extracted\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.841021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.841006 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f00781f-f61f-405d-99b8-a5074942d31f-installation-pull-secrets\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.841370 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.841354 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed801a8f-da34-4e49-8544-8a726033bd5f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-k2fzq\" (UID: \"ed801a8f-da34-4e49-8544-8a726033bd5f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" Jul 14 15:11:56.842677 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.842660 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed801a8f-da34-4e49-8544-8a726033bd5f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-k2fzq\" (UID: \"ed801a8f-da34-4e49-8544-8a726033bd5f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" Jul 14 15:11:56.849962 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.849837 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z"] Jul 14 15:11:56.873875 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.873854 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" Jul 14 15:11:56.941355 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941303 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnkfj\" (UniqueName: \"kubernetes.io/projected/016ae7b4-b656-453a-af91-be514f5dcdaf-kube-api-access-rnkfj\") pod \"downloads-68c9cbb497-b5k6z\" (UID: \"016ae7b4-b656-453a-af91-be514f5dcdaf\") " pod="openshift-console/downloads-68c9cbb497-b5k6z" Jul 14 15:11:56.941355 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941351 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wdbd\" (UniqueName: \"kubernetes.io/projected/9f00781f-f61f-405d-99b8-a5074942d31f-kube-api-access-6wdbd\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.941514 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941382 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f00781f-f61f-405d-99b8-a5074942d31f-image-registry-private-configuration\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.941514 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f00781f-f61f-405d-99b8-a5074942d31f-registry-certificates\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.941514 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941453 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f00781f-f61f-405d-99b8-a5074942d31f-ca-trust-extracted\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.941623 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941538 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f00781f-f61f-405d-99b8-a5074942d31f-installation-pull-secrets\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.941623 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941570 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f00781f-f61f-405d-99b8-a5074942d31f-trusted-ca\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.941623 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941598 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f00781f-f61f-405d-99b8-a5074942d31f-bound-sa-token\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.941709 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f00781f-f61f-405d-99b8-a5074942d31f-registry-tls\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.942118 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.941944 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f00781f-f61f-405d-99b8-a5074942d31f-ca-trust-extracted\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.942408 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.942363 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f00781f-f61f-405d-99b8-a5074942d31f-registry-certificates\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.942568 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.942549 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f00781f-f61f-405d-99b8-a5074942d31f-trusted-ca\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.944190 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.944169 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f00781f-f61f-405d-99b8-a5074942d31f-registry-tls\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.944276 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.944205 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f00781f-f61f-405d-99b8-a5074942d31f-image-registry-private-configuration\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.944319 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.944303 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f00781f-f61f-405d-99b8-a5074942d31f-installation-pull-secrets\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.949369 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.949350 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnkfj\" (UniqueName: \"kubernetes.io/projected/016ae7b4-b656-453a-af91-be514f5dcdaf-kube-api-access-rnkfj\") pod \"downloads-68c9cbb497-b5k6z\" (UID: \"016ae7b4-b656-453a-af91-be514f5dcdaf\") " pod="openshift-console/downloads-68c9cbb497-b5k6z" Jul 14 15:11:56.967765 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.967421 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wdbd\" (UniqueName: \"kubernetes.io/projected/9f00781f-f61f-405d-99b8-a5074942d31f-kube-api-access-6wdbd\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:56.969947 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:56.969908 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f00781f-f61f-405d-99b8-a5074942d31f-bound-sa-token\") pod \"image-registry-56749f8f64-wjg2c\" (UID: \"9f00781f-f61f-405d-99b8-a5074942d31f\") " pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:57.018774 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.018747 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2"] Jul 14 15:11:57.021565 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:57.021537 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0ba9fd9_3c50_4204_8b9f_547ca0725cd3.slice/crio-354cb965cfded50c7cb6900f36b4ffc444bf89c05fea8b64cb9bc0628ed561cd WatchSource:0}: Error finding container 354cb965cfded50c7cb6900f36b4ffc444bf89c05fea8b64cb9bc0628ed561cd: Status 404 returned error can't find the container with id 354cb965cfded50c7cb6900f36b4ffc444bf89c05fea8b64cb9bc0628ed561cd Jul 14 15:11:57.026888 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.026872 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" Jul 14 15:11:57.038371 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.038352 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-b5k6z" Jul 14 15:11:57.095089 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.095059 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-flhw9\"" Jul 14 15:11:57.102397 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.102377 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:57.179296 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.179268 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-k2fzq"] Jul 14 15:11:57.182743 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:57.182719 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded801a8f_da34_4e49_8544_8a726033bd5f.slice/crio-07df78a2f36ad54ad383d0ee7263885d574d280b56bb0e4b1f6406524158cc31 WatchSource:0}: Error finding container 07df78a2f36ad54ad383d0ee7263885d574d280b56bb0e4b1f6406524158cc31: Status 404 returned error can't find the container with id 07df78a2f36ad54ad383d0ee7263885d574d280b56bb0e4b1f6406524158cc31 Jul 14 15:11:57.201517 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.201481 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-b5k6z"] Jul 14 15:11:57.203683 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:57.203648 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016ae7b4_b656_453a_af91_be514f5dcdaf.slice/crio-6660d8d4887f4e8cca1aa4be3919e084ee986993a3e810abb762b6074c92219e WatchSource:0}: Error finding container 6660d8d4887f4e8cca1aa4be3919e084ee986993a3e810abb762b6074c92219e: Status 404 returned error can't find the container with id 6660d8d4887f4e8cca1aa4be3919e084ee986993a3e810abb762b6074c92219e Jul 14 15:11:57.252204 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.252178 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56749f8f64-wjg2c"] Jul 14 15:11:57.254884 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:11:57.254857 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f00781f_f61f_405d_99b8_a5074942d31f.slice/crio-2f68e7c6b092e04b143a641ed3c49da51a06a573ab5aea6099e89c3a57f38b19 WatchSource:0}: Error finding container 2f68e7c6b092e04b143a641ed3c49da51a06a573ab5aea6099e89c3a57f38b19: Status 404 returned error can't find the container with id 2f68e7c6b092e04b143a641ed3c49da51a06a573ab5aea6099e89c3a57f38b19 Jul 14 15:11:57.470420 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.470314 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" event={"ID":"03684fc7-9207-44f2-bbc2-bfac7f89ece9","Type":"ContainerStarted","Data":"fcf30693dd60c8740402e9a6928e7db2b2554336fcad2074432472347aa75423"} Jul 14 15:11:57.473058 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.472957 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7bwf9" event={"ID":"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0","Type":"ContainerStarted","Data":"0a8f41f75dd1aee0cb34952588281ea4605bc0f1a2ca498457ce513803340bfd"} Jul 14 15:11:57.475200 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.475050 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7m7vk" event={"ID":"f6d4e233-b66a-4c0b-9516-c6aa913dd474","Type":"ContainerStarted","Data":"cb6162ab6bbdd4e305b09b887e2fbe8c826c94dcdad761e8f44dab7cfc71b444"} Jul 14 15:11:57.475481 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.475433 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:11:57.477712 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.477665 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l9h2s" event={"ID":"e945306f-6eff-4b20-bf7e-fbd54d8f923b","Type":"ContainerStarted","Data":"cbce03f21ee08c467d8ddc081cb7c23845e00942da5e966ac3319afcd6ff99bd"} Jul 14 15:11:57.481392 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.480828 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" event={"ID":"9f00781f-f61f-405d-99b8-a5074942d31f","Type":"ContainerStarted","Data":"181426d5fbdf6fd00476d8ac34118395548c8e2f00e544526aeeefac25f36312"} Jul 14 15:11:57.481392 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.480869 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" event={"ID":"9f00781f-f61f-405d-99b8-a5074942d31f","Type":"ContainerStarted","Data":"2f68e7c6b092e04b143a641ed3c49da51a06a573ab5aea6099e89c3a57f38b19"} Jul 14 15:11:57.481392 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.481343 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:11:57.484711 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.484663 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" event={"ID":"a0ba9fd9-3c50-4204-8b9f-547ca0725cd3","Type":"ContainerStarted","Data":"354cb965cfded50c7cb6900f36b4ffc444bf89c05fea8b64cb9bc0628ed561cd"} Jul 14 15:11:57.488368 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.488340 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mw8jr" event={"ID":"7c3b2da0-c21a-497c-9850-ed0363bf823a","Type":"ContainerStarted","Data":"a28b25255b6d9532d114858142aa3e54f3f38c916c06d79a22601f6e3e642c04"} Jul 14 15:11:57.488484 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.488389 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mw8jr" event={"ID":"7c3b2da0-c21a-497c-9850-ed0363bf823a","Type":"ContainerStarted","Data":"eede6382633e64a7b73e1358751b43d638e85c81de0f6230c28f17e8c511e7fd"} Jul 14 15:11:57.488873 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.488855 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mw8jr" Jul 14 15:11:57.490645 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.490608 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-b5k6z" event={"ID":"016ae7b4-b656-453a-af91-be514f5dcdaf","Type":"ContainerStarted","Data":"6660d8d4887f4e8cca1aa4be3919e084ee986993a3e810abb762b6074c92219e"} Jul 14 15:11:57.492271 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.492212 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" event={"ID":"ed801a8f-da34-4e49-8544-8a726033bd5f","Type":"ContainerStarted","Data":"07df78a2f36ad54ad383d0ee7263885d574d280b56bb0e4b1f6406524158cc31"} Jul 14 15:11:57.495440 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.495110 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7m7vk" podStartSLOduration=67.286101304 podStartE2EDuration="1m12.495094379s" totalImagesPullingTime="5.208993075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:57.494290877 +0000 UTC m=+72.803409304" watchObservedRunningTime="2026-07-14 15:11:57.495094379 +0000 UTC m=+72.804212806" Jul 14 15:11:57.495583 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.495562 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:57.495776 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.495696 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n62q5" event={"ID":"732934da-b301-4135-b617-db1319e77b22","Type":"ContainerStarted","Data":"9ef0c2897102ba2e3994537a9f30fa0c89caf84e47065a1bdd6f32d741ea6293"} Jul 14 15:11:57.495776 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.495746 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n62q5" event={"ID":"732934da-b301-4135-b617-db1319e77b22","Type":"ContainerStarted","Data":"01a4a9e23420866310a48a023f868c27dd848053f9d8b60eead5c3b49b7dcc17"} Jul 14 15:11:57.512445 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.512421 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:57.521992 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.521262 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mw8jr" podStartSLOduration=33.881193443 podStartE2EDuration="38.521244443s" totalImagesPullingTime="4.640051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:57.520880689 +0000 UTC m=+72.829999115" watchObservedRunningTime="2026-07-14 15:11:57.521244443 +0000 UTC m=+72.830362871" Jul 14 15:11:57.545050 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.544980 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" podStartSLOduration=1.544965921 podStartE2EDuration="1.544965921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:57.54449585 +0000 UTC m=+72.853614278" watchObservedRunningTime="2026-07-14 15:11:57.544965921 +0000 UTC m=+72.854084343" Jul 14 15:11:57.547015 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.546624 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsp5n\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-kube-api-access-qsp5n\") pod \"accfb66a-f258-49c4-a080-2ddda1dff328\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " Jul 14 15:11:57.547015 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.546668 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-image-registry-private-configuration\") pod \"accfb66a-f258-49c4-a080-2ddda1dff328\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " Jul 14 15:11:57.547015 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.546714 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-installation-pull-secrets\") pod \"accfb66a-f258-49c4-a080-2ddda1dff328\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " Jul 14 15:11:57.547015 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.546742 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-registry-certificates\") pod \"accfb66a-f258-49c4-a080-2ddda1dff328\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " Jul 14 15:11:57.547314 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.547093 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-trusted-ca\") pod \"accfb66a-f258-49c4-a080-2ddda1dff328\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " Jul 14 15:11:57.547532 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.547437 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "accfb66a-f258-49c4-a080-2ddda1dff328" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:11:57.547532 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.547482 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "accfb66a-f258-49c4-a080-2ddda1dff328" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:11:57.548630 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.547701 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-bound-sa-token\") pod \"accfb66a-f258-49c4-a080-2ddda1dff328\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " Jul 14 15:11:57.548630 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.547753 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/accfb66a-f258-49c4-a080-2ddda1dff328-ca-trust-extracted\") pod \"accfb66a-f258-49c4-a080-2ddda1dff328\" (UID: \"accfb66a-f258-49c4-a080-2ddda1dff328\") " Jul 14 15:11:57.548630 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.548166 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-registry-certificates\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:11:57.548630 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.548183 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/accfb66a-f258-49c4-a080-2ddda1dff328-trusted-ca\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:11:57.550040 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.550012 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/accfb66a-f258-49c4-a080-2ddda1dff328-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "accfb66a-f258-49c4-a080-2ddda1dff328" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:11:57.558026 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.553421 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-kube-api-access-qsp5n" (OuterVolumeSpecName: "kube-api-access-qsp5n") pod "accfb66a-f258-49c4-a080-2ddda1dff328" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328"). InnerVolumeSpecName "kube-api-access-qsp5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:11:57.558026 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.554395 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "accfb66a-f258-49c4-a080-2ddda1dff328" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:11:57.558026 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.557779 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "accfb66a-f258-49c4-a080-2ddda1dff328" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:11:57.558355 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.558151 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "accfb66a-f258-49c4-a080-2ddda1dff328" (UID: "accfb66a-f258-49c4-a080-2ddda1dff328"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:11:57.568257 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.567985 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l9h2s" podStartSLOduration=67.343048573 podStartE2EDuration="1m12.567966962s" totalImagesPullingTime="5.224918389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:57.567421285 +0000 UTC m=+72.876539712" watchObservedRunningTime="2026-07-14 15:11:57.567966962 +0000 UTC m=+72.877085419" Jul 14 15:11:57.608184 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.607033 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n62q5" podStartSLOduration=68.306766088 podStartE2EDuration="1m13.607014508s" totalImagesPullingTime="5.30024842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:11:57.606662896 +0000 UTC m=+72.915781322" watchObservedRunningTime="2026-07-14 15:11:57.607014508 +0000 UTC m=+72.916132937" Jul 14 15:11:57.649523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.649412 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-installation-pull-secrets\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:11:57.649523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.649440 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-bound-sa-token\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:11:57.649523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.649456 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/accfb66a-f258-49c4-a080-2ddda1dff328-ca-trust-extracted\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:11:57.649523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.649470 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsp5n\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-kube-api-access-qsp5n\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:11:57.649523 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:57.649484 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/accfb66a-f258-49c4-a080-2ddda1dff328-image-registry-private-configuration\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:11:58.507874 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:58.502300 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f9fb64c4c-c9wp5" Jul 14 15:11:58.545062 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:58.545025 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f9fb64c4c-c9wp5"] Jul 14 15:11:58.550530 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:58.550493 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f9fb64c4c-c9wp5"] Jul 14 15:11:58.657473 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:58.657440 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/accfb66a-f258-49c4-a080-2ddda1dff328-registry-tls\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:11:59.194140 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:11:59.194109 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="accfb66a-f258-49c4-a080-2ddda1dff328" path="/var/lib/kubelet/pods/accfb66a-f258-49c4-a080-2ddda1dff328/volumes" Jul 14 15:12:03.524060 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:03.524023 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" event={"ID":"ed801a8f-da34-4e49-8544-8a726033bd5f","Type":"ContainerStarted","Data":"6493ca1dd8baf636623191bc9829966521a781786d25621b7b8a8654a8ff0f04"} Jul 14 15:12:03.526062 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:03.526028 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" event={"ID":"03684fc7-9207-44f2-bbc2-bfac7f89ece9","Type":"ContainerStarted","Data":"7e79b1eb508afaec3fceb968b12d00c68e30a868b69c0db82796d5714f685eca"} Jul 14 15:12:03.526194 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:03.526096 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" event={"ID":"03684fc7-9207-44f2-bbc2-bfac7f89ece9","Type":"ContainerStarted","Data":"56243030f30a3f95b75274213ad70446863cabc3e8ff515f6bbea2cf8ad8a4ea"} Jul 14 15:12:03.527684 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:03.527650 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7bwf9" event={"ID":"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0","Type":"ContainerStarted","Data":"16c4570338e24c17cfc8b6d89300b6d93538546515ac99743638d5be585fe605"} Jul 14 15:12:03.529257 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:03.529230 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" event={"ID":"a0ba9fd9-3c50-4204-8b9f-547ca0725cd3","Type":"ContainerStarted","Data":"eb6e98ee4099cf1e572a8160c58ae996e1a7eb8f7d59790947d936967478ed9e"} Jul 14 15:12:03.549199 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:03.549152 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-k2fzq" podStartSLOduration=2.037708017 podStartE2EDuration="7.549136939s" totalImagesPullingTime="5.511428922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:03.548483857 +0000 UTC m=+78.857602284" watchObservedRunningTime="2026-07-14 15:12:03.549136939 +0000 UTC m=+78.858255343" Jul 14 15:12:03.578151 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:03.578050 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847ccc9fd-z25f2" podStartSLOduration=1.4755440420000001 podStartE2EDuration="7.578033784s" totalImagesPullingTime="6.102489742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:03.577888521 +0000 UTC m=+78.887006947" watchObservedRunningTime="2026-07-14 15:12:03.578033784 +0000 UTC m=+78.887152210" Jul 14 15:12:04.534237 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:04.534207 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7bwf9" event={"ID":"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0","Type":"ContainerStarted","Data":"980d7398f01615aeb4ea00c9400f913b9cb8be38f938a7b58848dbcf96a210e1"} Jul 14 15:12:08.507613 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:08.507581 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mw8jr" Jul 14 15:12:08.528431 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:08.528383 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-46r6z" podStartSLOduration=38.308941325 podStartE2EDuration="44.528369051s" totalImagesPullingTime="6.219427726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:03.602458179 +0000 UTC m=+78.911576645" watchObservedRunningTime="2026-07-14 15:12:08.528369051 +0000 UTC m=+83.837487470" Jul 14 15:12:08.552621 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:08.552588 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7bwf9" event={"ID":"dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0","Type":"ContainerStarted","Data":"8f7cd8b8464c7f76f046878eb693a7bb3ab9aec66fa5628a6fcd12d1be4ad518"} Jul 14 15:12:08.573874 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:08.573821 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7bwf9" podStartSLOduration=35.938696289 podStartE2EDuration="46.573801002s" totalImagesPullingTime="10.635104713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:11:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:08.572393428 +0000 UTC m=+83.881511878" watchObservedRunningTime="2026-07-14 15:12:08.573801002 +0000 UTC m=+83.882919428" Jul 14 15:12:18.593520 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:18.593472 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-b5k6z" event={"ID":"016ae7b4-b656-453a-af91-be514f5dcdaf","Type":"ContainerStarted","Data":"b1dcc41a235e8f741713c024d3ee76688c97a8d391bf3f7752ed1ae36029d748"} Jul 14 15:12:18.594001 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:18.593677 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-b5k6z" Jul 14 15:12:18.601269 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:18.601246 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-b5k6z" Jul 14 15:12:18.638272 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:18.638220 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-b5k6z" podStartSLOduration=1.724633534 podStartE2EDuration="22.638201075s" totalImagesPullingTime="20.913567541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:18.636365944 +0000 UTC m=+93.945484391" watchObservedRunningTime="2026-07-14 15:12:18.638201075 +0000 UTC m=+93.947319502" Jul 14 15:12:19.510775 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:19.510748 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56749f8f64-wjg2c" Jul 14 15:12:22.406453 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.406413 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f8d9686c-2hwmh"] Jul 14 15:12:22.476591 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.476559 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f8d9686c-2hwmh"] Jul 14 15:12:22.476757 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.476667 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.479935 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.479908 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 15:12:22.479935 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.479926 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6zpvk\"" Jul 14 15:12:22.480120 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.479951 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 15:12:22.480120 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.479908 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 15:12:22.480120 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.479931 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 15:12:22.480920 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.480898 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 15:12:22.485331 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.485310 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 15:12:22.549468 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.549441 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxt9g\" (UniqueName: \"kubernetes.io/projected/4980262d-0c1e-46b9-a902-ea7e2de2aed2-kube-api-access-lxt9g\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.549598 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.549487 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-serving-cert\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.549598 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.549537 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-config\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.549598 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.549567 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-oauth-serving-cert\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.549598 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.549587 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-service-ca\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.549764 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.549651 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-trusted-ca-bundle\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.549764 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.549692 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-oauth-config\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.650357 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.650328 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-oauth-config\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.650477 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.650395 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxt9g\" (UniqueName: \"kubernetes.io/projected/4980262d-0c1e-46b9-a902-ea7e2de2aed2-kube-api-access-lxt9g\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.650477 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.650427 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-serving-cert\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.650477 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.650446 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-config\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.650477 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.650468 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-oauth-serving-cert\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.650716 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.650493 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-service-ca\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.650716 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.650539 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-trusted-ca-bundle\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.651520 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.651466 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-oauth-serving-cert\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.651520 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.651490 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-service-ca\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.651686 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.651610 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-config\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.651746 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.651693 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-trusted-ca-bundle\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.653438 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.653413 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-serving-cert\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.653758 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.653735 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-oauth-config\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.670343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.670287 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxt9g\" (UniqueName: \"kubernetes.io/projected/4980262d-0c1e-46b9-a902-ea7e2de2aed2-kube-api-access-lxt9g\") pod \"console-59f8d9686c-2hwmh\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.788059 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.788030 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:22.966650 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:22.966489 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f8d9686c-2hwmh"] Jul 14 15:12:22.969580 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:12:22.969553 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4980262d_0c1e_46b9_a902_ea7e2de2aed2.slice/crio-eab2770b23b89a6b050e0a38fb522ba2b3c6fe399c063db4e2e961a007b487fd WatchSource:0}: Error finding container eab2770b23b89a6b050e0a38fb522ba2b3c6fe399c063db4e2e961a007b487fd: Status 404 returned error can't find the container with id eab2770b23b89a6b050e0a38fb522ba2b3c6fe399c063db4e2e961a007b487fd Jul 14 15:12:23.616185 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:23.616146 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8d9686c-2hwmh" event={"ID":"4980262d-0c1e-46b9-a902-ea7e2de2aed2","Type":"ContainerStarted","Data":"eab2770b23b89a6b050e0a38fb522ba2b3c6fe399c063db4e2e961a007b487fd"} Jul 14 15:12:27.636853 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:27.636824 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8d9686c-2hwmh" event={"ID":"4980262d-0c1e-46b9-a902-ea7e2de2aed2","Type":"ContainerStarted","Data":"7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788"} Jul 14 15:12:27.658109 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:27.658061 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f8d9686c-2hwmh" podStartSLOduration=1.899500067 podStartE2EDuration="5.658045815s" totalImagesPullingTime="3.758545748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:27.657400375 +0000 UTC m=+102.966518800" watchObservedRunningTime="2026-07-14 15:12:27.658045815 +0000 UTC m=+102.967164242" Jul 14 15:12:28.504418 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:28.504394 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7m7vk" Jul 14 15:12:31.722535 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.722482 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9g979"] Jul 14 15:12:31.754231 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.754208 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9g979"] Jul 14 15:12:31.754231 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.754243 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d2q97"] Jul 14 15:12:31.754403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.754348 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:31.758470 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.758449 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 15:12:31.758610 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.758449 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 15:12:31.758742 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.758729 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 15:12:31.758884 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.758860 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 15:12:31.759750 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.759729 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 15:12:31.759922 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.759905 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-44qzd\"" Jul 14 15:12:31.760021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.760006 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 15:12:31.772210 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.772186 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:31.775283 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.775263 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 15:12:31.775385 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.775289 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 15:12:31.775747 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.775734 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vkczp\"" Jul 14 15:12:31.775966 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.775953 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 15:12:31.923965 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.923940 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl5m5\" (UniqueName: \"kubernetes.io/projected/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-kube-api-access-pl5m5\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:31.924069 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.923966 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:31.924069 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.923992 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:31.924069 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-wtmp\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:31.924216 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924072 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-metrics-client-ca\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:31.924216 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924122 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:31.924216 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924156 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:31.924366 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924221 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-textfile\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:31.924366 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924271 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:31.924366 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924330 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:31.924366 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924362 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4flml\" (UniqueName: \"kubernetes.io/projected/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-api-access-4flml\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:31.924534 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924380 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-sys\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:31.924534 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924396 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-tls\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:31.924534 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924412 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:31.924534 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:31.924428 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-root\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025480 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.025480 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025461 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-wtmp\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025480 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-metrics-client-ca\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025535 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.025641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025574 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.025641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025601 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-textfile\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025649 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025651 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-wtmp\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025689 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4flml\" (UniqueName: \"kubernetes.io/projected/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-api-access-4flml\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.025864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025717 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-sys\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025743 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-tls\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025771 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.025864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025797 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-root\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025823 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl5m5\" (UniqueName: \"kubernetes.io/projected/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-kube-api-access-pl5m5\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.025864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.026287 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.025876 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.026287 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:12:32.025694 2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 14 15:12:32.026287 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:12:32.025953 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-tls podName:dd1ec576-ea06-44ad-80d4-f5fd3c51bcba nodeName:}" failed. No retries permitted until 2026-07-14 15:12:32.525933775 +0000 UTC m=+107.835052189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-9g979" (UID: "dd1ec576-ea06-44ad-80d4-f5fd3c51bcba") : secret "kube-state-metrics-tls" not found Jul 14 15:12:32.026287 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:12:32.026061 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 15:12:32.026287 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:12:32.026113 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-tls podName:dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec nodeName:}" failed. No retries permitted until 2026-07-14 15:12:32.526096576 +0000 UTC m=+107.835214995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-tls") pod "node-exporter-d2q97" (UID: "dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec") : secret "node-exporter-tls" not found Jul 14 15:12:32.026287 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.026136 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-metrics-client-ca\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.026287 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.026193 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-sys\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.026287 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.026231 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-root\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.026287 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.026240 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.026619 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.026353 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.026619 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.026384 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-textfile\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.026619 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.026557 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.028004 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.027982 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.028285 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.028268 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.035956 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.035933 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl5m5\" (UniqueName: \"kubernetes.io/projected/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-kube-api-access-pl5m5\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.038350 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.038327 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4flml\" (UniqueName: \"kubernetes.io/projected/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-api-access-4flml\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.529292 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.529267 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.529438 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.529314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-tls\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.531477 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.531447 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec-node-exporter-tls\") pod \"node-exporter-d2q97\" (UID: \"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec\") " pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.531613 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.531545 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ec576-ea06-44ad-80d4-f5fd3c51bcba-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9g979\" (UID: \"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.662948 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.662926 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" Jul 14 15:12:32.680052 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.680032 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d2q97" Jul 14 15:12:32.714069 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:12:32.714037 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2fa0a6_a42c_42ec_ab87_fa1d829c02ec.slice/crio-6f5cfc57c7e30b0b67c1bf1e7a9e9f78bc3b0c5800376deb532e8654e468f47e WatchSource:0}: Error finding container 6f5cfc57c7e30b0b67c1bf1e7a9e9f78bc3b0c5800376deb532e8654e468f47e: Status 404 returned error can't find the container with id 6f5cfc57c7e30b0b67c1bf1e7a9e9f78bc3b0c5800376deb532e8654e468f47e Jul 14 15:12:32.788857 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.788788 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:32.789208 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.788859 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:32.793450 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.793428 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:32.821363 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:32.821338 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9g979"] Jul 14 15:12:32.822631 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:12:32.822604 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1ec576_ea06_44ad_80d4_f5fd3c51bcba.slice/crio-56a6eb137d231d3abf570feba1d724b8045ea3054d7b67ea4d789e23239bd166 WatchSource:0}: Error finding container 56a6eb137d231d3abf570feba1d724b8045ea3054d7b67ea4d789e23239bd166: Status 404 returned error can't find the container with id 56a6eb137d231d3abf570feba1d724b8045ea3054d7b67ea4d789e23239bd166 Jul 14 15:12:33.661382 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:33.661339 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2q97" event={"ID":"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec","Type":"ContainerStarted","Data":"6f5cfc57c7e30b0b67c1bf1e7a9e9f78bc3b0c5800376deb532e8654e468f47e"} Jul 14 15:12:33.663472 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:33.663439 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" event={"ID":"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba","Type":"ContainerStarted","Data":"56a6eb137d231d3abf570feba1d724b8045ea3054d7b67ea4d789e23239bd166"} Jul 14 15:12:33.668970 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:33.668944 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:12:35.672028 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:35.671992 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" event={"ID":"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba","Type":"ContainerStarted","Data":"ea5c6469781907cfcf1293b3f37b6e32de8d82a3d946410d2ad5e91e3083a95b"} Jul 14 15:12:35.672439 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:35.672044 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" event={"ID":"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba","Type":"ContainerStarted","Data":"61f4ea3577e168c3c3907a45b1dcc8f85e457513119899c9f633d8962670c6ff"} Jul 14 15:12:35.672439 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:35.672070 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" event={"ID":"dd1ec576-ea06-44ad-80d4-f5fd3c51bcba","Type":"ContainerStarted","Data":"26c45bab52d15b6a8eac39059cde77858d82b4148e851838d96f6b3b25acdf87"} Jul 14 15:12:35.673520 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:35.673483 2583 generic.go:356] "Generic (PLEG): container finished" podID="dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec" containerID="7e74ce2e4c1d1a5af3f4bfa58f525ba51ab5597fbe87135b2f5b4a68db667a64" exitCode=0 Jul 14 15:12:35.673631 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:35.673568 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2q97" event={"ID":"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec","Type":"ContainerDied","Data":"7e74ce2e4c1d1a5af3f4bfa58f525ba51ab5597fbe87135b2f5b4a68db667a64"} Jul 14 15:12:35.696325 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:35.696282 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g979" podStartSLOduration=2.844687594 podStartE2EDuration="4.696269737s" totalImagesPullingTime="1.851582143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:35.694787235 +0000 UTC m=+111.003905694" watchObservedRunningTime="2026-07-14 15:12:35.696269737 +0000 UTC m=+111.005388162" Jul 14 15:12:36.679914 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:36.679877 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2q97" event={"ID":"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec","Type":"ContainerStarted","Data":"025ed14925cae5e6e286289598cd0aa785257969ac6760eee01b4ff55445425e"} Jul 14 15:12:36.680338 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:36.679933 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2q97" event={"ID":"dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec","Type":"ContainerStarted","Data":"0369142f7c54a3ef51017bc027a1df087143d587d8d2fb7d41c3c698b1d9370c"} Jul 14 15:12:36.702968 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:36.702915 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d2q97" podStartSLOduration=3.627793155 podStartE2EDuration="5.702899744s" totalImagesPullingTime="1.958203518s" totalInitContainerRuntime="116.903071ms" isStatefulPod=true podCreationTimestamp="2026-07-14 15:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:36.701625592 +0000 UTC m=+112.010744078" watchObservedRunningTime="2026-07-14 15:12:36.702899744 +0000 UTC m=+112.012018172" Jul 14 15:12:47.719923 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:47.719890 2583 generic.go:356] "Generic (PLEG): container finished" podID="2c6ebeba-e9b2-4e7f-b7e6-3acee821b686" containerID="e16039a81b13dc5ae236f9ff63b6d63b4638a281c0acd9b7a1c0570fa9ea8f43" exitCode=0 Jul 14 15:12:47.720282 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:47.719930 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" event={"ID":"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686","Type":"ContainerDied","Data":"e16039a81b13dc5ae236f9ff63b6d63b4638a281c0acd9b7a1c0570fa9ea8f43"} Jul 14 15:12:47.720282 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:47.720227 2583 scope.go:117] "RemoveContainer" containerID="e16039a81b13dc5ae236f9ff63b6d63b4638a281c0acd9b7a1c0570fa9ea8f43" Jul 14 15:12:48.724998 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:48.724963 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xs9k6" event={"ID":"2c6ebeba-e9b2-4e7f-b7e6-3acee821b686","Type":"ContainerStarted","Data":"493d6f23b51a54ecce845f0a1aa3437c7a21b4454a8a2b8ff72c03f190395712"} Jul 14 15:12:53.090949 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:53.090908 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kr2kb_0bd375ca-1be0-4c01-a6b4-b86d75e506a9/serve-healthcheck-canary/0.log" Jul 14 15:12:53.292602 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:53.292573 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f8d9686c-2hwmh"] Jul 14 15:12:56.753843 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:56.753784 2583 generic.go:356] "Generic (PLEG): container finished" podID="13a08c00-c3d1-4b6e-acfe-f16bc76b5406" containerID="f406ff8169dde4942e274b9fae087c7cee19977cdd12c9652fc51b2ecbdead61" exitCode=0 Jul 14 15:12:56.754120 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:56.753860 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" event={"ID":"13a08c00-c3d1-4b6e-acfe-f16bc76b5406","Type":"ContainerDied","Data":"f406ff8169dde4942e274b9fae087c7cee19977cdd12c9652fc51b2ecbdead61"} Jul 14 15:12:56.754197 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:56.754179 2583 scope.go:117] "RemoveContainer" containerID="f406ff8169dde4942e274b9fae087c7cee19977cdd12c9652fc51b2ecbdead61" Jul 14 15:12:57.759327 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:12:57.759290 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p4zpb" event={"ID":"13a08c00-c3d1-4b6e-acfe-f16bc76b5406","Type":"ContainerStarted","Data":"bdefb375ecb6a67a6d423ffb0a68fc3e92817798dba9d73c3ef54f963a4cee4d"} Jul 14 15:13:18.317037 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.316998 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59f8d9686c-2hwmh" podUID="4980262d-0c1e-46b9-a902-ea7e2de2aed2" containerName="console" containerID="cri-o://7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788" gracePeriod=15 Jul 14 15:13:18.558680 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.558660 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:13:18.661174 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661153 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-oauth-serving-cert\") pod \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " Jul 14 15:13:18.661314 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661188 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxt9g\" (UniqueName: \"kubernetes.io/projected/4980262d-0c1e-46b9-a902-ea7e2de2aed2-kube-api-access-lxt9g\") pod \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " Jul 14 15:13:18.661314 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661215 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-oauth-config\") pod \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " Jul 14 15:13:18.661314 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661280 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-serving-cert\") pod \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " Jul 14 15:13:18.661482 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661353 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-service-ca\") pod \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " Jul 14 15:13:18.661482 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661379 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-trusted-ca-bundle\") pod \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " Jul 14 15:13:18.661482 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661407 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-config\") pod \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\" (UID: \"4980262d-0c1e-46b9-a902-ea7e2de2aed2\") " Jul 14 15:13:18.661703 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661667 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4980262d-0c1e-46b9-a902-ea7e2de2aed2" (UID: "4980262d-0c1e-46b9-a902-ea7e2de2aed2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:13:18.661888 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661853 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-service-ca" (OuterVolumeSpecName: "service-ca") pod "4980262d-0c1e-46b9-a902-ea7e2de2aed2" (UID: "4980262d-0c1e-46b9-a902-ea7e2de2aed2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:13:18.661972 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661859 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4980262d-0c1e-46b9-a902-ea7e2de2aed2" (UID: "4980262d-0c1e-46b9-a902-ea7e2de2aed2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:13:18.661972 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.661942 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-config" (OuterVolumeSpecName: "console-config") pod "4980262d-0c1e-46b9-a902-ea7e2de2aed2" (UID: "4980262d-0c1e-46b9-a902-ea7e2de2aed2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:13:18.663550 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.663524 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4980262d-0c1e-46b9-a902-ea7e2de2aed2-kube-api-access-lxt9g" (OuterVolumeSpecName: "kube-api-access-lxt9g") pod "4980262d-0c1e-46b9-a902-ea7e2de2aed2" (UID: "4980262d-0c1e-46b9-a902-ea7e2de2aed2"). InnerVolumeSpecName "kube-api-access-lxt9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:13:18.663550 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.663538 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4980262d-0c1e-46b9-a902-ea7e2de2aed2" (UID: "4980262d-0c1e-46b9-a902-ea7e2de2aed2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:13:18.663686 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.663666 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4980262d-0c1e-46b9-a902-ea7e2de2aed2" (UID: "4980262d-0c1e-46b9-a902-ea7e2de2aed2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:13:18.762224 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.762201 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-service-ca\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:13:18.762224 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.762221 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-trusted-ca-bundle\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:13:18.762359 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.762230 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-config\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:13:18.762359 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.762240 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4980262d-0c1e-46b9-a902-ea7e2de2aed2-oauth-serving-cert\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:13:18.762359 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.762250 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxt9g\" (UniqueName: \"kubernetes.io/projected/4980262d-0c1e-46b9-a902-ea7e2de2aed2-kube-api-access-lxt9g\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:13:18.762359 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.762258 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-oauth-config\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:13:18.762359 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.762267 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4980262d-0c1e-46b9-a902-ea7e2de2aed2-console-serving-cert\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:13:18.837639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.837614 2583 generic.go:356] "Generic (PLEG): container finished" podID="4980262d-0c1e-46b9-a902-ea7e2de2aed2" containerID="7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788" exitCode=0 Jul 14 15:13:18.837728 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.837650 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8d9686c-2hwmh" event={"ID":"4980262d-0c1e-46b9-a902-ea7e2de2aed2","Type":"ContainerDied","Data":"7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788"} Jul 14 15:13:18.837728 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.837663 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8d9686c-2hwmh" Jul 14 15:13:18.837728 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.837692 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8d9686c-2hwmh" event={"ID":"4980262d-0c1e-46b9-a902-ea7e2de2aed2","Type":"ContainerDied","Data":"eab2770b23b89a6b050e0a38fb522ba2b3c6fe399c063db4e2e961a007b487fd"} Jul 14 15:13:18.837728 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.837717 2583 scope.go:117] "RemoveContainer" containerID="7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788" Jul 14 15:13:18.845568 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.845550 2583 scope.go:117] "RemoveContainer" containerID="7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788" Jul 14 15:13:18.845847 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:13:18.845825 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788\": container with ID starting with 7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788 not found: ID does not exist" containerID="7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788" Jul 14 15:13:18.845899 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.845856 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788"} err="failed to get container status \"7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788\": rpc error: code = NotFound desc = could not find container \"7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788\": container with ID starting with 7fb359bb126bbc5c48611439bf59d6cb99b95732029a1c44bd36d7cbeb15b788 not found: ID does not exist" Jul 14 15:13:18.859216 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.859192 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f8d9686c-2hwmh"] Jul 14 15:13:18.865958 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:18.865938 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f8d9686c-2hwmh"] Jul 14 15:13:19.193000 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:19.192973 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4980262d-0c1e-46b9-a902-ea7e2de2aed2" path="/var/lib/kubelet/pods/4980262d-0c1e-46b9-a902-ea7e2de2aed2/volumes" Jul 14 15:13:48.756692 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.756661 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cfc665f84-svn25"] Jul 14 15:13:48.757579 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.757559 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4980262d-0c1e-46b9-a902-ea7e2de2aed2" containerName="console" Jul 14 15:13:48.757712 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.757701 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4980262d-0c1e-46b9-a902-ea7e2de2aed2" containerName="console" Jul 14 15:13:48.757857 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.757846 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4980262d-0c1e-46b9-a902-ea7e2de2aed2" containerName="console" Jul 14 15:13:48.763784 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.763763 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.767403 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.767381 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 15:13:48.767655 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.767627 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 15:13:48.767771 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.767630 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 15:13:48.767994 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.767846 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 15:13:48.767994 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.767880 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6zpvk\"" Jul 14 15:13:48.767994 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.767892 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 15:13:48.778015 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.777985 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 15:13:48.779514 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.779473 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfc665f84-svn25"] Jul 14 15:13:48.862470 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.862446 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-config\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.862587 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.862473 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-oauth-config\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.862587 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.862491 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-trusted-ca-bundle\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.862661 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.862581 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46pbk\" (UniqueName: \"kubernetes.io/projected/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-kube-api-access-46pbk\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.862661 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.862612 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-service-ca\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.862661 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.862628 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-oauth-serving-cert\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.862751 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.862675 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-serving-cert\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.963408 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.963385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46pbk\" (UniqueName: \"kubernetes.io/projected/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-kube-api-access-46pbk\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.963546 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.963414 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-service-ca\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.963546 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.963428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-oauth-serving-cert\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.963680 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.963579 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-serving-cert\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.963680 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.963617 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-config\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.963680 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.963634 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-oauth-config\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.963801 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.963675 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-trusted-ca-bundle\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.964261 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.964238 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-service-ca\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.964405 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.964278 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-oauth-serving-cert\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.964483 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.964287 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-config\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.964483 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.964471 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-trusted-ca-bundle\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.966093 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.966072 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-oauth-config\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.966224 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.966206 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-serving-cert\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:48.971978 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:48.971957 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46pbk\" (UniqueName: \"kubernetes.io/projected/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-kube-api-access-46pbk\") pod \"console-cfc665f84-svn25\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:49.081028 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:49.080982 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:49.211878 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:49.211116 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfc665f84-svn25"] Jul 14 15:13:49.214152 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:13:49.214120 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f05897_f8f3_4b6d_aa02_ccf6667d714f.slice/crio-c68c30c9450c17378d71f9a7ce579e07d1a9521e739e66e61e67edaee7a69754 WatchSource:0}: Error finding container c68c30c9450c17378d71f9a7ce579e07d1a9521e739e66e61e67edaee7a69754: Status 404 returned error can't find the container with id c68c30c9450c17378d71f9a7ce579e07d1a9521e739e66e61e67edaee7a69754 Jul 14 15:13:49.945801 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:49.945767 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfc665f84-svn25" event={"ID":"c7f05897-f8f3-4b6d-aa02-ccf6667d714f","Type":"ContainerStarted","Data":"7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d"} Jul 14 15:13:49.946147 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:49.945820 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfc665f84-svn25" event={"ID":"c7f05897-f8f3-4b6d-aa02-ccf6667d714f","Type":"ContainerStarted","Data":"c68c30c9450c17378d71f9a7ce579e07d1a9521e739e66e61e67edaee7a69754"} Jul 14 15:13:49.967465 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:49.967423 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cfc665f84-svn25" podStartSLOduration=1.9674093620000002 podStartE2EDuration="1.967409362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:13:49.965901285 +0000 UTC m=+185.275019730" watchObservedRunningTime="2026-07-14 15:13:49.967409362 +0000 UTC m=+185.276527790" Jul 14 15:13:59.082085 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:59.082046 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:59.082668 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:59.082103 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:59.086452 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:59.086431 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:13:59.982119 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:13:59.982084 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:15:13.856815 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:13.856769 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp"] Jul 14 15:15:13.862825 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:13.860961 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" Jul 14 15:15:13.865208 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:13.865048 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 14 15:15:13.865495 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:13.865473 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:15:13.865955 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:13.865495 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-9jwtk\"" Jul 14 15:15:13.881375 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:13.881329 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp"] Jul 14 15:15:13.941578 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:13.941541 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168dfa3f-b52a-4be7-8702-cae24284f2d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd2sp\" (UID: \"168dfa3f-b52a-4be7-8702-cae24284f2d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" Jul 14 15:15:13.941758 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:13.941609 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrm4\" (UniqueName: \"kubernetes.io/projected/168dfa3f-b52a-4be7-8702-cae24284f2d4-kube-api-access-psrm4\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd2sp\" (UID: \"168dfa3f-b52a-4be7-8702-cae24284f2d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" Jul 14 15:15:14.042738 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:14.042692 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168dfa3f-b52a-4be7-8702-cae24284f2d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd2sp\" (UID: \"168dfa3f-b52a-4be7-8702-cae24284f2d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" Jul 14 15:15:14.042941 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:14.042758 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrm4\" (UniqueName: \"kubernetes.io/projected/168dfa3f-b52a-4be7-8702-cae24284f2d4-kube-api-access-psrm4\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd2sp\" (UID: \"168dfa3f-b52a-4be7-8702-cae24284f2d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" Jul 14 15:15:14.043149 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:14.043125 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168dfa3f-b52a-4be7-8702-cae24284f2d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd2sp\" (UID: \"168dfa3f-b52a-4be7-8702-cae24284f2d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" Jul 14 15:15:14.056798 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:14.056757 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrm4\" (UniqueName: \"kubernetes.io/projected/168dfa3f-b52a-4be7-8702-cae24284f2d4-kube-api-access-psrm4\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd2sp\" (UID: \"168dfa3f-b52a-4be7-8702-cae24284f2d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" Jul 14 15:15:14.175090 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:14.175053 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" Jul 14 15:15:14.319094 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:14.319069 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp"] Jul 14 15:15:14.322304 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:15:14.322267 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168dfa3f_b52a_4be7_8702_cae24284f2d4.slice/crio-44177ec3580dbf89a5573e161bc9db03babf5f9785ffc838c4e0ab1aca6aa3ca WatchSource:0}: Error finding container 44177ec3580dbf89a5573e161bc9db03babf5f9785ffc838c4e0ab1aca6aa3ca: Status 404 returned error can't find the container with id 44177ec3580dbf89a5573e161bc9db03babf5f9785ffc838c4e0ab1aca6aa3ca Jul 14 15:15:15.256271 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:15.256144 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" event={"ID":"168dfa3f-b52a-4be7-8702-cae24284f2d4","Type":"ContainerStarted","Data":"44177ec3580dbf89a5573e161bc9db03babf5f9785ffc838c4e0ab1aca6aa3ca"} Jul 14 15:15:17.266909 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:17.266869 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" event={"ID":"168dfa3f-b52a-4be7-8702-cae24284f2d4","Type":"ContainerStarted","Data":"6810b638174c1a841b89db117e81304a31750e7de53e77efa39183bcc85a1e6b"} Jul 14 15:15:17.294974 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:17.294906 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd2sp" podStartSLOduration=1.887440719 podStartE2EDuration="4.294884668s" totalImagesPullingTime="2.407443949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:15:17.292654303 +0000 UTC m=+272.601772749" watchObservedRunningTime="2026-07-14 15:15:17.294884668 +0000 UTC m=+272.604003095" Jul 14 15:15:18.032518 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.032456 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kjphm"] Jul 14 15:15:18.035813 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.035795 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:18.039167 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.039143 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 15:15:18.040116 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.040094 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-87r69\"" Jul 14 15:15:18.040362 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.040346 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 15:15:18.063842 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.063810 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kjphm"] Jul 14 15:15:18.076548 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.076519 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef80da22-8ac8-42e2-bbde-3aef21d7d48f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kjphm\" (UID: \"ef80da22-8ac8-42e2-bbde-3aef21d7d48f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:18.076695 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.076582 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knb8p\" (UniqueName: \"kubernetes.io/projected/ef80da22-8ac8-42e2-bbde-3aef21d7d48f-kube-api-access-knb8p\") pod \"cert-manager-webhook-6486ffd997-kjphm\" (UID: \"ef80da22-8ac8-42e2-bbde-3aef21d7d48f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:18.177864 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.177822 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef80da22-8ac8-42e2-bbde-3aef21d7d48f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kjphm\" (UID: \"ef80da22-8ac8-42e2-bbde-3aef21d7d48f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:18.178050 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.177879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knb8p\" (UniqueName: \"kubernetes.io/projected/ef80da22-8ac8-42e2-bbde-3aef21d7d48f-kube-api-access-knb8p\") pod \"cert-manager-webhook-6486ffd997-kjphm\" (UID: \"ef80da22-8ac8-42e2-bbde-3aef21d7d48f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:18.198648 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.198617 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef80da22-8ac8-42e2-bbde-3aef21d7d48f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kjphm\" (UID: \"ef80da22-8ac8-42e2-bbde-3aef21d7d48f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:18.198821 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.198752 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knb8p\" (UniqueName: \"kubernetes.io/projected/ef80da22-8ac8-42e2-bbde-3aef21d7d48f-kube-api-access-knb8p\") pod \"cert-manager-webhook-6486ffd997-kjphm\" (UID: \"ef80da22-8ac8-42e2-bbde-3aef21d7d48f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:18.345076 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.344980 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:18.488114 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:18.488039 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kjphm"] Jul 14 15:15:18.490321 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:15:18.490285 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef80da22_8ac8_42e2_bbde_3aef21d7d48f.slice/crio-083d5cbdc52e51f3de84801ddc2cf6e97527baef61ab825d1e89964ca259755f WatchSource:0}: Error finding container 083d5cbdc52e51f3de84801ddc2cf6e97527baef61ab825d1e89964ca259755f: Status 404 returned error can't find the container with id 083d5cbdc52e51f3de84801ddc2cf6e97527baef61ab825d1e89964ca259755f Jul 14 15:15:19.277368 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:19.277329 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" event={"ID":"ef80da22-8ac8-42e2-bbde-3aef21d7d48f","Type":"ContainerStarted","Data":"083d5cbdc52e51f3de84801ddc2cf6e97527baef61ab825d1e89964ca259755f"} Jul 14 15:15:21.288754 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:21.288713 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" event={"ID":"ef80da22-8ac8-42e2-bbde-3aef21d7d48f","Type":"ContainerStarted","Data":"0ee0bf5dba43c029abc7b16b06c7b2df3617e42bb5a5c752320db6638111e471"} Jul 14 15:15:21.289171 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:21.288791 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:21.308149 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:21.308091 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" podStartSLOduration=1.928006313 podStartE2EDuration="4.308074154s" totalImagesPullingTime="2.380067841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:15:21.306243897 +0000 UTC m=+276.615362324" watchObservedRunningTime="2026-07-14 15:15:21.308074154 +0000 UTC m=+276.617192580" Jul 14 15:15:27.294975 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:27.294939 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kjphm" Jul 14 15:15:44.992256 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:44.992229 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:15:44.995426 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:44.995404 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:15:44.998211 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:44.998192 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:15:45.001584 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:45.001563 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:15:45.001798 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:45.001779 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 15:15:53.785075 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.785040 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc"] Jul 14 15:15:53.790172 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.790153 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.793562 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.793538 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 15:15:53.793909 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.793889 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 15:15:53.793909 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.793901 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x84bs\"" Jul 14 15:15:53.794055 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.793933 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 15:15:53.794055 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.793961 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 15:15:53.804879 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.804852 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc"] Jul 14 15:15:53.879687 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.879655 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6206be3e-26d2-40fb-b07b-be6b8ada3c77-webhook-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.879834 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.879695 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6206be3e-26d2-40fb-b07b-be6b8ada3c77-manifests\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.879834 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.879727 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8w6h\" (UniqueName: \"kubernetes.io/projected/6206be3e-26d2-40fb-b07b-be6b8ada3c77-kube-api-access-g8w6h\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.879834 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.879777 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6206be3e-26d2-40fb-b07b-be6b8ada3c77-tmp\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.879834 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.879795 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6206be3e-26d2-40fb-b07b-be6b8ada3c77-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.980754 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.980721 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8w6h\" (UniqueName: \"kubernetes.io/projected/6206be3e-26d2-40fb-b07b-be6b8ada3c77-kube-api-access-g8w6h\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.980905 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.980772 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6206be3e-26d2-40fb-b07b-be6b8ada3c77-tmp\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.980905 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.980887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6206be3e-26d2-40fb-b07b-be6b8ada3c77-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.980988 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.980938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6206be3e-26d2-40fb-b07b-be6b8ada3c77-webhook-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.981031 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.981002 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6206be3e-26d2-40fb-b07b-be6b8ada3c77-manifests\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.981381 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.981354 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6206be3e-26d2-40fb-b07b-be6b8ada3c77-manifests\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.982961 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.982941 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6206be3e-26d2-40fb-b07b-be6b8ada3c77-tmp\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.983244 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.983224 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6206be3e-26d2-40fb-b07b-be6b8ada3c77-webhook-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:53.983318 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:53.983226 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6206be3e-26d2-40fb-b07b-be6b8ada3c77-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:54.003143 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:54.003115 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8w6h\" (UniqueName: \"kubernetes.io/projected/6206be3e-26d2-40fb-b07b-be6b8ada3c77-kube-api-access-g8w6h\") pod \"opendatahub-operator-controller-manager-8676d5649d-rx2gc\" (UID: \"6206be3e-26d2-40fb-b07b-be6b8ada3c77\") " pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:54.100281 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:54.100203 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:15:54.233821 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:54.233798 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc"] Jul 14 15:15:54.237358 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:15:54.237277 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6206be3e_26d2_40fb_b07b_be6b8ada3c77.slice/crio-7df4cb4af8f9605f0022b007acd2de9584c0fc2ba0265bf819e81c35807a5ef1 WatchSource:0}: Error finding container 7df4cb4af8f9605f0022b007acd2de9584c0fc2ba0265bf819e81c35807a5ef1: Status 404 returned error can't find the container with id 7df4cb4af8f9605f0022b007acd2de9584c0fc2ba0265bf819e81c35807a5ef1 Jul 14 15:15:54.239922 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:54.239903 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 15:15:54.423345 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:15:54.423310 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" event={"ID":"6206be3e-26d2-40fb-b07b-be6b8ada3c77","Type":"ContainerStarted","Data":"7df4cb4af8f9605f0022b007acd2de9584c0fc2ba0265bf819e81c35807a5ef1"} Jul 14 15:16:00.448784 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:00.448749 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" event={"ID":"6206be3e-26d2-40fb-b07b-be6b8ada3c77","Type":"ContainerStarted","Data":"34e07f098570c162b77b6891519b7d4e7739f892d2dab26a05012b995a088d18"} Jul 14 15:16:01.454875 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:01.454842 2583 generic.go:356] "Generic (PLEG): container finished" podID="6206be3e-26d2-40fb-b07b-be6b8ada3c77" containerID="34e07f098570c162b77b6891519b7d4e7739f892d2dab26a05012b995a088d18" exitCode=0 Jul 14 15:16:01.455317 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:01.454928 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" event={"ID":"6206be3e-26d2-40fb-b07b-be6b8ada3c77","Type":"ContainerDied","Data":"34e07f098570c162b77b6891519b7d4e7739f892d2dab26a05012b995a088d18"} Jul 14 15:16:02.461437 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:02.461395 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" event={"ID":"6206be3e-26d2-40fb-b07b-be6b8ada3c77","Type":"ContainerStarted","Data":"9f54796846549bbe2fcf487844fc65f05fb37c411a18d2f173a1338b6d032c71"} Jul 14 15:16:02.461832 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:02.461486 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:16:02.484896 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:02.484851 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" podStartSLOduration=2.708650077 podStartE2EDuration="9.484836588s" totalImagesPullingTime="5.757581029s" totalInitContainerRuntime="1.018605482s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:02.484597925 +0000 UTC m=+317.793716362" watchObservedRunningTime="2026-07-14 15:16:02.484836588 +0000 UTC m=+317.793955013" Jul 14 15:16:13.468113 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:13.468081 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8676d5649d-rx2gc" Jul 14 15:16:15.819186 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.819149 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz"] Jul 14 15:16:15.822525 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.822492 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.825977 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.825954 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 15:16:15.826091 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.826020 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 15:16:15.826662 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.826646 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 15:16:15.827044 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.827030 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cpk2q\"" Jul 14 15:16:15.827125 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.827054 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 15:16:15.834370 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.834349 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz"] Jul 14 15:16:15.864040 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.864013 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53e6f9b9-06ae-46d8-9304-8d2dfb971a6a-tls-certs\") pod \"kube-auth-proxy-7754cbb886-k8zqz\" (UID: \"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.864162 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.864050 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm2k9\" (UniqueName: \"kubernetes.io/projected/53e6f9b9-06ae-46d8-9304-8d2dfb971a6a-kube-api-access-xm2k9\") pod \"kube-auth-proxy-7754cbb886-k8zqz\" (UID: \"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.864162 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.864135 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53e6f9b9-06ae-46d8-9304-8d2dfb971a6a-tmp\") pod \"kube-auth-proxy-7754cbb886-k8zqz\" (UID: \"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.965333 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.965300 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53e6f9b9-06ae-46d8-9304-8d2dfb971a6a-tmp\") pod \"kube-auth-proxy-7754cbb886-k8zqz\" (UID: \"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.965519 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.965361 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53e6f9b9-06ae-46d8-9304-8d2dfb971a6a-tls-certs\") pod \"kube-auth-proxy-7754cbb886-k8zqz\" (UID: \"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.965519 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.965381 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm2k9\" (UniqueName: \"kubernetes.io/projected/53e6f9b9-06ae-46d8-9304-8d2dfb971a6a-kube-api-access-xm2k9\") pod \"kube-auth-proxy-7754cbb886-k8zqz\" (UID: \"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.967698 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.967672 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53e6f9b9-06ae-46d8-9304-8d2dfb971a6a-tmp\") pod \"kube-auth-proxy-7754cbb886-k8zqz\" (UID: \"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.967937 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.967915 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53e6f9b9-06ae-46d8-9304-8d2dfb971a6a-tls-certs\") pod \"kube-auth-proxy-7754cbb886-k8zqz\" (UID: \"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.977089 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.977064 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hjc4z"] Jul 14 15:16:15.980288 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.980269 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:15.982665 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.982640 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm2k9\" (UniqueName: \"kubernetes.io/projected/53e6f9b9-06ae-46d8-9304-8d2dfb971a6a-kube-api-access-xm2k9\") pod \"kube-auth-proxy-7754cbb886-k8zqz\" (UID: \"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a\") " pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:15.983551 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.983534 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qdjqz\"" Jul 14 15:16:15.983879 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.983863 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 14 15:16:15.994545 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:15.994484 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hjc4z"] Jul 14 15:16:16.066144 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.066111 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xv8g\" (UniqueName: \"kubernetes.io/projected/f1059153-1bcb-4027-a665-19b194bfccb9-kube-api-access-6xv8g\") pod \"odh-model-controller-7998c67dc4-hjc4z\" (UID: \"f1059153-1bcb-4027-a665-19b194bfccb9\") " pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:16.066297 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.066163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1059153-1bcb-4027-a665-19b194bfccb9-cert\") pod \"odh-model-controller-7998c67dc4-hjc4z\" (UID: \"f1059153-1bcb-4027-a665-19b194bfccb9\") " pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:16.132638 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.132613 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" Jul 14 15:16:16.167028 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.166996 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xv8g\" (UniqueName: \"kubernetes.io/projected/f1059153-1bcb-4027-a665-19b194bfccb9-kube-api-access-6xv8g\") pod \"odh-model-controller-7998c67dc4-hjc4z\" (UID: \"f1059153-1bcb-4027-a665-19b194bfccb9\") " pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:16.167218 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.167048 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1059153-1bcb-4027-a665-19b194bfccb9-cert\") pod \"odh-model-controller-7998c67dc4-hjc4z\" (UID: \"f1059153-1bcb-4027-a665-19b194bfccb9\") " pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:16.167218 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:16:16.167153 2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 14 15:16:16.167348 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:16:16.167224 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1059153-1bcb-4027-a665-19b194bfccb9-cert podName:f1059153-1bcb-4027-a665-19b194bfccb9 nodeName:}" failed. No retries permitted until 2026-07-14 15:16:16.66720164 +0000 UTC m=+331.976320043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f1059153-1bcb-4027-a665-19b194bfccb9-cert") pod "odh-model-controller-7998c67dc4-hjc4z" (UID: "f1059153-1bcb-4027-a665-19b194bfccb9") : secret "odh-model-controller-webhook-cert" not found Jul 14 15:16:16.177876 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.177851 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xv8g\" (UniqueName: \"kubernetes.io/projected/f1059153-1bcb-4027-a665-19b194bfccb9-kube-api-access-6xv8g\") pod \"odh-model-controller-7998c67dc4-hjc4z\" (UID: \"f1059153-1bcb-4027-a665-19b194bfccb9\") " pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:16.274535 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.274492 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz"] Jul 14 15:16:16.276128 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:16:16.276101 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e6f9b9_06ae_46d8_9304_8d2dfb971a6a.slice/crio-2eb99ad897d26c33eb6effbf06b96c968ed6d2550d685b80a943549ff66b84b5 WatchSource:0}: Error finding container 2eb99ad897d26c33eb6effbf06b96c968ed6d2550d685b80a943549ff66b84b5: Status 404 returned error can't find the container with id 2eb99ad897d26c33eb6effbf06b96c968ed6d2550d685b80a943549ff66b84b5 Jul 14 15:16:16.519880 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.519781 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" event={"ID":"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a","Type":"ContainerStarted","Data":"2eb99ad897d26c33eb6effbf06b96c968ed6d2550d685b80a943549ff66b84b5"} Jul 14 15:16:16.671288 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.671253 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1059153-1bcb-4027-a665-19b194bfccb9-cert\") pod \"odh-model-controller-7998c67dc4-hjc4z\" (UID: \"f1059153-1bcb-4027-a665-19b194bfccb9\") " pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:16.671466 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:16:16.671411 2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 14 15:16:16.671537 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:16:16.671490 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1059153-1bcb-4027-a665-19b194bfccb9-cert podName:f1059153-1bcb-4027-a665-19b194bfccb9 nodeName:}" failed. No retries permitted until 2026-07-14 15:16:17.671471946 +0000 UTC m=+332.980590353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f1059153-1bcb-4027-a665-19b194bfccb9-cert") pod "odh-model-controller-7998c67dc4-hjc4z" (UID: "f1059153-1bcb-4027-a665-19b194bfccb9") : secret "odh-model-controller-webhook-cert" not found Jul 14 15:16:16.899068 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.899033 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m6xgx"] Jul 14 15:16:16.903494 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.903473 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:16.906281 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.906252 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8vj62\"" Jul 14 15:16:16.906281 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.906275 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 14 15:16:16.914340 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.914308 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m6xgx"] Jul 14 15:16:16.974468 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.974434 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9xm\" (UniqueName: \"kubernetes.io/projected/593e9e7a-b789-446d-be1f-e5fe7b3f5a4e-kube-api-access-xc9xm\") pod \"model-serving-api-54d89bd5fc-m6xgx\" (UID: \"593e9e7a-b789-446d-be1f-e5fe7b3f5a4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:16.974659 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:16.974555 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/593e9e7a-b789-446d-be1f-e5fe7b3f5a4e-tls-certs\") pod \"model-serving-api-54d89bd5fc-m6xgx\" (UID: \"593e9e7a-b789-446d-be1f-e5fe7b3f5a4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:17.075863 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.075822 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9xm\" (UniqueName: \"kubernetes.io/projected/593e9e7a-b789-446d-be1f-e5fe7b3f5a4e-kube-api-access-xc9xm\") pod \"model-serving-api-54d89bd5fc-m6xgx\" (UID: \"593e9e7a-b789-446d-be1f-e5fe7b3f5a4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:17.076017 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.075915 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/593e9e7a-b789-446d-be1f-e5fe7b3f5a4e-tls-certs\") pod \"model-serving-api-54d89bd5fc-m6xgx\" (UID: \"593e9e7a-b789-446d-be1f-e5fe7b3f5a4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:17.078411 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.078381 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/593e9e7a-b789-446d-be1f-e5fe7b3f5a4e-tls-certs\") pod \"model-serving-api-54d89bd5fc-m6xgx\" (UID: \"593e9e7a-b789-446d-be1f-e5fe7b3f5a4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:17.100447 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.100416 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9xm\" (UniqueName: \"kubernetes.io/projected/593e9e7a-b789-446d-be1f-e5fe7b3f5a4e-kube-api-access-xc9xm\") pod \"model-serving-api-54d89bd5fc-m6xgx\" (UID: \"593e9e7a-b789-446d-be1f-e5fe7b3f5a4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:17.215640 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.215561 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:17.289317 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.289285 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8"] Jul 14 15:16:17.293814 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.293672 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.305167 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.305139 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 15:16:17.305327 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.305251 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 15:16:17.305327 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.305292 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 15:16:17.305517 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.305255 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 15:16:17.305656 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.305633 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2q266\"" Jul 14 15:16:17.321940 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.321875 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8"] Jul 14 15:16:17.361399 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.361368 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m6xgx"] Jul 14 15:16:17.364639 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:16:17.364611 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593e9e7a_b789_446d_be1f_e5fe7b3f5a4e.slice/crio-d755a6f9995b29d1ce8dd86b9bb6f9335ace63c6bbc458632393b6e22e027033 WatchSource:0}: Error finding container d755a6f9995b29d1ce8dd86b9bb6f9335ace63c6bbc458632393b6e22e027033: Status 404 returned error can't find the container with id d755a6f9995b29d1ce8dd86b9bb6f9335ace63c6bbc458632393b6e22e027033 Jul 14 15:16:17.379253 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.379231 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f06fe149-6edf-4f92-8c72-6e57a363c868-local-certs\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.379369 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.379269 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.379369 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.379350 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.379459 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.379397 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.379459 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.379435 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-cacerts\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.379560 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.379451 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95hdj\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-kube-api-access-95hdj\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.379622 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.379605 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-token\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.481072 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.480988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-cacerts\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.481072 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.481024 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95hdj\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-kube-api-access-95hdj\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.481303 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.481111 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-token\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.481303 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.481137 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f06fe149-6edf-4f92-8c72-6e57a363c868-local-certs\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.481303 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.481165 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.481303 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.481200 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.481303 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.481223 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.481899 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.481861 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.483481 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.483458 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.483589 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.483489 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-cacerts\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.483589 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.483517 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f06fe149-6edf-4f92-8c72-6e57a363c868-local-certs\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.483660 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.483590 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.490001 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.489981 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-token\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.490382 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.490362 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95hdj\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-kube-api-access-95hdj\") pod \"istiod-openshift-gateway-7574459656-vt4g8\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.525784 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.525748 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" event={"ID":"593e9e7a-b789-446d-be1f-e5fe7b3f5a4e","Type":"ContainerStarted","Data":"d755a6f9995b29d1ce8dd86b9bb6f9335ace63c6bbc458632393b6e22e027033"} Jul 14 15:16:17.605446 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.605408 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:17.683953 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.683918 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1059153-1bcb-4027-a665-19b194bfccb9-cert\") pod \"odh-model-controller-7998c67dc4-hjc4z\" (UID: \"f1059153-1bcb-4027-a665-19b194bfccb9\") " pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:17.686355 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.686330 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1059153-1bcb-4027-a665-19b194bfccb9-cert\") pod \"odh-model-controller-7998c67dc4-hjc4z\" (UID: \"f1059153-1bcb-4027-a665-19b194bfccb9\") " pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:17.745407 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.745382 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8"] Jul 14 15:16:17.747847 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:16:17.747815 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06fe149_6edf_4f92_8c72_6e57a363c868.slice/crio-511f44119b55286e77cfa225c42025fcbb743328e58c51886475a3a1caa24441 WatchSource:0}: Error finding container 511f44119b55286e77cfa225c42025fcbb743328e58c51886475a3a1caa24441: Status 404 returned error can't find the container with id 511f44119b55286e77cfa225c42025fcbb743328e58c51886475a3a1caa24441 Jul 14 15:16:17.798777 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.798743 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:17.935891 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:17.935860 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hjc4z"] Jul 14 15:16:17.938885 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:16:17.938858 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1059153_1bcb_4027_a665_19b194bfccb9.slice/crio-e7c2a705b3f000cb19d8dfdaca0ea0476bb049604665eb37eeeff2c12fae86ee WatchSource:0}: Error finding container e7c2a705b3f000cb19d8dfdaca0ea0476bb049604665eb37eeeff2c12fae86ee: Status 404 returned error can't find the container with id e7c2a705b3f000cb19d8dfdaca0ea0476bb049604665eb37eeeff2c12fae86ee Jul 14 15:16:18.533066 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:18.533028 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" event={"ID":"f06fe149-6edf-4f92-8c72-6e57a363c868","Type":"ContainerStarted","Data":"511f44119b55286e77cfa225c42025fcbb743328e58c51886475a3a1caa24441"} Jul 14 15:16:18.534422 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:18.534392 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" event={"ID":"f1059153-1bcb-4027-a665-19b194bfccb9","Type":"ContainerStarted","Data":"e7c2a705b3f000cb19d8dfdaca0ea0476bb049604665eb37eeeff2c12fae86ee"} Jul 14 15:16:22.423579 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:22.423548 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 15:16:22.423896 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:22.423610 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 15:16:22.564173 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:22.564152 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:22.597679 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:22.596184 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" podStartSLOduration=3.075493616 podStartE2EDuration="7.59616146s" totalImagesPullingTime="4.520667844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:22.595964683 +0000 UTC m=+337.905083134" watchObservedRunningTime="2026-07-14 15:16:22.59616146 +0000 UTC m=+337.905279867" Jul 14 15:16:23.569605 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.569572 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" event={"ID":"53e6f9b9-06ae-46d8-9304-8d2dfb971a6a","Type":"ContainerStarted","Data":"aaec733026d755e484fc94666fb959f828662ee964f2b32a9d7004f09b9004be"} Jul 14 15:16:23.571200 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.571171 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" event={"ID":"f06fe149-6edf-4f92-8c72-6e57a363c868","Type":"ContainerStarted","Data":"a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97"} Jul 14 15:16:23.571320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.571278 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:23.572548 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.572521 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" event={"ID":"593e9e7a-b789-446d-be1f-e5fe7b3f5a4e","Type":"ContainerStarted","Data":"65437203f17bbeb951635dd03ab4bc9892927ab1b86371cf5aebee8d685b2740"} Jul 14 15:16:23.572673 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.572607 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:23.573332 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.573309 2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-vt4g8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 15:16:23.573425 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.573356 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" podUID="f06fe149-6edf-4f92-8c72-6e57a363c868" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 15:16:23.574101 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.574082 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" event={"ID":"f1059153-1bcb-4027-a665-19b194bfccb9","Type":"ContainerStarted","Data":"b501c373fd20697fe159e549641a6ef572203e99b6d37eb021aa4d18e50b8da7"} Jul 14 15:16:23.604657 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.604604 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7754cbb886-k8zqz" podStartSLOduration=2.461648861 podStartE2EDuration="8.60458636s" totalImagesPullingTime="6.142937499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:23.604127305 +0000 UTC m=+338.913245728" watchObservedRunningTime="2026-07-14 15:16:23.60458636 +0000 UTC m=+338.913704791" Jul 14 15:16:23.626737 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.626691 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" podStartSLOduration=2.575889433 podStartE2EDuration="7.626674836s" totalImagesPullingTime="5.050785403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:23.625414096 +0000 UTC m=+338.934532547" watchObservedRunningTime="2026-07-14 15:16:23.626674836 +0000 UTC m=+338.935793261" Jul 14 15:16:23.650898 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.650845 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" podStartSLOduration=1.9773389909999999 podStartE2EDuration="6.650825056s" totalImagesPullingTime="4.673486065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:23.650488876 +0000 UTC m=+338.959607298" watchObservedRunningTime="2026-07-14 15:16:23.650825056 +0000 UTC m=+338.959943485" Jul 14 15:16:23.771084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.771044 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt"] Jul 14 15:16:23.774475 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.774457 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.777525 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.777486 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 15:16:23.777649 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.777548 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 15:16:23.777649 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.777554 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 15:16:23.777649 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.777608 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 15:16:23.777793 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.777659 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sghgx\"" Jul 14 15:16:23.777793 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.777670 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 15:16:23.784158 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.784128 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt"] Jul 14 15:16:23.839256 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.839179 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-manager-config\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.839256 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.839231 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-metrics-cert\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.839428 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.839300 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-cert\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.839428 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.839333 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvlfn\" (UniqueName: \"kubernetes.io/projected/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-kube-api-access-fvlfn\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.940163 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.940130 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-manager-config\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.940345 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.940194 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-metrics-cert\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.940345 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.940249 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-cert\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.940345 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.940292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvlfn\" (UniqueName: \"kubernetes.io/projected/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-kube-api-access-fvlfn\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.940795 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.940771 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-manager-config\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.942724 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.942702 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-metrics-cert\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.942813 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.942739 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-cert\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:23.965957 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:23.965933 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvlfn\" (UniqueName: \"kubernetes.io/projected/353bb7d5-9c4e-49c9-a6a2-1148bd63b09d-kube-api-access-fvlfn\") pod \"lws-controller-manager-755b7b9d47-2b2dt\" (UID: \"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d\") " pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:24.086202 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:24.086168 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:24.244606 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:24.244581 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt"] Jul 14 15:16:24.246696 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:16:24.246670 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353bb7d5_9c4e_49c9_a6a2_1148bd63b09d.slice/crio-7d1ae4b3dab8460a036190e76c8d6e997156c6276969db8ac6a41219f889eff5 WatchSource:0}: Error finding container 7d1ae4b3dab8460a036190e76c8d6e997156c6276969db8ac6a41219f889eff5: Status 404 returned error can't find the container with id 7d1ae4b3dab8460a036190e76c8d6e997156c6276969db8ac6a41219f889eff5 Jul 14 15:16:24.581211 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:24.581120 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" event={"ID":"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d","Type":"ContainerStarted","Data":"7d1ae4b3dab8460a036190e76c8d6e997156c6276969db8ac6a41219f889eff5"} Jul 14 15:16:24.582261 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:24.582235 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:26.593985 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:26.593954 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" event={"ID":"353bb7d5-9c4e-49c9-a6a2-1148bd63b09d","Type":"ContainerStarted","Data":"a04d11d9a012fc76037d183c112e6d9a0cf5b5dbd0c8483551603609492d1d9b"} Jul 14 15:16:26.594377 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:26.594091 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:16:26.623408 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:26.623356 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" podStartSLOduration=1.428798576 podStartE2EDuration="3.623339001s" totalImagesPullingTime="2.194540425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:26.622815337 +0000 UTC m=+341.931933763" watchObservedRunningTime="2026-07-14 15:16:26.623339001 +0000 UTC m=+341.932457427" Jul 14 15:16:28.265038 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.265003 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8"] Jul 14 15:16:28.265856 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.265820 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" podUID="f06fe149-6edf-4f92-8c72-6e57a363c868" containerName="discovery" containerID="cri-o://a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97" gracePeriod=30 Jul 14 15:16:28.515559 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.515490 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:28.588074 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.588037 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-kubeconfig\") pod \"f06fe149-6edf-4f92-8c72-6e57a363c868\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " Jul 14 15:16:28.588239 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.588083 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-token\") pod \"f06fe149-6edf-4f92-8c72-6e57a363c868\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " Jul 14 15:16:28.588239 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.588133 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f06fe149-6edf-4f92-8c72-6e57a363c868-local-certs\") pod \"f06fe149-6edf-4f92-8c72-6e57a363c868\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " Jul 14 15:16:28.588239 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.588163 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-ca-configmap\") pod \"f06fe149-6edf-4f92-8c72-6e57a363c868\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " Jul 14 15:16:28.588239 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.588190 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-cacerts\") pod \"f06fe149-6edf-4f92-8c72-6e57a363c868\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " Jul 14 15:16:28.588239 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.588219 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95hdj\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-kube-api-access-95hdj\") pod \"f06fe149-6edf-4f92-8c72-6e57a363c868\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " Jul 14 15:16:28.588480 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.588297 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-dns-cert\") pod \"f06fe149-6edf-4f92-8c72-6e57a363c868\" (UID: \"f06fe149-6edf-4f92-8c72-6e57a363c868\") " Jul 14 15:16:28.588639 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.588595 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f06fe149-6edf-4f92-8c72-6e57a363c868" (UID: "f06fe149-6edf-4f92-8c72-6e57a363c868"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:16:28.590676 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.590633 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f06fe149-6edf-4f92-8c72-6e57a363c868" (UID: "f06fe149-6edf-4f92-8c72-6e57a363c868"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:16:28.590676 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.590664 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-kube-api-access-95hdj" (OuterVolumeSpecName: "kube-api-access-95hdj") pod "f06fe149-6edf-4f92-8c72-6e57a363c868" (UID: "f06fe149-6edf-4f92-8c72-6e57a363c868"). InnerVolumeSpecName "kube-api-access-95hdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:16:28.590838 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.590672 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-token" (OuterVolumeSpecName: "istio-token") pod "f06fe149-6edf-4f92-8c72-6e57a363c868" (UID: "f06fe149-6edf-4f92-8c72-6e57a363c868"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:16:28.590838 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.590729 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f06fe149-6edf-4f92-8c72-6e57a363c868" (UID: "f06fe149-6edf-4f92-8c72-6e57a363c868"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:16:28.590838 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.590798 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f06fe149-6edf-4f92-8c72-6e57a363c868-local-certs" (OuterVolumeSpecName: "local-certs") pod "f06fe149-6edf-4f92-8c72-6e57a363c868" (UID: "f06fe149-6edf-4f92-8c72-6e57a363c868"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:16:28.590838 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.590804 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-cacerts" (OuterVolumeSpecName: "cacerts") pod "f06fe149-6edf-4f92-8c72-6e57a363c868" (UID: "f06fe149-6edf-4f92-8c72-6e57a363c868"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:16:28.603557 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.603531 2583 generic.go:356] "Generic (PLEG): container finished" podID="f06fe149-6edf-4f92-8c72-6e57a363c868" containerID="a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97" exitCode=0 Jul 14 15:16:28.603668 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.603581 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" event={"ID":"f06fe149-6edf-4f92-8c72-6e57a363c868","Type":"ContainerDied","Data":"a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97"} Jul 14 15:16:28.603668 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.603629 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" event={"ID":"f06fe149-6edf-4f92-8c72-6e57a363c868","Type":"ContainerDied","Data":"511f44119b55286e77cfa225c42025fcbb743328e58c51886475a3a1caa24441"} Jul 14 15:16:28.603668 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.603632 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8" Jul 14 15:16:28.603775 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.603645 2583 scope.go:117] "RemoveContainer" containerID="a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97" Jul 14 15:16:28.612222 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.612206 2583 scope.go:117] "RemoveContainer" containerID="a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97" Jul 14 15:16:28.612470 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:16:28.612451 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97\": container with ID starting with a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97 not found: ID does not exist" containerID="a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97" Jul 14 15:16:28.612561 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.612479 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97"} err="failed to get container status \"a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97\": rpc error: code = NotFound desc = could not find container \"a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97\": container with ID starting with a7a6a44fc36e8840da959e1baa527f441a06bed15c04995e5968bec27712dc97 not found: ID does not exist" Jul 14 15:16:28.628373 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.628348 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8"] Jul 14 15:16:28.636750 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.632690 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vt4g8"] Jul 14 15:16:28.689812 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.689786 2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-dns-cert\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:16:28.689812 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.689811 2583 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-kubeconfig\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:16:28.689974 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.689821 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-token\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:16:28.689974 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.689830 2583 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f06fe149-6edf-4f92-8c72-6e57a363c868-local-certs\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:16:28.689974 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.689839 2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f06fe149-6edf-4f92-8c72-6e57a363c868-istio-csr-ca-configmap\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:16:28.689974 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.689847 2583 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f06fe149-6edf-4f92-8c72-6e57a363c868-cacerts\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:16:28.689974 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:28.689855 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95hdj\" (UniqueName: \"kubernetes.io/projected/f06fe149-6edf-4f92-8c72-6e57a363c868-kube-api-access-95hdj\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:16:29.195357 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:29.195325 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f06fe149-6edf-4f92-8c72-6e57a363c868" path="/var/lib/kubelet/pods/f06fe149-6edf-4f92-8c72-6e57a363c868/volumes" Jul 14 15:16:34.583703 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:34.583671 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hjc4z" Jul 14 15:16:34.585702 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:34.585683 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-m6xgx" Jul 14 15:16:37.600546 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:16:37.600452 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-755b7b9d47-2b2dt" Jul 14 15:17:55.648425 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:17:55.648384 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfc665f84-svn25"] Jul 14 15:18:03.861577 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.861542 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z5692"] Jul 14 15:18:03.861926 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.861842 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06fe149-6edf-4f92-8c72-6e57a363c868" containerName="discovery" Jul 14 15:18:03.861926 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.861854 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06fe149-6edf-4f92-8c72-6e57a363c868" containerName="discovery" Jul 14 15:18:03.861993 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.861929 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06fe149-6edf-4f92-8c72-6e57a363c868" containerName="discovery" Jul 14 15:18:03.864850 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.864831 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:03.867597 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.867577 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 14 15:18:03.868686 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.868658 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 15:18:03.868686 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.868669 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xq8sb\"" Jul 14 15:18:03.868819 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.868660 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 14 15:18:03.868819 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.868731 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 15:18:03.876607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.876589 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z5692"] Jul 14 15:18:03.904171 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.904149 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/be32d5a5-7bbd-4740-9749-78f9d57a04a8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z5692\" (UID: \"be32d5a5-7bbd-4740-9749-78f9d57a04a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:03.904269 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.904196 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be32d5a5-7bbd-4740-9749-78f9d57a04a8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z5692\" (UID: \"be32d5a5-7bbd-4740-9749-78f9d57a04a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:03.904316 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:03.904265 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t59v5\" (UniqueName: \"kubernetes.io/projected/be32d5a5-7bbd-4740-9749-78f9d57a04a8-kube-api-access-t59v5\") pod \"kuadrant-console-plugin-66b5774985-z5692\" (UID: \"be32d5a5-7bbd-4740-9749-78f9d57a04a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:04.004776 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:04.004750 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be32d5a5-7bbd-4740-9749-78f9d57a04a8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z5692\" (UID: \"be32d5a5-7bbd-4740-9749-78f9d57a04a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:04.004876 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:04.004810 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t59v5\" (UniqueName: \"kubernetes.io/projected/be32d5a5-7bbd-4740-9749-78f9d57a04a8-kube-api-access-t59v5\") pod \"kuadrant-console-plugin-66b5774985-z5692\" (UID: \"be32d5a5-7bbd-4740-9749-78f9d57a04a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:04.004876 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:04.004832 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/be32d5a5-7bbd-4740-9749-78f9d57a04a8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z5692\" (UID: \"be32d5a5-7bbd-4740-9749-78f9d57a04a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:04.005390 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:04.005361 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be32d5a5-7bbd-4740-9749-78f9d57a04a8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z5692\" (UID: \"be32d5a5-7bbd-4740-9749-78f9d57a04a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:04.007270 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:04.007253 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/be32d5a5-7bbd-4740-9749-78f9d57a04a8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z5692\" (UID: \"be32d5a5-7bbd-4740-9749-78f9d57a04a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:04.016407 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:04.016383 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t59v5\" (UniqueName: \"kubernetes.io/projected/be32d5a5-7bbd-4740-9749-78f9d57a04a8-kube-api-access-t59v5\") pod \"kuadrant-console-plugin-66b5774985-z5692\" (UID: \"be32d5a5-7bbd-4740-9749-78f9d57a04a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:04.173735 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:04.173709 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" Jul 14 15:18:04.300237 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:04.300213 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z5692"] Jul 14 15:18:04.302373 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:18:04.302347 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe32d5a5_7bbd_4740_9749_78f9d57a04a8.slice/crio-313ac5a52121fabff16a7e03730e5a51bc0af72b361c454a9dbfda3325327b4e WatchSource:0}: Error finding container 313ac5a52121fabff16a7e03730e5a51bc0af72b361c454a9dbfda3325327b4e: Status 404 returned error can't find the container with id 313ac5a52121fabff16a7e03730e5a51bc0af72b361c454a9dbfda3325327b4e Jul 14 15:18:05.028030 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:05.027993 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" event={"ID":"be32d5a5-7bbd-4740-9749-78f9d57a04a8","Type":"ContainerStarted","Data":"313ac5a52121fabff16a7e03730e5a51bc0af72b361c454a9dbfda3325327b4e"} Jul 14 15:18:20.669272 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:20.669232 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cfc665f84-svn25" podUID="c7f05897-f8f3-4b6d-aa02-ccf6667d714f" containerName="console" containerID="cri-o://7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d" gracePeriod=15 Jul 14 15:18:28.529210 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.529182 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:18:28.626199 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626139 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46pbk\" (UniqueName: \"kubernetes.io/projected/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-kube-api-access-46pbk\") pod \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " Jul 14 15:18:28.626199 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626168 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-oauth-serving-cert\") pod \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " Jul 14 15:18:28.626199 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626200 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-trusted-ca-bundle\") pod \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " Jul 14 15:18:28.626433 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626221 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-oauth-config\") pod \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " Jul 14 15:18:28.626433 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626249 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-config\") pod \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " Jul 14 15:18:28.626433 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626318 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-serving-cert\") pod \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " Jul 14 15:18:28.626433 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626369 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-service-ca\") pod \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\" (UID: \"c7f05897-f8f3-4b6d-aa02-ccf6667d714f\") " Jul 14 15:18:28.626666 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626611 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7f05897-f8f3-4b6d-aa02-ccf6667d714f" (UID: "c7f05897-f8f3-4b6d-aa02-ccf6667d714f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:18:28.626666 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626625 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7f05897-f8f3-4b6d-aa02-ccf6667d714f" (UID: "c7f05897-f8f3-4b6d-aa02-ccf6667d714f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:18:28.626761 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626700 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-config" (OuterVolumeSpecName: "console-config") pod "c7f05897-f8f3-4b6d-aa02-ccf6667d714f" (UID: "c7f05897-f8f3-4b6d-aa02-ccf6667d714f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:18:28.626876 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.626858 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7f05897-f8f3-4b6d-aa02-ccf6667d714f" (UID: "c7f05897-f8f3-4b6d-aa02-ccf6667d714f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:18:28.628349 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.628323 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7f05897-f8f3-4b6d-aa02-ccf6667d714f" (UID: "c7f05897-f8f3-4b6d-aa02-ccf6667d714f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:18:28.628721 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.628703 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7f05897-f8f3-4b6d-aa02-ccf6667d714f" (UID: "c7f05897-f8f3-4b6d-aa02-ccf6667d714f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:18:28.628789 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.628700 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-kube-api-access-46pbk" (OuterVolumeSpecName: "kube-api-access-46pbk") pod "c7f05897-f8f3-4b6d-aa02-ccf6667d714f" (UID: "c7f05897-f8f3-4b6d-aa02-ccf6667d714f"). InnerVolumeSpecName "kube-api-access-46pbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:18:28.727220 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.727186 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-serving-cert\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:18:28.727220 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.727218 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-service-ca\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:18:28.727220 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.727227 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46pbk\" (UniqueName: \"kubernetes.io/projected/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-kube-api-access-46pbk\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:18:28.727379 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.727236 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-oauth-serving-cert\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:18:28.727379 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.727244 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-trusted-ca-bundle\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:18:28.727379 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.727252 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-oauth-config\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:18:28.727379 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:28.727262 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7f05897-f8f3-4b6d-aa02-ccf6667d714f-console-config\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:18:29.147336 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.147307 2583 generic.go:356] "Generic (PLEG): container finished" podID="c7f05897-f8f3-4b6d-aa02-ccf6667d714f" containerID="7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d" exitCode=0 Jul 14 15:18:29.147476 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.147349 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfc665f84-svn25" Jul 14 15:18:29.147476 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.147387 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfc665f84-svn25" event={"ID":"c7f05897-f8f3-4b6d-aa02-ccf6667d714f","Type":"ContainerDied","Data":"7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d"} Jul 14 15:18:29.147476 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.147436 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfc665f84-svn25" event={"ID":"c7f05897-f8f3-4b6d-aa02-ccf6667d714f","Type":"ContainerDied","Data":"c68c30c9450c17378d71f9a7ce579e07d1a9521e739e66e61e67edaee7a69754"} Jul 14 15:18:29.147476 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.147467 2583 scope.go:117] "RemoveContainer" containerID="7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d" Jul 14 15:18:29.148961 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.148940 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" event={"ID":"be32d5a5-7bbd-4740-9749-78f9d57a04a8","Type":"ContainerStarted","Data":"18039d0f9f3164b4a293c547db58df79c57480e435e3fd6eb9c5d2607f570608"} Jul 14 15:18:29.156208 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.156193 2583 scope.go:117] "RemoveContainer" containerID="7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d" Jul 14 15:18:29.156457 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:18:29.156438 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d\": container with ID starting with 7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d not found: ID does not exist" containerID="7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d" Jul 14 15:18:29.156516 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.156463 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d"} err="failed to get container status \"7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d\": rpc error: code = NotFound desc = could not find container \"7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d\": container with ID starting with 7e11e65006d08df2e62a7bd17925ca451ca613edcbe9298947a1517f401e140d not found: ID does not exist" Jul 14 15:18:29.175395 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.175346 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z5692" podStartSLOduration=2.027435048 podStartE2EDuration="26.175330234s" totalImagesPullingTime="24.147895186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:18:29.175058224 +0000 UTC m=+464.484176651" watchObservedRunningTime="2026-07-14 15:18:29.175330234 +0000 UTC m=+464.484448663" Jul 14 15:18:29.195548 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.194897 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfc665f84-svn25"] Jul 14 15:18:29.197309 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:29.197284 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cfc665f84-svn25"] Jul 14 15:18:31.194323 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:31.194291 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7f05897-f8f3-4b6d-aa02-ccf6667d714f" path="/var/lib/kubelet/pods/c7f05897-f8f3-4b6d-aa02-ccf6667d714f/volumes" Jul 14 15:18:58.692353 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.692316 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xb62j"] Jul 14 15:18:58.692835 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.692651 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f05897-f8f3-4b6d-aa02-ccf6667d714f" containerName="console" Jul 14 15:18:58.692835 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.692662 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f05897-f8f3-4b6d-aa02-ccf6667d714f" containerName="console" Jul 14 15:18:58.692835 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.692716 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f05897-f8f3-4b6d-aa02-ccf6667d714f" containerName="console" Jul 14 15:18:58.724717 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.724688 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xb62j"] Jul 14 15:18:58.724861 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.724777 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xb62j" Jul 14 15:18:58.727298 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.727275 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x9v7d\"" Jul 14 15:18:58.842032 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.841999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nz5w\" (UniqueName: \"kubernetes.io/projected/e928f9f8-997c-4408-a41c-fbf762dfdbd3-kube-api-access-6nz5w\") pod \"authorino-58cd955675-xb62j\" (UID: \"e928f9f8-997c-4408-a41c-fbf762dfdbd3\") " pod="kuadrant-system/authorino-58cd955675-xb62j" Jul 14 15:18:58.854195 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.854164 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vp5cj"] Jul 14 15:18:58.860460 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.860438 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vp5cj" Jul 14 15:18:58.864339 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.864316 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vp5cj"] Jul 14 15:18:58.943296 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.943231 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nz5w\" (UniqueName: \"kubernetes.io/projected/e928f9f8-997c-4408-a41c-fbf762dfdbd3-kube-api-access-6nz5w\") pod \"authorino-58cd955675-xb62j\" (UID: \"e928f9f8-997c-4408-a41c-fbf762dfdbd3\") " pod="kuadrant-system/authorino-58cd955675-xb62j" Jul 14 15:18:58.951039 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:58.951014 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nz5w\" (UniqueName: \"kubernetes.io/projected/e928f9f8-997c-4408-a41c-fbf762dfdbd3-kube-api-access-6nz5w\") pod \"authorino-58cd955675-xb62j\" (UID: \"e928f9f8-997c-4408-a41c-fbf762dfdbd3\") " pod="kuadrant-system/authorino-58cd955675-xb62j" Jul 14 15:18:59.033894 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:59.033870 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xb62j" Jul 14 15:18:59.044340 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:59.044311 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtl4s\" (UniqueName: \"kubernetes.io/projected/4f727138-3167-40ba-82b6-64ad4756c9ad-kube-api-access-xtl4s\") pod \"authorino-75d556bd77-vp5cj\" (UID: \"4f727138-3167-40ba-82b6-64ad4756c9ad\") " pod="kuadrant-system/authorino-75d556bd77-vp5cj" Jul 14 15:18:59.145094 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:59.145068 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtl4s\" (UniqueName: \"kubernetes.io/projected/4f727138-3167-40ba-82b6-64ad4756c9ad-kube-api-access-xtl4s\") pod \"authorino-75d556bd77-vp5cj\" (UID: \"4f727138-3167-40ba-82b6-64ad4756c9ad\") " pod="kuadrant-system/authorino-75d556bd77-vp5cj" Jul 14 15:18:59.154056 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:59.154032 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtl4s\" (UniqueName: \"kubernetes.io/projected/4f727138-3167-40ba-82b6-64ad4756c9ad-kube-api-access-xtl4s\") pod \"authorino-75d556bd77-vp5cj\" (UID: \"4f727138-3167-40ba-82b6-64ad4756c9ad\") " pod="kuadrant-system/authorino-75d556bd77-vp5cj" Jul 14 15:18:59.170807 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:59.170783 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vp5cj" Jul 14 15:18:59.174358 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:59.174339 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xb62j"] Jul 14 15:18:59.176853 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:18:59.176831 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode928f9f8_997c_4408_a41c_fbf762dfdbd3.slice/crio-52668ec0f5b015be5dfa2b2d17d88f35def25030a886226860e179e872e6e88b WatchSource:0}: Error finding container 52668ec0f5b015be5dfa2b2d17d88f35def25030a886226860e179e872e6e88b: Status 404 returned error can't find the container with id 52668ec0f5b015be5dfa2b2d17d88f35def25030a886226860e179e872e6e88b Jul 14 15:18:59.285663 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:59.285625 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xb62j" event={"ID":"e928f9f8-997c-4408-a41c-fbf762dfdbd3","Type":"ContainerStarted","Data":"52668ec0f5b015be5dfa2b2d17d88f35def25030a886226860e179e872e6e88b"} Jul 14 15:18:59.357915 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:18:59.357885 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vp5cj"] Jul 14 15:18:59.362707 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:18:59.362680 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f727138_3167_40ba_82b6_64ad4756c9ad.slice/crio-13af89bcf1c4a7e2a90b583a6d4fa77ba57c37331a3323927ea1022fb84300ff WatchSource:0}: Error finding container 13af89bcf1c4a7e2a90b583a6d4fa77ba57c37331a3323927ea1022fb84300ff: Status 404 returned error can't find the container with id 13af89bcf1c4a7e2a90b583a6d4fa77ba57c37331a3323927ea1022fb84300ff Jul 14 15:19:00.295784 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:00.295704 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vp5cj" event={"ID":"4f727138-3167-40ba-82b6-64ad4756c9ad","Type":"ContainerStarted","Data":"13af89bcf1c4a7e2a90b583a6d4fa77ba57c37331a3323927ea1022fb84300ff"} Jul 14 15:19:03.313681 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:03.313649 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vp5cj" event={"ID":"4f727138-3167-40ba-82b6-64ad4756c9ad","Type":"ContainerStarted","Data":"943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0"} Jul 14 15:19:03.315119 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:03.315097 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xb62j" event={"ID":"e928f9f8-997c-4408-a41c-fbf762dfdbd3","Type":"ContainerStarted","Data":"b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227"} Jul 14 15:19:03.329213 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:03.329160 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vp5cj" podStartSLOduration=1.903675805 podStartE2EDuration="5.329145561s" totalImagesPullingTime="3.425469756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:19:03.327544636 +0000 UTC m=+498.636663063" watchObservedRunningTime="2026-07-14 15:19:03.329145561 +0000 UTC m=+498.638263987" Jul 14 15:19:03.341702 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:03.341663 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xb62j" podStartSLOduration=1.742053845 podStartE2EDuration="5.341646396s" totalImagesPullingTime="3.599592551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:19:03.340557007 +0000 UTC m=+498.649675433" watchObservedRunningTime="2026-07-14 15:19:03.341646396 +0000 UTC m=+498.650764822" Jul 14 15:19:03.364923 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:03.364896 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xb62j"] Jul 14 15:19:05.323012 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:05.322976 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xb62j" podUID="e928f9f8-997c-4408-a41c-fbf762dfdbd3" containerName="authorino" containerID="cri-o://b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227" gracePeriod=30 Jul 14 15:19:05.560693 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:05.560667 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xb62j" Jul 14 15:19:05.599452 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:05.599395 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nz5w\" (UniqueName: \"kubernetes.io/projected/e928f9f8-997c-4408-a41c-fbf762dfdbd3-kube-api-access-6nz5w\") pod \"e928f9f8-997c-4408-a41c-fbf762dfdbd3\" (UID: \"e928f9f8-997c-4408-a41c-fbf762dfdbd3\") " Jul 14 15:19:05.601402 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:05.601381 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e928f9f8-997c-4408-a41c-fbf762dfdbd3-kube-api-access-6nz5w" (OuterVolumeSpecName: "kube-api-access-6nz5w") pod "e928f9f8-997c-4408-a41c-fbf762dfdbd3" (UID: "e928f9f8-997c-4408-a41c-fbf762dfdbd3"). InnerVolumeSpecName "kube-api-access-6nz5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:19:05.700594 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:05.700573 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nz5w\" (UniqueName: \"kubernetes.io/projected/e928f9f8-997c-4408-a41c-fbf762dfdbd3-kube-api-access-6nz5w\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:19:06.328055 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:06.328027 2583 generic.go:356] "Generic (PLEG): container finished" podID="e928f9f8-997c-4408-a41c-fbf762dfdbd3" containerID="b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227" exitCode=0 Jul 14 15:19:06.328422 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:06.328058 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xb62j" Jul 14 15:19:06.328422 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:06.328076 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xb62j" event={"ID":"e928f9f8-997c-4408-a41c-fbf762dfdbd3","Type":"ContainerDied","Data":"b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227"} Jul 14 15:19:06.328422 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:06.328109 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xb62j" event={"ID":"e928f9f8-997c-4408-a41c-fbf762dfdbd3","Type":"ContainerDied","Data":"52668ec0f5b015be5dfa2b2d17d88f35def25030a886226860e179e872e6e88b"} Jul 14 15:19:06.328422 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:06.328153 2583 scope.go:117] "RemoveContainer" containerID="b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227" Jul 14 15:19:06.336546 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:06.336531 2583 scope.go:117] "RemoveContainer" containerID="b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227" Jul 14 15:19:06.336784 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:19:06.336769 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227\": container with ID starting with b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227 not found: ID does not exist" containerID="b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227" Jul 14 15:19:06.336824 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:06.336792 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227"} err="failed to get container status \"b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227\": rpc error: code = NotFound desc = could not find container \"b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227\": container with ID starting with b30d67c2c74e2567f190e947a70f265920d6b03bf93df1a61b4b810736392227 not found: ID does not exist" Jul 14 15:19:06.347740 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:06.347720 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xb62j"] Jul 14 15:19:06.352223 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:06.352203 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xb62j"] Jul 14 15:19:07.194634 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:07.194609 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e928f9f8-997c-4408-a41c-fbf762dfdbd3" path="/var/lib/kubelet/pods/e928f9f8-997c-4408-a41c-fbf762dfdbd3/volumes" Jul 14 15:19:32.196695 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.196657 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s69v2"] Jul 14 15:19:32.197320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.197105 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e928f9f8-997c-4408-a41c-fbf762dfdbd3" containerName="authorino" Jul 14 15:19:32.197320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.197127 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e928f9f8-997c-4408-a41c-fbf762dfdbd3" containerName="authorino" Jul 14 15:19:32.197320 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.197232 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e928f9f8-997c-4408-a41c-fbf762dfdbd3" containerName="authorino" Jul 14 15:19:32.204699 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.204672 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s69v2" Jul 14 15:19:32.206792 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.206768 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s69v2"] Jul 14 15:19:32.286844 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.286825 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndp59\" (UniqueName: \"kubernetes.io/projected/bab3b36c-63a4-4d8c-8912-552a8d5cba5a-kube-api-access-ndp59\") pod \"authorino-5d4b67c446-s69v2\" (UID: \"bab3b36c-63a4-4d8c-8912-552a8d5cba5a\") " pod="kuadrant-system/authorino-5d4b67c446-s69v2" Jul 14 15:19:32.388011 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.387993 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndp59\" (UniqueName: \"kubernetes.io/projected/bab3b36c-63a4-4d8c-8912-552a8d5cba5a-kube-api-access-ndp59\") pod \"authorino-5d4b67c446-s69v2\" (UID: \"bab3b36c-63a4-4d8c-8912-552a8d5cba5a\") " pod="kuadrant-system/authorino-5d4b67c446-s69v2" Jul 14 15:19:32.396063 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.396047 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndp59\" (UniqueName: \"kubernetes.io/projected/bab3b36c-63a4-4d8c-8912-552a8d5cba5a-kube-api-access-ndp59\") pod \"authorino-5d4b67c446-s69v2\" (UID: \"bab3b36c-63a4-4d8c-8912-552a8d5cba5a\") " pod="kuadrant-system/authorino-5d4b67c446-s69v2" Jul 14 15:19:32.444079 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.444054 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s69v2"] Jul 14 15:19:32.444212 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.444202 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s69v2" Jul 14 15:19:32.471428 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.471408 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cd9f44cb6-sxw7v"] Jul 14 15:19:32.475220 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.475203 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd9f44cb6-sxw7v" Jul 14 15:19:32.482513 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.482470 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cd9f44cb6-sxw7v"] Jul 14 15:19:32.502249 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.502221 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cd9f44cb6-sxw7v"] Jul 14 15:19:32.502542 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:19:32.502485 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qpdrw], unattached volumes=[], failed to process volumes=[kube-api-access-qpdrw]: context canceled" pod="kuadrant-system/authorino-7cd9f44cb6-sxw7v" podUID="44c19bbd-eaec-45b2-86d8-be1ddadb2632" Jul 14 15:19:32.574566 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.574540 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s69v2"] Jul 14 15:19:32.576638 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:19:32.576606 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbab3b36c_63a4_4d8c_8912_552a8d5cba5a.slice/crio-530c761fc1f155df6bb73b1a6110c919e80d59f46bcf420fa2ab68c76211ef17 WatchSource:0}: Error finding container 530c761fc1f155df6bb73b1a6110c919e80d59f46bcf420fa2ab68c76211ef17: Status 404 returned error can't find the container with id 530c761fc1f155df6bb73b1a6110c919e80d59f46bcf420fa2ab68c76211ef17 Jul 14 15:19:32.589586 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.589564 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpdrw\" (UniqueName: \"kubernetes.io/projected/44c19bbd-eaec-45b2-86d8-be1ddadb2632-kube-api-access-qpdrw\") pod \"authorino-7cd9f44cb6-sxw7v\" (UID: \"44c19bbd-eaec-45b2-86d8-be1ddadb2632\") " pod="kuadrant-system/authorino-7cd9f44cb6-sxw7v" Jul 14 15:19:32.689879 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.689856 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpdrw\" (UniqueName: \"kubernetes.io/projected/44c19bbd-eaec-45b2-86d8-be1ddadb2632-kube-api-access-qpdrw\") pod \"authorino-7cd9f44cb6-sxw7v\" (UID: \"44c19bbd-eaec-45b2-86d8-be1ddadb2632\") " pod="kuadrant-system/authorino-7cd9f44cb6-sxw7v" Jul 14 15:19:32.698583 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:32.698535 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpdrw\" (UniqueName: \"kubernetes.io/projected/44c19bbd-eaec-45b2-86d8-be1ddadb2632-kube-api-access-qpdrw\") pod \"authorino-7cd9f44cb6-sxw7v\" (UID: \"44c19bbd-eaec-45b2-86d8-be1ddadb2632\") " pod="kuadrant-system/authorino-7cd9f44cb6-sxw7v" Jul 14 15:19:33.443547 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.443518 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd9f44cb6-sxw7v" Jul 14 15:19:33.443975 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.443545 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s69v2" event={"ID":"bab3b36c-63a4-4d8c-8912-552a8d5cba5a","Type":"ContainerStarted","Data":"1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd"} Jul 14 15:19:33.443975 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.443565 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-s69v2" podUID="bab3b36c-63a4-4d8c-8912-552a8d5cba5a" containerName="authorino" containerID="cri-o://1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd" gracePeriod=30 Jul 14 15:19:33.443975 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.443579 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s69v2" event={"ID":"bab3b36c-63a4-4d8c-8912-552a8d5cba5a","Type":"ContainerStarted","Data":"530c761fc1f155df6bb73b1a6110c919e80d59f46bcf420fa2ab68c76211ef17"} Jul 14 15:19:33.450849 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.450827 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd9f44cb6-sxw7v" Jul 14 15:19:33.459520 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.459462 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-s69v2" podStartSLOduration=1.061748518 podStartE2EDuration="1.459449592s" totalImagesPullingTime="397.701074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:19:33.457913239 +0000 UTC m=+528.767031661" watchObservedRunningTime="2026-07-14 15:19:33.459449592 +0000 UTC m=+528.768568018" Jul 14 15:19:33.495457 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.495439 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpdrw\" (UniqueName: \"kubernetes.io/projected/44c19bbd-eaec-45b2-86d8-be1ddadb2632-kube-api-access-qpdrw\") pod \"44c19bbd-eaec-45b2-86d8-be1ddadb2632\" (UID: \"44c19bbd-eaec-45b2-86d8-be1ddadb2632\") " Jul 14 15:19:33.497314 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.497291 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44c19bbd-eaec-45b2-86d8-be1ddadb2632-kube-api-access-qpdrw" (OuterVolumeSpecName: "kube-api-access-qpdrw") pod "44c19bbd-eaec-45b2-86d8-be1ddadb2632" (UID: "44c19bbd-eaec-45b2-86d8-be1ddadb2632"). InnerVolumeSpecName "kube-api-access-qpdrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:19:33.596084 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.596055 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpdrw\" (UniqueName: \"kubernetes.io/projected/44c19bbd-eaec-45b2-86d8-be1ddadb2632-kube-api-access-qpdrw\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:19:33.687492 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.687471 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s69v2" Jul 14 15:19:33.797226 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.797174 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndp59\" (UniqueName: \"kubernetes.io/projected/bab3b36c-63a4-4d8c-8912-552a8d5cba5a-kube-api-access-ndp59\") pod \"bab3b36c-63a4-4d8c-8912-552a8d5cba5a\" (UID: \"bab3b36c-63a4-4d8c-8912-552a8d5cba5a\") " Jul 14 15:19:33.799050 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.799030 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bab3b36c-63a4-4d8c-8912-552a8d5cba5a-kube-api-access-ndp59" (OuterVolumeSpecName: "kube-api-access-ndp59") pod "bab3b36c-63a4-4d8c-8912-552a8d5cba5a" (UID: "bab3b36c-63a4-4d8c-8912-552a8d5cba5a"). InnerVolumeSpecName "kube-api-access-ndp59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:19:33.898537 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:33.898495 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndp59\" (UniqueName: \"kubernetes.io/projected/bab3b36c-63a4-4d8c-8912-552a8d5cba5a-kube-api-access-ndp59\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:19:34.448866 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.448841 2583 generic.go:356] "Generic (PLEG): container finished" podID="bab3b36c-63a4-4d8c-8912-552a8d5cba5a" containerID="1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd" exitCode=0 Jul 14 15:19:34.449201 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.448888 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s69v2" Jul 14 15:19:34.449201 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.448924 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s69v2" event={"ID":"bab3b36c-63a4-4d8c-8912-552a8d5cba5a","Type":"ContainerDied","Data":"1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd"} Jul 14 15:19:34.449201 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.448963 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s69v2" event={"ID":"bab3b36c-63a4-4d8c-8912-552a8d5cba5a","Type":"ContainerDied","Data":"530c761fc1f155df6bb73b1a6110c919e80d59f46bcf420fa2ab68c76211ef17"} Jul 14 15:19:34.449201 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.448981 2583 scope.go:117] "RemoveContainer" containerID="1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd" Jul 14 15:19:34.449201 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.449078 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd9f44cb6-sxw7v" Jul 14 15:19:34.458161 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.458143 2583 scope.go:117] "RemoveContainer" containerID="1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd" Jul 14 15:19:34.458417 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:19:34.458399 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd\": container with ID starting with 1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd not found: ID does not exist" containerID="1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd" Jul 14 15:19:34.458466 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.458425 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd"} err="failed to get container status \"1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd\": rpc error: code = NotFound desc = could not find container \"1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd\": container with ID starting with 1c6218e3b0db6bd0906cc018cb4d88f0e1136536266d4a75b6b91e1ad46e9fbd not found: ID does not exist" Jul 14 15:19:34.469851 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.469819 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s69v2"] Jul 14 15:19:34.473425 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.473407 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s69v2"] Jul 14 15:19:34.495177 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.495157 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cd9f44cb6-sxw7v"] Jul 14 15:19:34.498910 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:34.498888 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7cd9f44cb6-sxw7v"] Jul 14 15:19:35.193966 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:35.193938 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44c19bbd-eaec-45b2-86d8-be1ddadb2632" path="/var/lib/kubelet/pods/44c19bbd-eaec-45b2-86d8-be1ddadb2632/volumes" Jul 14 15:19:35.194169 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:35.194153 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bab3b36c-63a4-4d8c-8912-552a8d5cba5a" path="/var/lib/kubelet/pods/bab3b36c-63a4-4d8c-8912-552a8d5cba5a/volumes" Jul 14 15:19:38.661483 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:38.661413 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vp5cj"] Jul 14 15:19:38.661919 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:38.661610 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vp5cj" podUID="4f727138-3167-40ba-82b6-64ad4756c9ad" containerName="authorino" containerID="cri-o://943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0" gracePeriod=30 Jul 14 15:19:38.906542 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:38.906521 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vp5cj" Jul 14 15:19:39.035614 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.035546 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtl4s\" (UniqueName: \"kubernetes.io/projected/4f727138-3167-40ba-82b6-64ad4756c9ad-kube-api-access-xtl4s\") pod \"4f727138-3167-40ba-82b6-64ad4756c9ad\" (UID: \"4f727138-3167-40ba-82b6-64ad4756c9ad\") " Jul 14 15:19:39.037441 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.037419 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f727138-3167-40ba-82b6-64ad4756c9ad-kube-api-access-xtl4s" (OuterVolumeSpecName: "kube-api-access-xtl4s") pod "4f727138-3167-40ba-82b6-64ad4756c9ad" (UID: "4f727138-3167-40ba-82b6-64ad4756c9ad"). InnerVolumeSpecName "kube-api-access-xtl4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:19:39.136838 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.136814 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtl4s\" (UniqueName: \"kubernetes.io/projected/4f727138-3167-40ba-82b6-64ad4756c9ad-kube-api-access-xtl4s\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:19:39.472018 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.471990 2583 generic.go:356] "Generic (PLEG): container finished" podID="4f727138-3167-40ba-82b6-64ad4756c9ad" containerID="943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0" exitCode=0 Jul 14 15:19:39.472133 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.472030 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vp5cj" Jul 14 15:19:39.472133 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.472072 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vp5cj" event={"ID":"4f727138-3167-40ba-82b6-64ad4756c9ad","Type":"ContainerDied","Data":"943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0"} Jul 14 15:19:39.472133 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.472100 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vp5cj" event={"ID":"4f727138-3167-40ba-82b6-64ad4756c9ad","Type":"ContainerDied","Data":"13af89bcf1c4a7e2a90b583a6d4fa77ba57c37331a3323927ea1022fb84300ff"} Jul 14 15:19:39.472133 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.472116 2583 scope.go:117] "RemoveContainer" containerID="943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0" Jul 14 15:19:39.479922 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.479907 2583 scope.go:117] "RemoveContainer" containerID="943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0" Jul 14 15:19:39.480167 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:19:39.480148 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0\": container with ID starting with 943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0 not found: ID does not exist" containerID="943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0" Jul 14 15:19:39.480212 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.480176 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0"} err="failed to get container status \"943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0\": rpc error: code = NotFound desc = could not find container \"943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0\": container with ID starting with 943d39e8f0a18da7beee4438e7c5d75373ea4ea266327c658f0ce527cb68bcf0 not found: ID does not exist" Jul 14 15:19:39.492332 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.492311 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vp5cj"] Jul 14 15:19:39.495930 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:39.495912 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vp5cj"] Jul 14 15:19:41.194094 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:41.194054 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f727138-3167-40ba-82b6-64ad4756c9ad" path="/var/lib/kubelet/pods/4f727138-3167-40ba-82b6-64ad4756c9ad/volumes" Jul 14 15:19:43.617808 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.617776 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c5fcf5655-pzjwf"] Jul 14 15:19:43.618242 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.618069 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bab3b36c-63a4-4d8c-8912-552a8d5cba5a" containerName="authorino" Jul 14 15:19:43.618242 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.618080 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bab3b36c-63a4-4d8c-8912-552a8d5cba5a" containerName="authorino" Jul 14 15:19:43.618242 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.618105 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f727138-3167-40ba-82b6-64ad4756c9ad" containerName="authorino" Jul 14 15:19:43.618242 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.618110 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f727138-3167-40ba-82b6-64ad4756c9ad" containerName="authorino" Jul 14 15:19:43.618242 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.618174 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bab3b36c-63a4-4d8c-8912-552a8d5cba5a" containerName="authorino" Jul 14 15:19:43.618242 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.618183 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f727138-3167-40ba-82b6-64ad4756c9ad" containerName="authorino" Jul 14 15:19:43.622290 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.622271 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:43.628304 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.628124 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 15:19:43.628433 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.628416 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 15:19:43.632012 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.631986 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rpn2l\"" Jul 14 15:19:43.659699 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.659674 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c5fcf5655-pzjwf"] Jul 14 15:19:43.770034 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.770001 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqh9b\" (UniqueName: \"kubernetes.io/projected/7856c73c-3c87-4a8f-9b09-219d37af5752-kube-api-access-qqh9b\") pod \"maas-controller-6c5fcf5655-pzjwf\" (UID: \"7856c73c-3c87-4a8f-9b09-219d37af5752\") " pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:43.770162 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.770051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7856c73c-3c87-4a8f-9b09-219d37af5752-webhook-cert\") pod \"maas-controller-6c5fcf5655-pzjwf\" (UID: \"7856c73c-3c87-4a8f-9b09-219d37af5752\") " pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:43.870725 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.870664 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqh9b\" (UniqueName: \"kubernetes.io/projected/7856c73c-3c87-4a8f-9b09-219d37af5752-kube-api-access-qqh9b\") pod \"maas-controller-6c5fcf5655-pzjwf\" (UID: \"7856c73c-3c87-4a8f-9b09-219d37af5752\") " pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:43.870725 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.870704 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7856c73c-3c87-4a8f-9b09-219d37af5752-webhook-cert\") pod \"maas-controller-6c5fcf5655-pzjwf\" (UID: \"7856c73c-3c87-4a8f-9b09-219d37af5752\") " pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:43.872995 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.872970 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7856c73c-3c87-4a8f-9b09-219d37af5752-webhook-cert\") pod \"maas-controller-6c5fcf5655-pzjwf\" (UID: \"7856c73c-3c87-4a8f-9b09-219d37af5752\") " pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:43.876291 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.876270 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57d7d8975-mbpwt"] Jul 14 15:19:43.879495 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.879475 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:43.886043 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.885988 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqh9b\" (UniqueName: \"kubernetes.io/projected/7856c73c-3c87-4a8f-9b09-219d37af5752-kube-api-access-qqh9b\") pod \"maas-controller-6c5fcf5655-pzjwf\" (UID: \"7856c73c-3c87-4a8f-9b09-219d37af5752\") " pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:43.890366 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.890344 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57d7d8975-mbpwt"] Jul 14 15:19:43.935949 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.935926 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:43.972115 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.972090 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvvvg\" (UniqueName: \"kubernetes.io/projected/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-kube-api-access-cvvvg\") pod \"maas-controller-57d7d8975-mbpwt\" (UID: \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\") " pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:43.972230 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:43.972129 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-webhook-cert\") pod \"maas-controller-57d7d8975-mbpwt\" (UID: \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\") " pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:44.060787 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:44.060762 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c5fcf5655-pzjwf"] Jul 14 15:19:44.062481 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:19:44.062450 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7856c73c_3c87_4a8f_9b09_219d37af5752.slice/crio-df60de75091c1b577c7e2b3c9ec65f7c199ff36e9da66c59a9ce8c6e193b45ed WatchSource:0}: Error finding container df60de75091c1b577c7e2b3c9ec65f7c199ff36e9da66c59a9ce8c6e193b45ed: Status 404 returned error can't find the container with id df60de75091c1b577c7e2b3c9ec65f7c199ff36e9da66c59a9ce8c6e193b45ed Jul 14 15:19:44.072694 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:44.072669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvvvg\" (UniqueName: \"kubernetes.io/projected/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-kube-api-access-cvvvg\") pod \"maas-controller-57d7d8975-mbpwt\" (UID: \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\") " pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:44.072795 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:44.072705 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-webhook-cert\") pod \"maas-controller-57d7d8975-mbpwt\" (UID: \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\") " pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:44.074856 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:44.074837 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-webhook-cert\") pod \"maas-controller-57d7d8975-mbpwt\" (UID: \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\") " pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:44.081475 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:44.081450 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvvvg\" (UniqueName: \"kubernetes.io/projected/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-kube-api-access-cvvvg\") pod \"maas-controller-57d7d8975-mbpwt\" (UID: \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\") " pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:44.197871 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:44.197847 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:44.327309 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:44.327274 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57d7d8975-mbpwt"] Jul 14 15:19:44.329354 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:19:44.329328 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8758d08e_d2b4_44fb_8a8b_4d59f1178df9.slice/crio-9250f4f799cf9084c07d9e760b86d2c590ea0b3def8c7b5fd2c8e21908f25bae WatchSource:0}: Error finding container 9250f4f799cf9084c07d9e760b86d2c590ea0b3def8c7b5fd2c8e21908f25bae: Status 404 returned error can't find the container with id 9250f4f799cf9084c07d9e760b86d2c590ea0b3def8c7b5fd2c8e21908f25bae Jul 14 15:19:44.494604 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:44.494547 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d7d8975-mbpwt" event={"ID":"8758d08e-d2b4-44fb-8a8b-4d59f1178df9","Type":"ContainerStarted","Data":"9250f4f799cf9084c07d9e760b86d2c590ea0b3def8c7b5fd2c8e21908f25bae"} Jul 14 15:19:44.495511 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:44.495482 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" event={"ID":"7856c73c-3c87-4a8f-9b09-219d37af5752","Type":"ContainerStarted","Data":"df60de75091c1b577c7e2b3c9ec65f7c199ff36e9da66c59a9ce8c6e193b45ed"} Jul 14 15:19:46.253641 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:46.253620 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 15:19:46.507619 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:46.507526 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d7d8975-mbpwt" event={"ID":"8758d08e-d2b4-44fb-8a8b-4d59f1178df9","Type":"ContainerStarted","Data":"53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9"} Jul 14 15:19:46.507769 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:46.507621 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:46.508910 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:46.508885 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" event={"ID":"7856c73c-3c87-4a8f-9b09-219d37af5752","Type":"ContainerStarted","Data":"3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090"} Jul 14 15:19:46.509015 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:46.508939 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:46.529366 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:46.529325 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57d7d8975-mbpwt" podStartSLOduration=1.601356188 podStartE2EDuration="3.529310594s" totalImagesPullingTime="1.927954406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:19:46.528175163 +0000 UTC m=+541.837293603" watchObservedRunningTime="2026-07-14 15:19:46.529310594 +0000 UTC m=+541.838429022" Jul 14 15:19:46.548652 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:46.548613 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" podStartSLOduration=1.36167311 podStartE2EDuration="3.548600945s" totalImagesPullingTime="2.186927835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:19:46.547672504 +0000 UTC m=+541.856790929" watchObservedRunningTime="2026-07-14 15:19:46.548600945 +0000 UTC m=+541.857719370" Jul 14 15:19:57.514542 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:57.514484 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:19:57.514984 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:57.514591 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:57.583903 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:57.583875 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c5fcf5655-pzjwf"] Jul 14 15:19:57.584073 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:57.584050 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" podUID="7856c73c-3c87-4a8f-9b09-219d37af5752" containerName="manager" containerID="cri-o://3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090" gracePeriod=30 Jul 14 15:19:57.847740 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:57.847714 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:57.986012 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:57.985980 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqh9b\" (UniqueName: \"kubernetes.io/projected/7856c73c-3c87-4a8f-9b09-219d37af5752-kube-api-access-qqh9b\") pod \"7856c73c-3c87-4a8f-9b09-219d37af5752\" (UID: \"7856c73c-3c87-4a8f-9b09-219d37af5752\") " Jul 14 15:19:57.986180 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:57.986076 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7856c73c-3c87-4a8f-9b09-219d37af5752-webhook-cert\") pod \"7856c73c-3c87-4a8f-9b09-219d37af5752\" (UID: \"7856c73c-3c87-4a8f-9b09-219d37af5752\") " Jul 14 15:19:57.988238 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:57.988204 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7856c73c-3c87-4a8f-9b09-219d37af5752-kube-api-access-qqh9b" (OuterVolumeSpecName: "kube-api-access-qqh9b") pod "7856c73c-3c87-4a8f-9b09-219d37af5752" (UID: "7856c73c-3c87-4a8f-9b09-219d37af5752"). InnerVolumeSpecName "kube-api-access-qqh9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:19:57.988238 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:57.988206 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7856c73c-3c87-4a8f-9b09-219d37af5752-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7856c73c-3c87-4a8f-9b09-219d37af5752" (UID: "7856c73c-3c87-4a8f-9b09-219d37af5752"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:19:58.086820 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.086761 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqh9b\" (UniqueName: \"kubernetes.io/projected/7856c73c-3c87-4a8f-9b09-219d37af5752-kube-api-access-qqh9b\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:19:58.086820 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.086783 2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7856c73c-3c87-4a8f-9b09-219d37af5752-webhook-cert\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:19:58.563092 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.563050 2583 generic.go:356] "Generic (PLEG): container finished" podID="7856c73c-3c87-4a8f-9b09-219d37af5752" containerID="3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090" exitCode=0 Jul 14 15:19:58.563479 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.563105 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" event={"ID":"7856c73c-3c87-4a8f-9b09-219d37af5752","Type":"ContainerDied","Data":"3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090"} Jul 14 15:19:58.563479 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.563117 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" Jul 14 15:19:58.563479 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.563185 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5fcf5655-pzjwf" event={"ID":"7856c73c-3c87-4a8f-9b09-219d37af5752","Type":"ContainerDied","Data":"df60de75091c1b577c7e2b3c9ec65f7c199ff36e9da66c59a9ce8c6e193b45ed"} Jul 14 15:19:58.563479 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.563216 2583 scope.go:117] "RemoveContainer" containerID="3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090" Jul 14 15:19:58.571979 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.571962 2583 scope.go:117] "RemoveContainer" containerID="3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090" Jul 14 15:19:58.572227 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:19:58.572207 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090\": container with ID starting with 3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090 not found: ID does not exist" containerID="3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090" Jul 14 15:19:58.572274 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.572233 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090"} err="failed to get container status \"3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090\": rpc error: code = NotFound desc = could not find container \"3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090\": container with ID starting with 3c05782384feed80fcc7b52036b4a4820beb20e66cfb5f03c4870c15adae7090 not found: ID does not exist" Jul 14 15:19:58.584741 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.584722 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c5fcf5655-pzjwf"] Jul 14 15:19:58.587741 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:58.587714 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c5fcf5655-pzjwf"] Jul 14 15:19:59.194812 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:19:59.194785 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7856c73c-3c87-4a8f-9b09-219d37af5752" path="/var/lib/kubelet/pods/7856c73c-3c87-4a8f-9b09-219d37af5752/volumes" Jul 14 15:20:19.296463 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.296431 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg"] Jul 14 15:20:19.296923 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.296772 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7856c73c-3c87-4a8f-9b09-219d37af5752" containerName="manager" Jul 14 15:20:19.296923 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.296786 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7856c73c-3c87-4a8f-9b09-219d37af5752" containerName="manager" Jul 14 15:20:19.296923 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.296856 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7856c73c-3c87-4a8f-9b09-219d37af5752" containerName="manager" Jul 14 15:20:19.302872 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.302849 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.305408 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.305386 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 15:20:19.305551 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.305407 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 15:20:19.307198 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.307128 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 15:20:19.307351 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.307330 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jlsh9\"" Jul 14 15:20:19.308742 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.308722 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg"] Jul 14 15:20:19.441253 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.441230 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51fccdb-6721-4fc4-8539-dc7719980588-openshift-service-ca\") pod \"maas-api-79484dbb4b-v8nwg\" (UID: \"c51fccdb-6721-4fc4-8539-dc7719980588\") " pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.441388 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.441293 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c4s5\" (UniqueName: \"kubernetes.io/projected/c51fccdb-6721-4fc4-8539-dc7719980588-kube-api-access-8c4s5\") pod \"maas-api-79484dbb4b-v8nwg\" (UID: \"c51fccdb-6721-4fc4-8539-dc7719980588\") " pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.441454 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.441376 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51fccdb-6721-4fc4-8539-dc7719980588-maas-api-tls\") pod \"maas-api-79484dbb4b-v8nwg\" (UID: \"c51fccdb-6721-4fc4-8539-dc7719980588\") " pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.542644 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.542616 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51fccdb-6721-4fc4-8539-dc7719980588-openshift-service-ca\") pod \"maas-api-79484dbb4b-v8nwg\" (UID: \"c51fccdb-6721-4fc4-8539-dc7719980588\") " pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.542741 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.542687 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c4s5\" (UniqueName: \"kubernetes.io/projected/c51fccdb-6721-4fc4-8539-dc7719980588-kube-api-access-8c4s5\") pod \"maas-api-79484dbb4b-v8nwg\" (UID: \"c51fccdb-6721-4fc4-8539-dc7719980588\") " pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.542741 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.542728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51fccdb-6721-4fc4-8539-dc7719980588-maas-api-tls\") pod \"maas-api-79484dbb4b-v8nwg\" (UID: \"c51fccdb-6721-4fc4-8539-dc7719980588\") " pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.543258 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.543234 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51fccdb-6721-4fc4-8539-dc7719980588-openshift-service-ca\") pod \"maas-api-79484dbb4b-v8nwg\" (UID: \"c51fccdb-6721-4fc4-8539-dc7719980588\") " pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.546619 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.546566 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51fccdb-6721-4fc4-8539-dc7719980588-maas-api-tls\") pod \"maas-api-79484dbb4b-v8nwg\" (UID: \"c51fccdb-6721-4fc4-8539-dc7719980588\") " pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.551184 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.551163 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c4s5\" (UniqueName: \"kubernetes.io/projected/c51fccdb-6721-4fc4-8539-dc7719980588-kube-api-access-8c4s5\") pod \"maas-api-79484dbb4b-v8nwg\" (UID: \"c51fccdb-6721-4fc4-8539-dc7719980588\") " pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.614021 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.613998 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:19.756511 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.756472 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg"] Jul 14 15:20:19.758819 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:20:19.758792 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51fccdb_6721_4fc4_8539_dc7719980588.slice/crio-5b105747c773a31e3c4286b1210d31c0ff77ad851e73793e14a7a77693d21f1f WatchSource:0}: Error finding container 5b105747c773a31e3c4286b1210d31c0ff77ad851e73793e14a7a77693d21f1f: Status 404 returned error can't find the container with id 5b105747c773a31e3c4286b1210d31c0ff77ad851e73793e14a7a77693d21f1f Jul 14 15:20:19.914200 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.914174 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-k4rhr"] Jul 14 15:20:19.920268 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.920249 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:19.922896 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.922873 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wx9qm\"" Jul 14 15:20:19.923034 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.923018 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 15:20:19.930672 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:19.930652 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-k4rhr"] Jul 14 15:20:20.045964 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.045936 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdjh9\" (UniqueName: \"kubernetes.io/projected/60d49af9-804f-4a5d-b24d-6b4a9799b6c1-kube-api-access-fdjh9\") pod \"payload-processing-f9b8d9b9b-k4rhr\" (UID: \"60d49af9-804f-4a5d-b24d-6b4a9799b6c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:20.046075 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.045996 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60d49af9-804f-4a5d-b24d-6b4a9799b6c1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-k4rhr\" (UID: \"60d49af9-804f-4a5d-b24d-6b4a9799b6c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:20.146874 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.146850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60d49af9-804f-4a5d-b24d-6b4a9799b6c1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-k4rhr\" (UID: \"60d49af9-804f-4a5d-b24d-6b4a9799b6c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:20.146981 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.146900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdjh9\" (UniqueName: \"kubernetes.io/projected/60d49af9-804f-4a5d-b24d-6b4a9799b6c1-kube-api-access-fdjh9\") pod \"payload-processing-f9b8d9b9b-k4rhr\" (UID: \"60d49af9-804f-4a5d-b24d-6b4a9799b6c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:20.147567 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.147551 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60d49af9-804f-4a5d-b24d-6b4a9799b6c1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-k4rhr\" (UID: \"60d49af9-804f-4a5d-b24d-6b4a9799b6c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:20.156898 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.156872 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdjh9\" (UniqueName: \"kubernetes.io/projected/60d49af9-804f-4a5d-b24d-6b4a9799b6c1-kube-api-access-fdjh9\") pod \"payload-processing-f9b8d9b9b-k4rhr\" (UID: \"60d49af9-804f-4a5d-b24d-6b4a9799b6c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:20.231454 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.231399 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:20.360799 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.360771 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-k4rhr"] Jul 14 15:20:20.364754 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:20:20.364729 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d49af9_804f_4a5d_b24d_6b4a9799b6c1.slice/crio-4e051a84727f2a6d5205ccccf914ebf0b685fceee407f34931edc5db2805fd38 WatchSource:0}: Error finding container 4e051a84727f2a6d5205ccccf914ebf0b685fceee407f34931edc5db2805fd38: Status 404 returned error can't find the container with id 4e051a84727f2a6d5205ccccf914ebf0b685fceee407f34931edc5db2805fd38 Jul 14 15:20:20.659827 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.659801 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" event={"ID":"60d49af9-804f-4a5d-b24d-6b4a9799b6c1","Type":"ContainerStarted","Data":"4e051a84727f2a6d5205ccccf914ebf0b685fceee407f34931edc5db2805fd38"} Jul 14 15:20:20.661022 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:20.660996 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" event={"ID":"c51fccdb-6721-4fc4-8539-dc7719980588","Type":"ContainerStarted","Data":"5b105747c773a31e3c4286b1210d31c0ff77ad851e73793e14a7a77693d21f1f"} Jul 14 15:20:21.667990 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:21.667732 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" event={"ID":"c51fccdb-6721-4fc4-8539-dc7719980588","Type":"ContainerStarted","Data":"36fd09c083ce540ea886411bd0e41000cf18a0f556002d9a2021170193231d22"} Jul 14 15:20:21.668391 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:21.668036 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:21.684890 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:21.684845 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" podStartSLOduration=0.919973285 podStartE2EDuration="2.68483285s" totalImagesPullingTime="1.764859565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:20:21.683564077 +0000 UTC m=+576.992682526" watchObservedRunningTime="2026-07-14 15:20:21.68483285 +0000 UTC m=+576.993951275" Jul 14 15:20:27.678001 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:27.677974 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79484dbb4b-v8nwg" Jul 14 15:20:28.698366 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:28.698334 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" event={"ID":"60d49af9-804f-4a5d-b24d-6b4a9799b6c1","Type":"ContainerStarted","Data":"2b36e32f4b2cd54ee71faa83db4da3fb46a75372dfd1d1842bfd4bd239b35c88"} Jul 14 15:20:28.698746 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:28.698387 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:28.714691 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:28.714644 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" podStartSLOduration=2.379100971 podStartE2EDuration="9.714628646s" totalImagesPullingTime="7.335527675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:20:28.712332796 +0000 UTC m=+584.021451242" watchObservedRunningTime="2026-07-14 15:20:28.714628646 +0000 UTC m=+584.023747072" Jul 14 15:20:39.705050 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:39.705010 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-k4rhr" Jul 14 15:20:45.020855 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:45.020830 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:20:45.024040 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:45.024011 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:20:45.024300 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:45.024278 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:20:45.027204 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:45.027187 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:20:49.982623 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:49.982589 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw"] Jul 14 15:20:49.987041 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:49.987017 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:49.989607 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:49.989586 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 14 15:20:49.989814 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:49.989588 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 15:20:49.990713 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:49.990680 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dxjjb\"" Jul 14 15:20:49.990834 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:49.990727 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 15:20:49.994556 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:49.994533 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw"] Jul 14 15:20:50.057817 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.057788 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.057947 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.057821 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.057947 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.057854 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.058061 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.057951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.058061 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.057996 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.058061 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.058043 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sc9w\" (UniqueName: \"kubernetes.io/projected/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-kube-api-access-2sc9w\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.158684 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.158654 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sc9w\" (UniqueName: \"kubernetes.io/projected/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-kube-api-access-2sc9w\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.158790 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.158693 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.158790 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.158717 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.158790 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.158757 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.158895 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.158806 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.158895 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.158837 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.159155 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.159127 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.159155 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.159147 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.159277 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.159200 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.160901 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.160883 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.161205 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.161188 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.166377 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.166359 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sc9w\" (UniqueName: \"kubernetes.io/projected/b6dd91c9-28bb-4342-b776-f874dbaf6b5d-kube-api-access-2sc9w\") pod \"e2e-distinct-simulated-kserve-59975d69f9-89fnw\" (UID: \"b6dd91c9-28bb-4342-b776-f874dbaf6b5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.297777 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.297726 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:20:50.427973 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.427859 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw"] Jul 14 15:20:50.430106 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:20:50.430078 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6dd91c9_28bb_4342_b776_f874dbaf6b5d.slice/crio-45ce254f13023ac8ab5d098e1ba798c7c282f84c7ae23c5f2d3570dc8d137a96 WatchSource:0}: Error finding container 45ce254f13023ac8ab5d098e1ba798c7c282f84c7ae23c5f2d3570dc8d137a96: Status 404 returned error can't find the container with id 45ce254f13023ac8ab5d098e1ba798c7c282f84c7ae23c5f2d3570dc8d137a96 Jul 14 15:20:50.799809 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:50.799769 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" event={"ID":"b6dd91c9-28bb-4342-b776-f874dbaf6b5d","Type":"ContainerStarted","Data":"45ce254f13023ac8ab5d098e1ba798c7c282f84c7ae23c5f2d3570dc8d137a96"} Jul 14 15:20:51.807728 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:51.807646 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" event={"ID":"b6dd91c9-28bb-4342-b776-f874dbaf6b5d","Type":"ContainerStarted","Data":"4d34831f0540389e2fd0adbea5bb222fee4bce8f6cd221768d3eb8f161810fff"} Jul 14 15:20:51.825329 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:20:51.825280 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" podStartSLOduration=1.7701679989999999 podStartE2EDuration="2.825265318s" totalImagesPullingTime="1.055097319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:20:51.82389611 +0000 UTC m=+607.133014569" watchObservedRunningTime="2026-07-14 15:20:51.825265318 +0000 UTC m=+607.134383755" Jul 14 15:21:00.298711 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:00.298680 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:21:00.302007 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:00.298742 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:21:00.311061 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:00.311042 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:21:00.857433 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:00.857406 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-89fnw" Jul 14 15:21:01.589150 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.589116 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp"] Jul 14 15:21:01.593902 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.593884 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.596640 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.596619 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 15:21:01.602343 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.602322 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp"] Jul 14 15:21:01.645634 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.645610 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.645746 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.645646 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.645746 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.645679 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvx2t\" (UniqueName: \"kubernetes.io/projected/ba82a874-dc31-4493-9782-aa45a757dccc-kube-api-access-hvx2t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.645868 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.645742 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.645868 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.645786 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.645868 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.645858 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba82a874-dc31-4493-9782-aa45a757dccc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.747008 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.746982 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba82a874-dc31-4493-9782-aa45a757dccc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.747099 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.747021 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.747099 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.747043 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.747099 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.747074 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvx2t\" (UniqueName: \"kubernetes.io/projected/ba82a874-dc31-4493-9782-aa45a757dccc-kube-api-access-hvx2t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.747099 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.747091 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.747355 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.747109 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.747495 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.747469 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.747599 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.747550 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.747599 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.747581 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.749391 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.749371 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba82a874-dc31-4493-9782-aa45a757dccc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.749545 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.749525 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba82a874-dc31-4493-9782-aa45a757dccc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.755086 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.755064 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvx2t\" (UniqueName: \"kubernetes.io/projected/ba82a874-dc31-4493-9782-aa45a757dccc-kube-api-access-hvx2t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp\" (UID: \"ba82a874-dc31-4493-9782-aa45a757dccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:01.904225 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:01.904198 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:02.034384 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:02.034357 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp"] Jul 14 15:21:02.036241 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:21:02.036208 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba82a874_dc31_4493_9782_aa45a757dccc.slice/crio-0b98539bf3fabeec7a8f83bff187878a6029885242545a0c087893bc189ed790 WatchSource:0}: Error finding container 0b98539bf3fabeec7a8f83bff187878a6029885242545a0c087893bc189ed790: Status 404 returned error can't find the container with id 0b98539bf3fabeec7a8f83bff187878a6029885242545a0c087893bc189ed790 Jul 14 15:21:02.037613 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:02.037594 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 15:21:02.857660 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:02.857623 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" event={"ID":"ba82a874-dc31-4493-9782-aa45a757dccc","Type":"ContainerStarted","Data":"af69e46e132a436271bd511884ce7225b1ac85946644481cccd86a1ed5d19571"} Jul 14 15:21:02.858018 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:02.857688 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" event={"ID":"ba82a874-dc31-4493-9782-aa45a757dccc","Type":"ContainerStarted","Data":"0b98539bf3fabeec7a8f83bff187878a6029885242545a0c087893bc189ed790"} Jul 14 15:21:02.876769 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:02.876699 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" podStartSLOduration=1.539131942 podStartE2EDuration="1.876683809s" totalImagesPullingTime="337.551867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:21:02.875732287 +0000 UTC m=+618.184850713" watchObservedRunningTime="2026-07-14 15:21:02.876683809 +0000 UTC m=+618.185802276" Jul 14 15:21:11.904533 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:11.904484 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:11.904944 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:11.904555 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:11.916744 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:11.916723 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:12.917223 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:12.917192 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp" Jul 14 15:21:17.478828 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.478789 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz"] Jul 14 15:21:17.482142 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.482115 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.484767 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.484744 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 14 15:21:17.494745 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.494721 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz"] Jul 14 15:21:17.578108 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.578074 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.578232 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.578155 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.578232 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.578189 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.578308 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.578232 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.578308 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.578281 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.578380 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.578307 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2qd\" (UniqueName: \"kubernetes.io/projected/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-kube-api-access-vr2qd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.679373 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.679349 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.679479 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.679380 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.679479 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.679400 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.679479 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.679458 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.679604 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.679534 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2qd\" (UniqueName: \"kubernetes.io/projected/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-kube-api-access-vr2qd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.679604 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.679570 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.679809 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.679782 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.679910 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.679849 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.680015 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.679994 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.681677 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.681659 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.681965 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.681946 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.691315 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.691295 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2qd\" (UniqueName: \"kubernetes.io/projected/47d6bcb0-ce7a-48ff-a945-752ee727a2b4-kube-api-access-vr2qd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz\" (UID: \"47d6bcb0-ce7a-48ff-a945-752ee727a2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.792803 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.792725 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:17.922399 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:17.922375 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz"] Jul 14 15:21:17.924724 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:21:17.924700 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47d6bcb0_ce7a_48ff_a945_752ee727a2b4.slice/crio-b4db1dd2a2dc0150e621ef171d416ae7d9bf770292bdd3e50d9ad218ad140db5 WatchSource:0}: Error finding container b4db1dd2a2dc0150e621ef171d416ae7d9bf770292bdd3e50d9ad218ad140db5: Status 404 returned error can't find the container with id b4db1dd2a2dc0150e621ef171d416ae7d9bf770292bdd3e50d9ad218ad140db5 Jul 14 15:21:18.934435 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:18.934403 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" event={"ID":"47d6bcb0-ce7a-48ff-a945-752ee727a2b4","Type":"ContainerStarted","Data":"e90063da6ec7dc4e069412721811b84641b3a4e395ca271ef71f2e9cbffbbe3c"} Jul 14 15:21:18.934812 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:18.934448 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" event={"ID":"47d6bcb0-ce7a-48ff-a945-752ee727a2b4","Type":"ContainerStarted","Data":"b4db1dd2a2dc0150e621ef171d416ae7d9bf770292bdd3e50d9ad218ad140db5"} Jul 14 15:21:18.954564 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:18.954520 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" podStartSLOduration=1.675672934 podStartE2EDuration="1.954492587s" totalImagesPullingTime="278.819653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:21:18.952576302 +0000 UTC m=+634.261694750" watchObservedRunningTime="2026-07-14 15:21:18.954492587 +0000 UTC m=+634.263611027" Jul 14 15:21:27.793595 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:27.793563 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:27.794002 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:27.793812 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:27.805653 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:27.805628 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:27.983638 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:27.983610 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz" Jul 14 15:21:53.198309 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.198278 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59fbd69bf9-mktc2"] Jul 14 15:21:53.201794 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.201773 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59fbd69bf9-mktc2" Jul 14 15:21:53.206916 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.206894 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 15:21:53.207042 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.206913 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x9v7d\"" Jul 14 15:21:53.212558 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.212536 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59fbd69bf9-mktc2"] Jul 14 15:21:53.245276 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.245252 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f-tls-cert\") pod \"authorino-59fbd69bf9-mktc2\" (UID: \"e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f\") " pod="kuadrant-system/authorino-59fbd69bf9-mktc2" Jul 14 15:21:53.245367 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.245292 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msx4n\" (UniqueName: \"kubernetes.io/projected/e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f-kube-api-access-msx4n\") pod \"authorino-59fbd69bf9-mktc2\" (UID: \"e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f\") " pod="kuadrant-system/authorino-59fbd69bf9-mktc2" Jul 14 15:21:53.346297 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.346271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f-tls-cert\") pod \"authorino-59fbd69bf9-mktc2\" (UID: \"e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f\") " pod="kuadrant-system/authorino-59fbd69bf9-mktc2" Jul 14 15:21:53.346402 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.346316 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msx4n\" (UniqueName: \"kubernetes.io/projected/e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f-kube-api-access-msx4n\") pod \"authorino-59fbd69bf9-mktc2\" (UID: \"e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f\") " pod="kuadrant-system/authorino-59fbd69bf9-mktc2" Jul 14 15:21:53.348459 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.348440 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f-tls-cert\") pod \"authorino-59fbd69bf9-mktc2\" (UID: \"e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f\") " pod="kuadrant-system/authorino-59fbd69bf9-mktc2" Jul 14 15:21:53.354965 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.354947 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msx4n\" (UniqueName: \"kubernetes.io/projected/e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f-kube-api-access-msx4n\") pod \"authorino-59fbd69bf9-mktc2\" (UID: \"e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f\") " pod="kuadrant-system/authorino-59fbd69bf9-mktc2" Jul 14 15:21:53.510325 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.510273 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59fbd69bf9-mktc2" Jul 14 15:21:53.634979 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:53.634956 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59fbd69bf9-mktc2"] Jul 14 15:21:53.636843 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:21:53.636819 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6a87b0d_91b7_4c14_bfda_2b8c90b34c2f.slice/crio-f0225b549225ec108c1805fc6038042f4eed5ad53f2090fc834529f6c9856011 WatchSource:0}: Error finding container f0225b549225ec108c1805fc6038042f4eed5ad53f2090fc834529f6c9856011: Status 404 returned error can't find the container with id f0225b549225ec108c1805fc6038042f4eed5ad53f2090fc834529f6c9856011 Jul 14 15:21:54.083427 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:54.083403 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59fbd69bf9-mktc2" event={"ID":"e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f","Type":"ContainerStarted","Data":"f0225b549225ec108c1805fc6038042f4eed5ad53f2090fc834529f6c9856011"} Jul 14 15:21:55.096521 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:55.091061 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59fbd69bf9-mktc2" event={"ID":"e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f","Type":"ContainerStarted","Data":"f6c69b0f3a46b19d64632e9400a595dea9f15675b14076b1af715b6cb2fd4842"} Jul 14 15:21:55.108342 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:21:55.108267 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59fbd69bf9-mktc2" podStartSLOduration=1.667781886 podStartE2EDuration="2.108237828s" totalImagesPullingTime="440.455942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:21:55.10743651 +0000 UTC m=+670.416554950" watchObservedRunningTime="2026-07-14 15:21:55.108237828 +0000 UTC m=+670.417356272" Jul 14 15:25:45.050708 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:45.050641 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:25:45.051549 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:45.051527 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:25:45.054388 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:45.054368 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:25:45.055161 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:45.055140 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wj4zb_072b5b8f-b490-426e-8718-92587f39635c/ovn-acl-logging/0.log" Jul 14 15:25:52.220364 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:52.220330 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57d7d8975-mbpwt"] Jul 14 15:25:52.220945 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:52.220560 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57d7d8975-mbpwt" podUID="8758d08e-d2b4-44fb-8a8b-4d59f1178df9" containerName="manager" containerID="cri-o://53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9" gracePeriod=30 Jul 14 15:25:52.474715 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:52.474665 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:25:52.570452 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:52.570419 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvvvg\" (UniqueName: \"kubernetes.io/projected/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-kube-api-access-cvvvg\") pod \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\" (UID: \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\") " Jul 14 15:25:52.570631 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:52.570461 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-webhook-cert\") pod \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\" (UID: \"8758d08e-d2b4-44fb-8a8b-4d59f1178df9\") " Jul 14 15:25:52.572578 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:52.572550 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-kube-api-access-cvvvg" (OuterVolumeSpecName: "kube-api-access-cvvvg") pod "8758d08e-d2b4-44fb-8a8b-4d59f1178df9" (UID: "8758d08e-d2b4-44fb-8a8b-4d59f1178df9"). InnerVolumeSpecName "kube-api-access-cvvvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:25:52.572578 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:52.572554 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8758d08e-d2b4-44fb-8a8b-4d59f1178df9" (UID: "8758d08e-d2b4-44fb-8a8b-4d59f1178df9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:25:52.671668 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:52.671643 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvvvg\" (UniqueName: \"kubernetes.io/projected/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-kube-api-access-cvvvg\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:25:52.671668 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:52.671666 2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8758d08e-d2b4-44fb-8a8b-4d59f1178df9-webhook-cert\") on node \"ip-10-0-140-4.ec2.internal\" DevicePath \"\"" Jul 14 15:25:53.151108 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.151072 2583 generic.go:356] "Generic (PLEG): container finished" podID="8758d08e-d2b4-44fb-8a8b-4d59f1178df9" containerID="53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9" exitCode=0 Jul 14 15:25:53.151244 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.151119 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57d7d8975-mbpwt" Jul 14 15:25:53.151244 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.151151 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d7d8975-mbpwt" event={"ID":"8758d08e-d2b4-44fb-8a8b-4d59f1178df9","Type":"ContainerDied","Data":"53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9"} Jul 14 15:25:53.151244 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.151202 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57d7d8975-mbpwt" event={"ID":"8758d08e-d2b4-44fb-8a8b-4d59f1178df9","Type":"ContainerDied","Data":"9250f4f799cf9084c07d9e760b86d2c590ea0b3def8c7b5fd2c8e21908f25bae"} Jul 14 15:25:53.151244 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.151225 2583 scope.go:117] "RemoveContainer" containerID="53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9" Jul 14 15:25:53.159929 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.159912 2583 scope.go:117] "RemoveContainer" containerID="53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9" Jul 14 15:25:53.160172 ip-10-0-140-4 kubenswrapper[2583]: E0714 15:25:53.160155 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9\": container with ID starting with 53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9 not found: ID does not exist" containerID="53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9" Jul 14 15:25:53.160233 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.160183 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9"} err="failed to get container status \"53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9\": rpc error: code = NotFound desc = could not find container \"53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9\": container with ID starting with 53cfcd087ba28a09b108b9e95c5eba848992ab33fd60dd0a69420832524dfba9 not found: ID does not exist" Jul 14 15:25:53.173751 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.173731 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57d7d8975-mbpwt"] Jul 14 15:25:53.179802 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.179775 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57d7d8975-mbpwt"] Jul 14 15:25:53.194569 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:25:53.194548 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8758d08e-d2b4-44fb-8a8b-4d59f1178df9" path="/var/lib/kubelet/pods/8758d08e-d2b4-44fb-8a8b-4d59f1178df9/volumes" Jul 14 15:27:07.569728 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:07.569649 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59fbd69bf9-mktc2_e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f/authorino/0.log" Jul 14 15:27:13.397068 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:13.397035 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m6xgx_593e9e7a-b789-446d-be1f-e5fe7b3f5a4e/server/0.log" Jul 14 15:27:13.522552 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:13.522489 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hjc4z_f1059153-1bcb-4027-a665-19b194bfccb9/manager/0.log" Jul 14 15:27:13.802615 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:13.802555 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8676d5649d-rx2gc_6206be3e-26d2-40fb-b07b-be6b8ada3c77/copy-manifests/0.log" Jul 14 15:27:13.809007 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:13.808982 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8676d5649d-rx2gc_6206be3e-26d2-40fb-b07b-be6b8ada3c77/manager/0.log" Jul 14 15:27:14.321142 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:14.321123 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79484dbb4b-v8nwg_c51fccdb-6721-4fc4-8539-dc7719980588/maas-api/0.log" Jul 14 15:27:16.012381 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:16.012355 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59fbd69bf9-mktc2_e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f/authorino/0.log" Jul 14 15:27:16.401899 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:16.401876 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-z5692_be32d5a5-7bbd-4740-9749-78f9d57a04a8/kuadrant-console-plugin/0.log" Jul 14 15:27:17.682951 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:17.682920 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754cbb886-k8zqz_53e6f9b9-06ae-46d8-9304-8d2dfb971a6a/kube-auth-proxy/0.log" Jul 14 15:27:18.213567 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:18.213545 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k4rhr_60d49af9-804f-4a5d-b24d-6b4a9799b6c1/payload-processing/0.log" Jul 14 15:27:18.885166 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:18.885141 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-89fnw_b6dd91c9-28bb-4342-b776-f874dbaf6b5d/main/0.log" Jul 14 15:27:19.165293 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:19.165218 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl7mkp_ba82a874-dc31-4493-9782-aa45a757dccc/main/0.log" Jul 14 15:27:19.446922 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:19.446865 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-nb4gz_47d6bcb0-ce7a-48ff-a945-752ee727a2b4/main/0.log" Jul 14 15:27:27.037346 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:27.037316 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l9h2s_e945306f-6eff-4b20-bf7e-fbd54d8f923b/global-pull-secret-syncer/0.log" Jul 14 15:27:27.194456 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:27.194425 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dkl65_6b2ffeb5-04a9-4e0e-b24a-9c614095b35f/konnectivity-agent/0.log" Jul 14 15:27:27.267063 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:27.267037 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-4.ec2.internal_d93f0333f4b92614bdbed4b4019a42b1/haproxy/0.log" Jul 14 15:27:32.159510 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:32.159480 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59fbd69bf9-mktc2_e6a87b0d-91b7-4c14-bfda-2b8c90b34c2f/authorino/0.log" Jul 14 15:27:32.257830 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:32.257805 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-z5692_be32d5a5-7bbd-4740-9749-78f9d57a04a8/kuadrant-console-plugin/0.log" Jul 14 15:27:34.269907 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:34.269829 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9g979_dd1ec576-ea06-44ad-80d4-f5fd3c51bcba/kube-state-metrics/0.log" Jul 14 15:27:34.287476 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:34.287455 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9g979_dd1ec576-ea06-44ad-80d4-f5fd3c51bcba/kube-rbac-proxy-main/0.log" Jul 14 15:27:34.311691 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:34.311669 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9g979_dd1ec576-ea06-44ad-80d4-f5fd3c51bcba/kube-rbac-proxy-self/0.log" Jul 14 15:27:34.497933 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:34.497903 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d2q97_dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec/node-exporter/0.log" Jul 14 15:27:34.517756 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:34.517730 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d2q97_dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec/kube-rbac-proxy/0.log" Jul 14 15:27:34.538333 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:34.538280 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d2q97_dd2fa0a6-a42c-42ec-ab87-fa1d829c02ec/init-textfile/0.log" Jul 14 15:27:36.359248 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:36.359220 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-k2fzq_ed801a8f-da34-4e49-8544-8a726033bd5f/networking-console-plugin/0.log" Jul 14 15:27:36.982619 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:36.982582 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/1.log" Jul 14 15:27:36.989218 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:36.989198 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mmhjl_e4a182e2-2de6-4d3a-b1c1-4d52c051bd28/console-operator/2.log" Jul 14 15:27:37.040994 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.040966 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj"] Jul 14 15:27:37.041323 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.041311 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8758d08e-d2b4-44fb-8a8b-4d59f1178df9" containerName="manager" Jul 14 15:27:37.041364 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.041325 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8758d08e-d2b4-44fb-8a8b-4d59f1178df9" containerName="manager" Jul 14 15:27:37.041408 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.041399 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8758d08e-d2b4-44fb-8a8b-4d59f1178df9" containerName="manager" Jul 14 15:27:37.044567 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.044530 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.048270 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.048248 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6pw6b\"/\"kube-root-ca.crt\"" Jul 14 15:27:37.049455 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.049435 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6pw6b\"/\"default-dockercfg-5zgz8\"" Jul 14 15:27:37.050196 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.050176 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6pw6b\"/\"openshift-service-ca.crt\"" Jul 14 15:27:37.053117 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.053097 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj"] Jul 14 15:27:37.148905 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.148877 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-proc\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.149017 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.148924 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-sys\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.149017 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.148997 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-lib-modules\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.149112 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.149059 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jddst\" (UniqueName: \"kubernetes.io/projected/0a9a8f5c-1482-4a58-8cce-077fdef06e54-kube-api-access-jddst\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.149157 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.149122 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-podres\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.250567 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.250468 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-podres\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.250714 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.250591 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-proc\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.250714 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.250625 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-podres\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.250714 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.250629 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-sys\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.250714 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.250678 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-sys\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.250933 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.250737 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-proc\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.250933 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.250781 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-lib-modules\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.250933 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.250808 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddst\" (UniqueName: \"kubernetes.io/projected/0a9a8f5c-1482-4a58-8cce-077fdef06e54-kube-api-access-jddst\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.251076 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.250958 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a9a8f5c-1482-4a58-8cce-077fdef06e54-lib-modules\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.259062 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.259045 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jddst\" (UniqueName: \"kubernetes.io/projected/0a9a8f5c-1482-4a58-8cce-077fdef06e54-kube-api-access-jddst\") pod \"perf-node-gather-daemonset-l5kzj\" (UID: \"0a9a8f5c-1482-4a58-8cce-077fdef06e54\") " pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.355449 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.355422 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.484542 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.484514 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj"] Jul 14 15:27:37.486102 ip-10-0-140-4 kubenswrapper[2583]: W0714 15:27:37.486078 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0a9a8f5c_1482_4a58_8cce_077fdef06e54.slice/crio-e63f838c13c9c5d48b7497244ed326e9c5d43a35a9bbc10c13b2a83d3ff24d38 WatchSource:0}: Error finding container e63f838c13c9c5d48b7497244ed326e9c5d43a35a9bbc10c13b2a83d3ff24d38: Status 404 returned error can't find the container with id e63f838c13c9c5d48b7497244ed326e9c5d43a35a9bbc10c13b2a83d3ff24d38 Jul 14 15:27:37.609367 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.609332 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" event={"ID":"0a9a8f5c-1482-4a58-8cce-077fdef06e54","Type":"ContainerStarted","Data":"0b682cc82da76d5457848172bc23b7a8a6c8d0d46221471fddac742e62009dbc"} Jul 14 15:27:37.609543 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.609386 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" event={"ID":"0a9a8f5c-1482-4a58-8cce-077fdef06e54","Type":"ContainerStarted","Data":"e63f838c13c9c5d48b7497244ed326e9c5d43a35a9bbc10c13b2a83d3ff24d38"} Jul 14 15:27:37.609543 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.609438 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:37.625815 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.625766 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" podStartSLOduration=0.625750587 podStartE2EDuration="625.750587ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:27:37.623975539 +0000 UTC m=+1012.933093974" watchObservedRunningTime="2026-07-14 15:27:37.625750587 +0000 UTC m=+1012.934869012" Jul 14 15:27:37.659874 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:37.659848 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-b5k6z_016ae7b4-b656-453a-af91-be514f5dcdaf/download-server/0.log" Jul 14 15:27:38.258031 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:38.258006 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-t6sfv_89ca2fcb-7311-480a-9927-57cad1818f65/volume-data-source-validator/0.log" Jul 14 15:27:39.378448 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:39.378420 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mw8jr_7c3b2da0-c21a-497c-9850-ed0363bf823a/dns/0.log" Jul 14 15:27:39.401744 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:39.401718 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mw8jr_7c3b2da0-c21a-497c-9850-ed0363bf823a/kube-rbac-proxy/0.log" Jul 14 15:27:39.479354 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:39.479324 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l88r6_95da5e03-b6f6-4810-8bb7-46bae5485eac/dns-node-resolver/0.log" Jul 14 15:27:39.989479 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:39.989447 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56749f8f64-wjg2c_9f00781f-f61f-405d-99b8-a5074942d31f/registry/0.log" Jul 14 15:27:40.053698 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:40.053673 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tnqvx_e8b7ef5b-25a0-4dc7-a490-290e827c172d/node-ca/0.log" Jul 14 15:27:41.079831 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:41.079801 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754cbb886-k8zqz_53e6f9b9-06ae-46d8-9304-8d2dfb971a6a/kube-auth-proxy/0.log" Jul 14 15:27:41.179592 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:41.179570 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k4rhr_60d49af9-804f-4a5d-b24d-6b4a9799b6c1/payload-processing/0.log" Jul 14 15:27:41.873316 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:41.873290 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kr2kb_0bd375ca-1be0-4c01-a6b4-b86d75e506a9/serve-healthcheck-canary/0.log" Jul 14 15:27:42.440667 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:42.440643 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7bwf9_dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0/kube-rbac-proxy/0.log" Jul 14 15:27:42.459493 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:42.459471 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7bwf9_dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0/exporter/0.log" Jul 14 15:27:42.478856 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:42.478837 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7bwf9_dc4e651b-aa06-4c03-bcbf-d090fb1dd8e0/extractor/0.log" Jul 14 15:27:43.623025 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:43.622998 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6pw6b/perf-node-gather-daemonset-l5kzj" Jul 14 15:27:44.897550 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:44.897493 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m6xgx_593e9e7a-b789-446d-be1f-e5fe7b3f5a4e/server/0.log" Jul 14 15:27:44.943385 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:44.943361 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hjc4z_f1059153-1bcb-4027-a665-19b194bfccb9/manager/0.log" Jul 14 15:27:45.041620 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:45.041593 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8676d5649d-rx2gc_6206be3e-26d2-40fb-b07b-be6b8ada3c77/manager/0.log" Jul 14 15:27:45.064391 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:45.064369 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8676d5649d-rx2gc_6206be3e-26d2-40fb-b07b-be6b8ada3c77/copy-manifests/0.log" Jul 14 15:27:46.470142 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:46.470112 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-755b7b9d47-2b2dt_353bb7d5-9c4e-49c9-a6a2-1148bd63b09d/manager/0.log" Jul 14 15:27:47.517781 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:47.517749 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754cbb886-k8zqz_53e6f9b9-06ae-46d8-9304-8d2dfb971a6a/kube-auth-proxy/0.log" Jul 14 15:27:47.591452 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:47.591425 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k4rhr_60d49af9-804f-4a5d-b24d-6b4a9799b6c1/payload-processing/0.log" Jul 14 15:27:48.786616 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:48.786595 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754cbb886-k8zqz_53e6f9b9-06ae-46d8-9304-8d2dfb971a6a/kube-auth-proxy/0.log" Jul 14 15:27:48.861435 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:48.861413 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k4rhr_60d49af9-804f-4a5d-b24d-6b4a9799b6c1/payload-processing/0.log" Jul 14 15:27:52.042679 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:52.042647 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xs9k6_2c6ebeba-e9b2-4e7f-b7e6-3acee821b686/kube-storage-version-migrator-operator/1.log" Jul 14 15:27:52.043433 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:52.043416 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xs9k6_2c6ebeba-e9b2-4e7f-b7e6-3acee821b686/kube-storage-version-migrator-operator/0.log" Jul 14 15:27:53.008307 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.008275 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-92cxj_722b7bc2-356d-4e48-ba4c-b4767c6b3e14/kube-multus/0.log" Jul 14 15:27:53.347892 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.347838 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mslc2_a5206e27-331b-4105-be8c-60d1328f9395/kube-multus-additional-cni-plugins/0.log" Jul 14 15:27:53.369152 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.369126 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mslc2_a5206e27-331b-4105-be8c-60d1328f9395/egress-router-binary-copy/0.log" Jul 14 15:27:53.390736 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.390719 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mslc2_a5206e27-331b-4105-be8c-60d1328f9395/cni-plugins/0.log" Jul 14 15:27:53.411211 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.411187 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mslc2_a5206e27-331b-4105-be8c-60d1328f9395/bond-cni-plugin/0.log" Jul 14 15:27:53.430998 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.430980 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mslc2_a5206e27-331b-4105-be8c-60d1328f9395/routeoverride-cni/0.log" Jul 14 15:27:53.451290 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.451272 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mslc2_a5206e27-331b-4105-be8c-60d1328f9395/whereabouts-cni-bincopy/0.log" Jul 14 15:27:53.470103 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.470084 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mslc2_a5206e27-331b-4105-be8c-60d1328f9395/whereabouts-cni/0.log" Jul 14 15:27:53.596572 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.596552 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n62q5_732934da-b301-4135-b617-db1319e77b22/network-metrics-daemon/0.log" Jul 14 15:27:53.614072 ip-10-0-140-4 kubenswrapper[2583]: I0714 15:27:53.614023 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n62q5_732934da-b301-4135-b617-db1319e77b22/kube-rbac-proxy/0.log"