Jul 14 09:58:24.705802 ip-10-0-139-82 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 09:58:24.705814 ip-10-0-139-82 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 09:58:24.705822 ip-10-0-139-82 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 09:58:24.706136 ip-10-0-139-82 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 09:58:34.738913 ip-10-0-139-82 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 09:58:34.738929 ip-10-0-139-82 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b0d7051412b4465dac1c9dae9f4c7c98 -- Jul 14 10:00:11.778126 ip-10-0-139-82 systemd[1]: Starting Kubernetes Kubelet... Jul 14 10:00:12.239644 ip-10-0-139-82 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 10:00:12.239644 ip-10-0-139-82 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 10:00:12.239644 ip-10-0-139-82 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 10:00:12.239644 ip-10-0-139-82 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 10:00:12.239644 ip-10-0-139-82 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 10:00:12.241204 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.241085 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 10:00:12.246173 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246155 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:12.246173 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246174 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246178 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246181 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246184 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246187 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246196 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246198 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246201 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246203 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246207 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246209 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246212 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246215 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246217 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246220 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246223 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246225 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246228 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246230 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:12.246242 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246233 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246235 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246239 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246243 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246247 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246250 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246253 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246255 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246258 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246261 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246263 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246266 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246268 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246271 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246273 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246276 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246278 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246281 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246283 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246286 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:12.246709 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246289 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246291 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246294 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246296 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246300 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246304 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246308 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246311 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246315 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246318 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246321 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246323 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246326 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246328 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246332 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246334 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246337 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246340 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246342 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:12.247226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246345 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246347 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246349 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246352 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246354 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246357 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246359 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246362 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246364 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246367 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246369 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246371 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246374 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246377 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246380 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246382 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246385 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246387 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246389 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246392 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:12.247681 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246394 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246396 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246399 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246401 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246404 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246406 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246409 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246413 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246417 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246420 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246422 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246425 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246428 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246430 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246432 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246435 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246438 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246440 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246442 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.246444 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247149 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:12.248201 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247155 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247159 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247162 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247164 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247167 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247171 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247173 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247176 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247178 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247180 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247183 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247186 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247188 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247191 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247194 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247196 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247199 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247201 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247205 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247208 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:12.248706 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247210 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247213 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247216 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247218 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247220 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247223 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247225 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247228 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247230 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247233 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247236 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247238 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247241 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247243 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247246 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247248 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247251 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247253 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247256 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:12.249247 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247259 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247261 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247263 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247267 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247272 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247276 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247280 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247283 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247286 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247288 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247291 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247294 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247297 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247299 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247302 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247304 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247307 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247309 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247312 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:12.249691 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247314 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247317 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247319 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247321 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247324 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247326 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247329 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247331 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247334 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247336 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247339 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247341 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247344 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247347 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247351 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247354 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247357 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247359 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247362 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247364 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:12.250178 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247367 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247369 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247372 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247375 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247377 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247382 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247384 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247387 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247390 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247392 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247395 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247397 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247400 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247402 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247404 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247407 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247409 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247412 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247414 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247416 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:12.250664 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247791 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247812 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247815 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247819 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247821 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247825 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247827 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247830 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247833 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247835 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247838 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247841 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247844 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247846 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247849 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247851 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247856 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247860 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247863 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:12.251165 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247866 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247869 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247873 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247876 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247879 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247882 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247885 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247888 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247890 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247893 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247896 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247898 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247901 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247904 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247907 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247910 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247912 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247915 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247917 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:12.251618 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247920 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247923 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247925 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247927 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247930 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247932 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247935 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247937 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247939 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247945 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247947 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247950 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247953 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247956 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247960 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247963 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247965 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247967 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247970 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:12.252095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247972 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247976 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247978 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247981 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247983 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247986 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247988 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247991 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247993 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247996 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.247998 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248001 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248004 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248006 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248009 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248012 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248014 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248017 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248020 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248022 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:12.252541 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248026 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248028 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248032 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248034 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248037 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248039 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248042 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248044 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248047 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248049 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248052 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248056 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248059 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248062 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248065 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248067 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248070 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248072 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248075 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248077 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248080 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:12.253042 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248082 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248167 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248179 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248188 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248194 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248200 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248204 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248209 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248213 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248216 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248219 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248223 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248226 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248229 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248232 2561 flags.go:64] FLAG: --cgroup-root="" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248235 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248238 2561 flags.go:64] FLAG: --client-ca-file="" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248241 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248244 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248249 2561 flags.go:64] FLAG: --cluster-domain="" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248251 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248255 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248260 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248263 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 10:00:12.253539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248267 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248270 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248273 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248276 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248279 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248282 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248285 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248288 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248290 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248295 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248298 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248301 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248303 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248306 2561 flags.go:64] FLAG: --enable-server="true" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248309 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248314 2561 flags.go:64] FLAG: --event-burst="100" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248316 2561 flags.go:64] FLAG: --event-qps="50" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248319 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248322 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248324 2561 flags.go:64] FLAG: --eviction-hard="" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248328 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248331 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248334 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248337 2561 flags.go:64] FLAG: --eviction-soft="" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248340 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 10:00:12.254156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248343 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248345 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248349 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248351 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248354 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248358 2561 flags.go:64] FLAG: --feature-gates="" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248361 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248364 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248367 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248370 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248373 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248376 2561 flags.go:64] FLAG: --help="false" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248379 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248382 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248384 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248387 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248390 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248395 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248398 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248400 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248403 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248406 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248409 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248412 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 10:00:12.254791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248415 2561 flags.go:64] FLAG: --kube-reserved="" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248418 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248421 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248424 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248427 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248430 2561 flags.go:64] FLAG: --lock-file="" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248433 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248436 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248440 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248445 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248448 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248450 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248453 2561 flags.go:64] FLAG: --logging-format="text" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248458 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248461 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248464 2561 flags.go:64] FLAG: --manifest-url="" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248466 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248471 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248474 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248478 2561 flags.go:64] FLAG: --max-pods="110" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248481 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248484 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248487 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248490 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248493 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 10:00:12.255593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248496 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248498 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248505 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248508 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248511 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248514 2561 flags.go:64] FLAG: --pod-cidr="" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248517 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248523 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248526 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248529 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248532 2561 flags.go:64] FLAG: --port="10250" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248535 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248537 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-043624ac4d8e36ff4" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248540 2561 flags.go:64] FLAG: --qos-reserved="" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248543 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248546 2561 flags.go:64] FLAG: --register-node="true" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248549 2561 flags.go:64] FLAG: --register-with-taints="" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248552 2561 flags.go:64] FLAG: --registry-burst="10" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248555 2561 flags.go:64] FLAG: --registry-qps="5" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248557 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248562 2561 flags.go:64] FLAG: --reserved-memory="" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248565 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248568 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248571 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248573 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 10:00:12.256473 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248576 2561 flags.go:64] FLAG: --runonce="false" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248579 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248591 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248595 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248598 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248601 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248604 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248606 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248610 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248613 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248615 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248618 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248621 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248624 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248627 2561 flags.go:64] FLAG: --system-cgroups="" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248630 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248636 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248639 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248642 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248647 2561 flags.go:64] FLAG: --tls-min-version="" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248649 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248652 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248655 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248658 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248661 2561 flags.go:64] FLAG: --v="2" Jul 14 10:00:12.257119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248670 2561 flags.go:64] FLAG: --version="false" Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248674 2561 flags.go:64] FLAG: --vmodule="" Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248678 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.248682 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248816 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248820 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248823 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248827 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248829 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248832 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248835 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248838 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248840 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248843 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248846 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248848 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248851 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248853 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248856 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248858 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:12.257726 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248861 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248863 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248866 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248869 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248876 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248878 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248881 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248884 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248886 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248889 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248892 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248894 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248897 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248899 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248903 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248906 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248908 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248910 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248913 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248915 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:12.258236 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248917 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248920 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248923 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248925 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248928 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248930 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248933 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248935 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248937 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248941 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248944 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248947 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248949 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248952 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248955 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248957 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248961 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248964 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248966 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:12.258762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248969 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248971 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248974 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248978 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248981 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248984 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248988 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248992 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248996 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.248999 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249001 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249003 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249006 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249008 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249011 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249013 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249015 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249018 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249020 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:12.259248 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249023 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249025 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249027 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249030 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249032 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249035 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249037 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249040 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249043 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249046 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249050 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249053 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249055 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249058 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249060 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249063 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249065 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249068 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249070 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249073 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:12.259713 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249076 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249079 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249081 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249084 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.249086 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.249119 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.257577 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.257596 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.257618 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.257627 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257686 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257691 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257695 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257698 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257701 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:12.260211 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257704 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257707 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257709 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257714 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257717 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257720 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257723 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257726 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257729 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257733 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257736 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257739 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257742 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257745 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257748 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257750 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257754 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257757 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257760 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:12.260597 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257762 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257765 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257768 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257771 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257773 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257776 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257780 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257782 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257785 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257788 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257790 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257793 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257813 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257816 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257819 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257822 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257824 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257827 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257830 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:12.261153 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257832 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257835 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257838 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257842 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257845 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257849 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257852 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257854 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257857 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257859 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257862 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257864 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257867 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257869 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257871 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257874 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257877 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257879 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257882 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257884 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:12.261609 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257887 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257889 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257892 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257894 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257897 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257899 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257902 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257904 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257906 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257909 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257911 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257913 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257916 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257918 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257921 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257924 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257927 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257931 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257935 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257937 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:12.262114 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257940 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257943 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257945 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257948 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257950 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257953 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257955 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257958 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257960 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257963 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257965 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257968 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257970 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257973 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257976 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:12.262585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.257978 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.257983 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258097 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258101 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258104 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258107 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258110 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258113 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258115 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258118 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258121 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258124 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258126 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258129 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258132 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 10:00:12.262952 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258134 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258137 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258140 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258142 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258145 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258148 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258152 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258155 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258157 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258160 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258162 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258165 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258167 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258170 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258172 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258175 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258177 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258180 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258182 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258184 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 10:00:12.263319 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258187 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258189 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258192 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258196 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258199 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258202 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258205 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258207 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258210 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258213 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258216 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258219 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258222 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258225 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258228 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258231 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258234 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258237 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258239 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258242 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 10:00:12.263793 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258244 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258247 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258249 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258252 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258255 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258257 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258259 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258262 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258264 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258267 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258269 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258272 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258274 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258277 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258279 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258281 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258284 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258287 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258289 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258292 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 10:00:12.264282 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258294 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258297 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258299 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258301 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258304 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258307 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258309 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258312 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258314 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258317 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258319 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258321 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258323 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258327 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258330 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258333 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258336 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258339 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258341 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 10:00:12.264762 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258344 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258346 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258349 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258351 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258354 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258356 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:12.258359 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.258364 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.258476 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.262097 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.263538 2561 server.go:1019] "Starting client certificate rotation" Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.263638 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 10:00:12.265230 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.263681 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 10:00:12.267993 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.267971 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 10:00:12.269240 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.269219 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 10:00:12.281195 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.281173 2561 log.go:25] "Validated CRI v1 runtime API" Jul 14 10:00:12.283629 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.283608 2561 log.go:25] "Validated CRI v1 image API" Jul 14 10:00:12.284618 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.284602 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 10:00:12.287728 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.287699 2561 fs.go:135] Filesystem UUIDs: map[201fa1c1-cf4b-49b7-8b38-d031d3a43c5f:/dev/nvme0n1p3 3d8d770c-f00a-40f2-8dde-9289137cd015:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 14 10:00:12.287817 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.287727 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 10:00:12.293478 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.293300 2561 manager.go:216] Machine: {Timestamp:2026-07-14 10:00:12.291505557 +0000 UTC m=+0.388893812 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099773 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dde80b3e94e4719208d2fb0584e2c SystemUUID:ec2dde80-b3e9-4e47-1920-8d2fb0584e2c BootID:b0d70514-12b4-465d-ac1c-9dae9f4c7c98 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:f8:a2:ee:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:f8:a2:ee:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:da:2b:85:ed:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 10:00:12.293478 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.293465 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 10:00:12.293627 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.293581 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 10:00:12.296094 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.296072 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 10:00:12.298099 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.298069 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 10:00:12.298276 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.298108 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-82.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 10:00:12.299833 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.299819 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 10:00:12.299899 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.299840 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 10:00:12.299899 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.299852 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 10:00:12.300885 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.300872 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 10:00:12.302374 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.302362 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 10:00:12.305785 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.305769 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 14 10:00:12.305997 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.305984 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 10:00:12.306054 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.306028 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 14 10:00:12.306054 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.306042 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 10:00:12.306133 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.306058 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 10:00:12.306133 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.306074 2561 kubelet.go:398] "Adding apiserver pod source" Jul 14 10:00:12.306133 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.306086 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 10:00:12.306464 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.306451 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 10:00:12.306534 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.306474 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 10:00:12.309437 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.309415 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 10:00:12.311287 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.311273 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 10:00:12.311333 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.311304 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 10:00:12.311464 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.311454 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 10:00:12.311514 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.311468 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 10:00:12.311514 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.311474 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 10:00:12.311514 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.311480 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 10:00:12.311514 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.311487 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 10:00:12.311514 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.311493 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 10:00:12.312021 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.312011 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 10:00:12.312021 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.312021 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 10:00:12.312089 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.312028 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 10:00:12.312089 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.312033 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 10:00:12.312089 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.312042 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 10:00:12.312089 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.312050 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 10:00:12.312929 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.312918 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 10:00:12.312929 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.312928 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 10:00:12.315282 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.315257 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-82.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 10:00:12.315282 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.315263 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 10:00:12.315405 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.315361 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 10:00:12.316228 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.316216 2561 server.go:1268] "Started kubelet" Jul 14 10:00:12.316320 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.316294 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 10:00:12.316368 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.316308 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 10:00:12.316368 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.316359 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 10:00:12.317213 ip-10-0-139-82 systemd[1]: Started Kubernetes Kubelet. Jul 14 10:00:12.317811 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.317692 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 10:00:12.319044 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.318997 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 14 10:00:12.322906 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.321885 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-82.ec2.internal.18c21fa8d12859e4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-82.ec2.internal,UID:ip-10-0-139-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-82.ec2.internal,},FirstTimestamp:2026-07-14 10:00:12.316187108 +0000 UTC m=+0.413575300,LastTimestamp:2026-07-14 10:00:12.316187108 +0000 UTC m=+0.413575300,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-82.ec2.internal,}" Jul 14 10:00:12.324071 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.324051 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 10:00:12.324170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.324074 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 10:00:12.324227 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.324171 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:12.324697 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.324680 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 10:00:12.324809 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.324680 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 10:00:12.324809 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.324736 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 10:00:12.324899 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.324875 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 14 10:00:12.324899 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.324886 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 14 10:00:12.325137 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.325118 2561 factory.go:55] Registering systemd factory Jul 14 10:00:12.325137 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.325139 2561 factory.go:223] Registration of the systemd container factory successfully Jul 14 10:00:12.325391 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.325365 2561 factory.go:153] Registering CRI-O factory Jul 14 10:00:12.325391 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.325384 2561 factory.go:223] Registration of the crio container factory successfully Jul 14 10:00:12.325511 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.325384 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 10:00:12.325511 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.325436 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 10:00:12.325511 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.325459 2561 factory.go:103] Registering Raw factory Jul 14 10:00:12.325511 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.325472 2561 manager.go:1196] Started watching for new ooms in manager Jul 14 10:00:12.326606 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.326584 2561 manager.go:349] Starting recovery of all containers Jul 14 10:00:12.333623 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.332996 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 10:00:12.333623 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.333299 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 10:00:12.336705 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.336686 2561 manager.go:354] Recovery completed Jul 14 10:00:12.342103 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.341956 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:12.344057 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.344042 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:12.344113 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.344071 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:12.344113 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.344083 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:12.344676 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.344661 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 10:00:12.344676 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.344669 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:12.344676 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.344674 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 10:00:12.344786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.344690 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 14 10:00:12.345355 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.345337 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:12.345438 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.345363 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:12.345438 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.345374 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:12.346131 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.346119 2561 policy_none.go:49] "None policy: Start" Jul 14 10:00:12.346184 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.346134 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 10:00:12.346184 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.346145 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 10:00:12.347164 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.347154 2561 policy_none.go:47] "Start" Jul 14 10:00:12.347847 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.347829 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hqrv" Jul 14 10:00:12.353691 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.353673 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hqrv" Jul 14 10:00:12.353771 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.353705 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-82.ec2.internal.18c21fa8d2d1a217 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-82.ec2.internal,UID:ip-10-0-139-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-82.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-82.ec2.internal,},FirstTimestamp:2026-07-14 10:00:12.344058391 +0000 UTC m=+0.441446584,LastTimestamp:2026-07-14 10:00:12.344058391 +0000 UTC m=+0.441446584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-82.ec2.internal,}" Jul 14 10:00:12.359147 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.359071 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-82.ec2.internal.18c21fa8d2d1e5e0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-82.ec2.internal,UID:ip-10-0-139-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-82.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-82.ec2.internal,},FirstTimestamp:2026-07-14 10:00:12.344075744 +0000 UTC m=+0.441463937,LastTimestamp:2026-07-14 10:00:12.344075744 +0000 UTC m=+0.441463937,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-82.ec2.internal,}" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.387189 2561 manager.go:337] "Starting Device Plugin manager" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.387227 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.387240 2561 server.go:87] "Starting device plugin registration server" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.387484 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.387500 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.387732 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.387822 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.387830 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.388379 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 10:00:12.404739 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.388432 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:12.440822 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.440777 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 10:00:12.442195 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.442176 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 10:00:12.442303 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.442212 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 10:00:12.442303 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.442234 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 10:00:12.442303 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.442266 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 10:00:12.444653 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.444629 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:12.488616 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.488550 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:12.490110 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.490093 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:12.490184 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.490126 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:12.490184 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.490141 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:12.490184 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.490164 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.499741 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.499717 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.499827 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.499746 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-82.ec2.internal\": node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:12.523189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.523152 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:12.542873 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.542841 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal"] Jul 14 10:00:12.543015 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.542907 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:12.544574 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.544559 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:12.544636 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.544600 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:12.544636 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.544616 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:12.546140 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.546122 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:12.546257 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.546237 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.546327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.546291 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:12.547060 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.547042 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:12.547060 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.547053 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:12.547213 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.547067 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:12.547213 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.547076 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:12.547213 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.547077 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:12.547213 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.547092 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:12.549107 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.549093 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.549165 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.549119 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 10:00:12.550375 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.550356 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientMemory" Jul 14 10:00:12.550489 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.550419 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 10:00:12.550489 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.550435 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeHasSufficientPID" Jul 14 10:00:12.575728 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.575694 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-82.ec2.internal\" not found" node="ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.580507 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.580489 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-82.ec2.internal\" not found" node="ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.624081 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.624048 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:12.627350 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.627327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/48011e991b26b97b5ae0c1a3157566a6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-82.ec2.internal\" (UID: \"48011e991b26b97b5ae0c1a3157566a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.627424 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.627358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc6f6cfa993df0b5e88de23c598d0eff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal\" (UID: \"fc6f6cfa993df0b5e88de23c598d0eff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.627424 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.627374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc6f6cfa993df0b5e88de23c598d0eff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal\" (UID: \"fc6f6cfa993df0b5e88de23c598d0eff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.724579 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.724511 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:12.727761 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.727746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/48011e991b26b97b5ae0c1a3157566a6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-82.ec2.internal\" (UID: \"48011e991b26b97b5ae0c1a3157566a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.727823 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.727769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc6f6cfa993df0b5e88de23c598d0eff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal\" (UID: \"fc6f6cfa993df0b5e88de23c598d0eff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.727823 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.727785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc6f6cfa993df0b5e88de23c598d0eff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal\" (UID: \"fc6f6cfa993df0b5e88de23c598d0eff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.727923 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.727849 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/48011e991b26b97b5ae0c1a3157566a6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-82.ec2.internal\" (UID: \"48011e991b26b97b5ae0c1a3157566a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.727923 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.727850 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc6f6cfa993df0b5e88de23c598d0eff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal\" (UID: \"fc6f6cfa993df0b5e88de23c598d0eff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.727923 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.727866 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc6f6cfa993df0b5e88de23c598d0eff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal\" (UID: \"fc6f6cfa993df0b5e88de23c598d0eff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.825295 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.825243 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:12.877631 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.877605 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.883742 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:12.883718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" Jul 14 10:00:12.925620 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:12.925590 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:13.026094 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:13.026013 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:13.126528 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:13.126494 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:13.227114 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:13.227077 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:13.263428 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.263406 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 10:00:13.263890 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.263554 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 10:00:13.328008 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:13.327976 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-82.ec2.internal\" not found" Jul 14 10:00:13.357445 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.357383 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 09:55:12 +0000 UTC" deadline="2028-04-08 05:42:56.814879604 +0000 UTC" Jul 14 10:00:13.357445 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.357436 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15211h42m43.457449209s" Jul 14 10:00:13.376325 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.376296 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:13.392989 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:13.392950 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6f6cfa993df0b5e88de23c598d0eff.slice/crio-5fa91a6c83b65915b79d4c8b919a61907e9e483fe4a72d1590cd66f13b7695d4 WatchSource:0}: Error finding container 5fa91a6c83b65915b79d4c8b919a61907e9e483fe4a72d1590cd66f13b7695d4: Status 404 returned error can't find the container with id 5fa91a6c83b65915b79d4c8b919a61907e9e483fe4a72d1590cd66f13b7695d4 Jul 14 10:00:13.398846 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.398829 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 10:00:13.412013 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:13.411980 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48011e991b26b97b5ae0c1a3157566a6.slice/crio-81114b6460e7375c456a3409f2e3bb7bc44ebac65ce5a763b604a7ecd93fd061 WatchSource:0}: Error finding container 81114b6460e7375c456a3409f2e3bb7bc44ebac65ce5a763b604a7ecd93fd061: Status 404 returned error can't find the container with id 81114b6460e7375c456a3409f2e3bb7bc44ebac65ce5a763b604a7ecd93fd061 Jul 14 10:00:13.415374 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.415358 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:13.424465 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.424439 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal" Jul 14 10:00:13.436342 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.436319 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 10:00:13.438905 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.438891 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" Jul 14 10:00:13.446098 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.446052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal" event={"ID":"48011e991b26b97b5ae0c1a3157566a6","Type":"ContainerStarted","Data":"81114b6460e7375c456a3409f2e3bb7bc44ebac65ce5a763b604a7ecd93fd061"} Jul 14 10:00:13.447152 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.447129 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" event={"ID":"fc6f6cfa993df0b5e88de23c598d0eff","Type":"ContainerStarted","Data":"5fa91a6c83b65915b79d4c8b919a61907e9e483fe4a72d1590cd66f13b7695d4"} Jul 14 10:00:13.454264 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.454241 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 10:00:13.688350 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:13.688263 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:14.207127 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.207094 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 10:00:14.307672 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.307636 2561 apiserver.go:52] "Watching apiserver" Jul 14 10:00:14.318494 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.318463 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 10:00:14.319677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.319652 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2qd4v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal","openshift-multus/multus-95xnl","openshift-dns/node-resolver-rfwhk","openshift-multus/multus-additional-cni-plugins-mvv6p","openshift-multus/network-metrics-daemon-vngw5","openshift-network-diagnostics/network-check-target-vx8xc","openshift-network-operator/iptables-alerter-h7gzv","openshift-ovn-kubernetes/ovnkube-node-6v5bh","kube-system/global-pull-secret-syncer-t64dj","kube-system/konnectivity-agent-m67dp","kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4","openshift-cluster-node-tuning-operator/tuned-47kxj"] Jul 14 10:00:14.321341 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.321316 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.321442 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.321398 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:14.322698 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.322679 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.324163 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.324139 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.324760 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.324743 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 10:00:14.325665 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.325607 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.325665 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.325622 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6scfq\"" Jul 14 10:00:14.325841 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.325696 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 10:00:14.325841 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.325820 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 10:00:14.325841 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.325832 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 10:00:14.326805 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.326781 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 10:00:14.327016 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.326821 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 10:00:14.327016 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.326867 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f76jh\"" Jul 14 10:00:14.327016 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.326998 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.327194 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.327100 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 10:00:14.327194 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.327117 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 10:00:14.328338 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.328318 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:14.328338 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.328331 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 10:00:14.328457 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.328396 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:14.328457 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.328411 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tzllq\"" Jul 14 10:00:14.328457 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.328407 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 10:00:14.329394 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.329377 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lgk6s\"" Jul 14 10:00:14.329501 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.329473 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 10:00:14.329745 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.329728 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 10:00:14.329872 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.329798 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.331540 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.331287 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.332216 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.332191 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 10:00:14.332355 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.332299 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 10:00:14.332510 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.332495 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 10:00:14.332587 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.332558 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n8bmq\"" Jul 14 10:00:14.332939 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.332925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.333761 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.333741 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 10:00:14.333761 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.333742 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 10:00:14.333916 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.333803 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qnj4b\"" Jul 14 10:00:14.336315 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.334916 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 10:00:14.336315 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.335006 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:00:14.336315 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.335459 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.336315 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.335712 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 10:00:14.336655 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.336443 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 10:00:14.336655 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.336582 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 10:00:14.336799 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.336742 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fv9tt\"" Jul 14 10:00:14.336879 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.336854 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:00:14.337202 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-registration-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.337297 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-cnibin\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.337297 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0efce125-9bae-4e39-a903-e19620955a88-multus-daemon-config\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.337297 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-run-multus-certs\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.337448 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337314 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-multus-cni-dir\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.337448 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-run-k8s-cni-cncf-io\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.337448 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-dbus\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.337448 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-var-lib-cni-multus\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.337693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-etc-kubernetes\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.337693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d7d7750a-ed94-4fce-8684-53b69c2befba-hosts-file\") pod \"node-resolver-rfwhk\" (UID: \"d7d7750a-ed94-4fce-8684-53b69c2befba\") " pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.337693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krshf\" (UniqueName: \"kubernetes.io/projected/d7d7750a-ed94-4fce-8684-53b69c2befba-kube-api-access-krshf\") pod \"node-resolver-rfwhk\" (UID: \"d7d7750a-ed94-4fce-8684-53b69c2befba\") " pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.337693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.337693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-sys-fs\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.337693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337651 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-os-release\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.337693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-run-netns\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.338158 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337766 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-var-lib-cni-bin\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.338657 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.337866 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.338644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-system-cni-dir\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339189 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqvt\" (UniqueName: \"kubernetes.io/projected/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-kube-api-access-6lqvt\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0efce125-9bae-4e39-a903-e19620955a88-cni-binary-copy\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-multus-socket-dir-parent\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-socket-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-device-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339315 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-multus-conf-dir\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339353 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339379 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pbtjm\"" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-kubelet-config\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-var-lib-kubelet\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339426 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-hostroot\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339481 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339483 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9bm7\" (UniqueName: \"kubernetes.io/projected/0efce125-9bae-4e39-a903-e19620955a88-kube-api-access-l9bm7\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339537 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7d7750a-ed94-4fce-8684-53b69c2befba-tmp-dir\") pod \"node-resolver-rfwhk\" (UID: \"d7d7750a-ed94-4fce-8684-53b69c2befba\") " pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.340433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.339820 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:14.341546 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.339905 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:14.341781 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.341759 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 10:00:14.341861 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.341785 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-29xmc\"" Jul 14 10:00:14.341940 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.341764 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 10:00:14.361442 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.361421 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8n5lm" Jul 14 10:00:14.367742 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.367719 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8n5lm" Jul 14 10:00:14.426384 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.426352 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 10:00:14.439885 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.439852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krshf\" (UniqueName: \"kubernetes.io/projected/d7d7750a-ed94-4fce-8684-53b69c2befba-kube-api-access-krshf\") pod \"node-resolver-rfwhk\" (UID: \"d7d7750a-ed94-4fce-8684-53b69c2befba\") " pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.439981 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.439920 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-run-ovn\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.439981 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.439946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-modprobe-d\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.439981 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.439975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-sysctl-d\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.440138 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.440138 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-sys-fs\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.440138 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.440095 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:14.440138 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-var-lib-cni-bin\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440138 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-run-systemd\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440150 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-sys-fs\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.440171 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret podName:3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:14.940149335 +0000 UTC m=+3.037537532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret") pod "global-pull-secret-syncer-t64dj" (UID: "3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-system-cni-dir\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440200 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-var-lib-cni-bin\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-system-cni-dir\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-var-lib-openvswitch\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-cni-netd\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440279 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-tuned\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440287 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-system-cni-dir\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqvt\" (UniqueName: \"kubernetes.io/projected/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-kube-api-access-6lqvt\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.440327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-multus-socket-dir-parent\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440411 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-run-ovn-kubernetes\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-kubernetes\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-sysctl-conf\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwxlf\" (UniqueName: \"kubernetes.io/projected/c81bb332-2d6c-4f02-9378-c0274d81c038-kube-api-access-cwxlf\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440508 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-multus-socket-dir-parent\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-device-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-multus-conf-dir\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr6v7\" (UniqueName: \"kubernetes.io/projected/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-kube-api-access-fr6v7\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-sys\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440609 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-lib-modules\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440627 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-multus-conf-dir\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-cnibin\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440641 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-device-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-var-lib-kubelet\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-hostroot\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440701 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9bm7\" (UniqueName: \"kubernetes.io/projected/0efce125-9bae-4e39-a903-e19620955a88-kube-api-access-l9bm7\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.440812 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-slash\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440745 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-hostroot\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440750 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-var-lib-kubelet\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-run-netns\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-var-lib-kubelet\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440881 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0efce125-9bae-4e39-a903-e19620955a88-multus-daemon-config\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-run-openvswitch\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-node-log\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-cni-bin\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e83875eb-181b-474d-9c06-2a04e0db1ebb-ovnkube-config\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.440992 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r6zc\" (UniqueName: \"kubernetes.io/projected/f6acd9a7-7ba5-4c47-a46f-cf983aceb58b-kube-api-access-9r6zc\") pod \"iptables-alerter-h7gzv\" (UID: \"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b\") " pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dca51534-98f3-45a0-a191-f981cc9daa13-cni-binary-copy\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-multus-cni-dir\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-run-k8s-cni-cncf-io\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441097 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-systemd-units\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f6acd9a7-7ba5-4c47-a46f-cf983aceb58b-iptables-alerter-script\") pod \"iptables-alerter-h7gzv\" (UID: \"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b\") " pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6qcv\" (UniqueName: \"kubernetes.io/projected/b11e3dfb-042f-45a5-b118-3e59564ea508-kube-api-access-r6qcv\") pod \"node-ca-2qd4v\" (UID: \"b11e3dfb-042f-45a5-b118-3e59564ea508\") " pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.441552 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441170 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-run-k8s-cni-cncf-io\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-var-lib-cni-multus\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441201 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-multus-cni-dir\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441214 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-etc-kubernetes\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441224 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-var-lib-cni-multus\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-kubelet\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-os-release\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441312 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-etc-kubernetes\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-run-netns\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441396 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-run-netns\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441443 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-os-release\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441449 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-host\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441483 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e83875eb-181b-474d-9c06-2a04e0db1ebb-env-overrides\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441524 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0efce125-9bae-4e39-a903-e19620955a88-multus-daemon-config\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.442420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-run\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6acd9a7-7ba5-4c47-a46f-cf983aceb58b-host-slash\") pod \"iptables-alerter-h7gzv\" (UID: \"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b\") " pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441593 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-os-release\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dca51534-98f3-45a0-a191-f981cc9daa13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441663 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dca51534-98f3-45a0-a191-f981cc9daa13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441737 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0efce125-9bae-4e39-a903-e19620955a88-cni-binary-copy\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e83875eb-181b-474d-9c06-2a04e0db1ebb-ovnkube-script-lib\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441758 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-sysconfig\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441844 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqxcr\" (UniqueName: \"kubernetes.io/projected/dca51534-98f3-45a0-a191-f981cc9daa13-kube-api-access-bqxcr\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b11e3dfb-042f-45a5-b118-3e59564ea508-serviceca\") pod \"node-ca-2qd4v\" (UID: \"b11e3dfb-042f-45a5-b118-3e59564ea508\") " pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-socket-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441952 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-kubelet-config\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.441977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7d7750a-ed94-4fce-8684-53b69c2befba-tmp-dir\") pod \"node-resolver-rfwhk\" (UID: \"d7d7750a-ed94-4fce-8684-53b69c2befba\") " pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.443083 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e83875eb-181b-474d-9c06-2a04e0db1ebb-ovn-node-metrics-cert\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442012 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-kubelet-config\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mh7b\" (UniqueName: \"kubernetes.io/projected/e83875eb-181b-474d-9c06-2a04e0db1ebb-kube-api-access-9mh7b\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b11e3dfb-042f-45a5-b118-3e59564ea508-host\") pod \"node-ca-2qd4v\" (UID: \"b11e3dfb-042f-45a5-b118-3e59564ea508\") " pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442077 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-registration-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-cnibin\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-run-multus-certs\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-etc-openvswitch\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442172 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-registration-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442208 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-socket-dir\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442218 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-host-run-multus-certs\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-log-socket\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442246 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0efce125-9bae-4e39-a903-e19620955a88-cni-binary-copy\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442245 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0efce125-9bae-4e39-a903-e19620955a88-cnibin\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442306 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7d7750a-ed94-4fce-8684-53b69c2befba-tmp-dir\") pod \"node-resolver-rfwhk\" (UID: \"d7d7750a-ed94-4fce-8684-53b69c2befba\") " pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.443677 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-systemd\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.444210 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c81bb332-2d6c-4f02-9378-c0274d81c038-tmp\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.444210 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50f67e5c-fcc3-4a0b-ae24-73ead64751b0-agent-certs\") pod \"konnectivity-agent-m67dp\" (UID: \"50f67e5c-fcc3-4a0b-ae24-73ead64751b0\") " pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:14.444210 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50f67e5c-fcc3-4a0b-ae24-73ead64751b0-konnectivity-ca\") pod \"konnectivity-agent-m67dp\" (UID: \"50f67e5c-fcc3-4a0b-ae24-73ead64751b0\") " pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:14.444210 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442435 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-dbus\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.444210 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d7d7750a-ed94-4fce-8684-53b69c2befba-hosts-file\") pod \"node-resolver-rfwhk\" (UID: \"d7d7750a-ed94-4fce-8684-53b69c2befba\") " pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.444210 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442579 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-dbus\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.444210 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.442592 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d7d7750a-ed94-4fce-8684-53b69c2befba-hosts-file\") pod \"node-resolver-rfwhk\" (UID: \"d7d7750a-ed94-4fce-8684-53b69c2befba\") " pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.447452 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.447425 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 10:00:14.451131 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.451103 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9bm7\" (UniqueName: \"kubernetes.io/projected/0efce125-9bae-4e39-a903-e19620955a88-kube-api-access-l9bm7\") pod \"multus-95xnl\" (UID: \"0efce125-9bae-4e39-a903-e19620955a88\") " pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.451252 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.451103 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krshf\" (UniqueName: \"kubernetes.io/projected/d7d7750a-ed94-4fce-8684-53b69c2befba-kube-api-access-krshf\") pod \"node-resolver-rfwhk\" (UID: \"d7d7750a-ed94-4fce-8684-53b69c2befba\") " pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.451252 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.451150 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqvt\" (UniqueName: \"kubernetes.io/projected/b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3-kube-api-access-6lqvt\") pod \"aws-ebs-csi-driver-node-jkfz4\" (UID: \"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.542954 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.542848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-slash\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.542954 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.542888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-run-netns\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.542954 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.542914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-var-lib-kubelet\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.542954 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.542939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-run-openvswitch\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.542976 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-slash\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.542982 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-run-openvswitch\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543000 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-run-netns\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543037 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-var-lib-kubelet\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543041 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-node-log\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543102 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-node-log\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543104 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-cni-bin\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543148 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-cni-bin\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e83875eb-181b-474d-9c06-2a04e0db1ebb-ovnkube-config\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r6zc\" (UniqueName: \"kubernetes.io/projected/f6acd9a7-7ba5-4c47-a46f-cf983aceb58b-kube-api-access-9r6zc\") pod \"iptables-alerter-h7gzv\" (UID: \"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b\") " pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.543284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543222 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dca51534-98f3-45a0-a191-f981cc9daa13-cni-binary-copy\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-systemd-units\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f6acd9a7-7ba5-4c47-a46f-cf983aceb58b-iptables-alerter-script\") pod \"iptables-alerter-h7gzv\" (UID: \"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b\") " pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6qcv\" (UniqueName: \"kubernetes.io/projected/b11e3dfb-042f-45a5-b118-3e59564ea508-kube-api-access-r6qcv\") pod \"node-ca-2qd4v\" (UID: \"b11e3dfb-042f-45a5-b118-3e59564ea508\") " pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-kubelet\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543459 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-host\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543494 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-kubelet\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e83875eb-181b-474d-9c06-2a04e0db1ebb-env-overrides\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-run\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6acd9a7-7ba5-4c47-a46f-cf983aceb58b-host-slash\") pod \"iptables-alerter-h7gzv\" (UID: \"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b\") " pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.543593 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-os-release\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dca51534-98f3-45a0-a191-f981cc9daa13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.543673 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs podName:0e14bf74-373b-4b7d-a6a4-32b73e28a0d0 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:15.04364201 +0000 UTC m=+3.141030196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs") pod "network-metrics-daemon-vngw5" (UID: "0e14bf74-373b-4b7d-a6a4-32b73e28a0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:14.543933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dca51534-98f3-45a0-a191-f981cc9daa13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e83875eb-181b-474d-9c06-2a04e0db1ebb-ovnkube-script-lib\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-sysconfig\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543954 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dca51534-98f3-45a0-a191-f981cc9daa13-cni-binary-copy\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.543969 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e83875eb-181b-474d-9c06-2a04e0db1ebb-ovnkube-config\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544003 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-systemd-units\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544014 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6acd9a7-7ba5-4c47-a46f-cf983aceb58b-host-slash\") pod \"iptables-alerter-h7gzv\" (UID: \"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b\") " pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544026 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-run\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544058 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-os-release\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544069 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-sysconfig\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544089 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-host\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqxcr\" (UniqueName: \"kubernetes.io/projected/dca51534-98f3-45a0-a191-f981cc9daa13-kube-api-access-bqxcr\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b11e3dfb-042f-45a5-b118-3e59564ea508-serviceca\") pod \"node-ca-2qd4v\" (UID: \"b11e3dfb-042f-45a5-b118-3e59564ea508\") " pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e83875eb-181b-474d-9c06-2a04e0db1ebb-ovn-node-metrics-cert\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544187 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mh7b\" (UniqueName: \"kubernetes.io/projected/e83875eb-181b-474d-9c06-2a04e0db1ebb-kube-api-access-9mh7b\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544222 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dca51534-98f3-45a0-a191-f981cc9daa13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.544830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b11e3dfb-042f-45a5-b118-3e59564ea508-host\") pod \"node-ca-2qd4v\" (UID: \"b11e3dfb-042f-45a5-b118-3e59564ea508\") " pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-etc-openvswitch\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-log-socket\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-systemd\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c81bb332-2d6c-4f02-9378-c0274d81c038-tmp\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50f67e5c-fcc3-4a0b-ae24-73ead64751b0-agent-certs\") pod \"konnectivity-agent-m67dp\" (UID: \"50f67e5c-fcc3-4a0b-ae24-73ead64751b0\") " pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544420 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50f67e5c-fcc3-4a0b-ae24-73ead64751b0-konnectivity-ca\") pod \"konnectivity-agent-m67dp\" (UID: \"50f67e5c-fcc3-4a0b-ae24-73ead64751b0\") " pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544437 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-log-socket\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544450 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-run-ovn\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544480 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-etc-openvswitch\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-modprobe-d\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b11e3dfb-042f-45a5-b118-3e59564ea508-host\") pod \"node-ca-2qd4v\" (UID: \"b11e3dfb-042f-45a5-b118-3e59564ea508\") " pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-sysctl-d\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544509 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dca51534-98f3-45a0-a191-f981cc9daa13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544541 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e83875eb-181b-474d-9c06-2a04e0db1ebb-ovnkube-script-lib\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-run-systemd\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.546081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-system-cni-dir\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544599 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-run-ovn\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544625 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-system-cni-dir\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544674 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-run-systemd\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544732 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-systemd\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544743 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-sysctl-d\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544757 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-modprobe-d\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544777 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544781 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f6acd9a7-7ba5-4c47-a46f-cf983aceb58b-iptables-alerter-script\") pod \"iptables-alerter-h7gzv\" (UID: \"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b\") " pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544802 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e83875eb-181b-474d-9c06-2a04e0db1ebb-env-overrides\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-var-lib-openvswitch\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544850 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-cni-netd\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-tuned\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-run-ovn-kubernetes\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544929 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-var-lib-openvswitch\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544943 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-cni-netd\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-kubernetes\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.547212 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544977 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-kubernetes\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.544992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-sysctl-conf\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwxlf\" (UniqueName: \"kubernetes.io/projected/c81bb332-2d6c-4f02-9378-c0274d81c038-kube-api-access-cwxlf\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr6v7\" (UniqueName: \"kubernetes.io/projected/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-kube-api-access-fr6v7\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545080 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-sys\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-lib-modules\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-cnibin\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545140 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-sysctl-conf\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545022 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83875eb-181b-474d-9c06-2a04e0db1ebb-host-run-ovn-kubernetes\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545277 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-lib-modules\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545325 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dca51534-98f3-45a0-a191-f981cc9daa13-cnibin\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545455 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c81bb332-2d6c-4f02-9378-c0274d81c038-sys\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545607 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50f67e5c-fcc3-4a0b-ae24-73ead64751b0-konnectivity-ca\") pod \"konnectivity-agent-m67dp\" (UID: \"50f67e5c-fcc3-4a0b-ae24-73ead64751b0\") " pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.545979 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b11e3dfb-042f-45a5-b118-3e59564ea508-serviceca\") pod \"node-ca-2qd4v\" (UID: \"b11e3dfb-042f-45a5-b118-3e59564ea508\") " pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.547392 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c81bb332-2d6c-4f02-9378-c0274d81c038-tmp\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.547480 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e83875eb-181b-474d-9c06-2a04e0db1ebb-ovn-node-metrics-cert\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.548023 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.547574 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c81bb332-2d6c-4f02-9378-c0274d81c038-etc-tuned\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.548504 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.548040 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50f67e5c-fcc3-4a0b-ae24-73ead64751b0-agent-certs\") pod \"konnectivity-agent-m67dp\" (UID: \"50f67e5c-fcc3-4a0b-ae24-73ead64751b0\") " pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:14.553221 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.553198 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:14.553312 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.553227 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:14.553312 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.553241 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p5f4f for pod openshift-network-diagnostics/network-check-target-vx8xc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:14.553493 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.553324 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f podName:45cd99fa-b233-4420-b004-9284aabcba1a nodeName:}" failed. No retries permitted until 2026-07-14 10:00:15.053303859 +0000 UTC m=+3.150692049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p5f4f" (UniqueName: "kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f") pod "network-check-target-vx8xc" (UID: "45cd99fa-b233-4420-b004-9284aabcba1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:14.556457 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.556426 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6qcv\" (UniqueName: \"kubernetes.io/projected/b11e3dfb-042f-45a5-b118-3e59564ea508-kube-api-access-r6qcv\") pod \"node-ca-2qd4v\" (UID: \"b11e3dfb-042f-45a5-b118-3e59564ea508\") " pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.556660 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.556623 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r6zc\" (UniqueName: \"kubernetes.io/projected/f6acd9a7-7ba5-4c47-a46f-cf983aceb58b-kube-api-access-9r6zc\") pod \"iptables-alerter-h7gzv\" (UID: \"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b\") " pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.556731 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.556672 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwxlf\" (UniqueName: \"kubernetes.io/projected/c81bb332-2d6c-4f02-9378-c0274d81c038-kube-api-access-cwxlf\") pod \"tuned-47kxj\" (UID: \"c81bb332-2d6c-4f02-9378-c0274d81c038\") " pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.556794 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.556778 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr6v7\" (UniqueName: \"kubernetes.io/projected/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-kube-api-access-fr6v7\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:14.556953 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.556935 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqxcr\" (UniqueName: \"kubernetes.io/projected/dca51534-98f3-45a0-a191-f981cc9daa13-kube-api-access-bqxcr\") pod \"multus-additional-cni-plugins-mvv6p\" (UID: \"dca51534-98f3-45a0-a191-f981cc9daa13\") " pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.556990 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.556939 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mh7b\" (UniqueName: \"kubernetes.io/projected/e83875eb-181b-474d-9c06-2a04e0db1ebb-kube-api-access-9mh7b\") pod \"ovnkube-node-6v5bh\" (UID: \"e83875eb-181b-474d-9c06-2a04e0db1ebb\") " pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.634462 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.634423 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" Jul 14 10:00:14.644026 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.643997 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95xnl" Jul 14 10:00:14.644482 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:14.644454 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3da3fb7_6be0_4a88_b0cb_5e94756ac2b3.slice/crio-1993d10eaae6d2e24dafd50af4755da8ad6458814580901e80e812096c0d6886 WatchSource:0}: Error finding container 1993d10eaae6d2e24dafd50af4755da8ad6458814580901e80e812096c0d6886: Status 404 returned error can't find the container with id 1993d10eaae6d2e24dafd50af4755da8ad6458814580901e80e812096c0d6886 Jul 14 10:00:14.651370 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.651342 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rfwhk" Jul 14 10:00:14.653031 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:14.652975 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0efce125_9bae_4e39_a903_e19620955a88.slice/crio-360edf563d6a29ee51fae6f4e3ed211abb23962d1fcbc8f0c19ce46d5851be74 WatchSource:0}: Error finding container 360edf563d6a29ee51fae6f4e3ed211abb23962d1fcbc8f0c19ce46d5851be74: Status 404 returned error can't find the container with id 360edf563d6a29ee51fae6f4e3ed211abb23962d1fcbc8f0c19ce46d5851be74 Jul 14 10:00:14.656206 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.656186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" Jul 14 10:00:14.661954 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.661933 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:14.662693 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:14.662667 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d7750a_ed94_4fce_8684_53b69c2befba.slice/crio-12314bdbafdc868b8ca980ecc9fe9faf26cc1e8e016cceffdbc45fe8b8e6704c WatchSource:0}: Error finding container 12314bdbafdc868b8ca980ecc9fe9faf26cc1e8e016cceffdbc45fe8b8e6704c: Status 404 returned error can't find the container with id 12314bdbafdc868b8ca980ecc9fe9faf26cc1e8e016cceffdbc45fe8b8e6704c Jul 14 10:00:14.667914 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.667889 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-47kxj" Jul 14 10:00:14.672488 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:14.672466 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83875eb_181b_474d_9c06_2a04e0db1ebb.slice/crio-c99ce8b45f2f346138c016cdbdb49f53eec03bbd6eef574036c59e06617fedab WatchSource:0}: Error finding container c99ce8b45f2f346138c016cdbdb49f53eec03bbd6eef574036c59e06617fedab: Status 404 returned error can't find the container with id c99ce8b45f2f346138c016cdbdb49f53eec03bbd6eef574036c59e06617fedab Jul 14 10:00:14.674843 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.674806 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h7gzv" Jul 14 10:00:14.681070 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:14.681047 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81bb332_2d6c_4f02_9378_c0274d81c038.slice/crio-3bd9d881165347aef1494587ba4cc6fb2140794890fb8047cb464244085213d1 WatchSource:0}: Error finding container 3bd9d881165347aef1494587ba4cc6fb2140794890fb8047cb464244085213d1: Status 404 returned error can't find the container with id 3bd9d881165347aef1494587ba4cc6fb2140794890fb8047cb464244085213d1 Jul 14 10:00:14.681154 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.681059 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2qd4v" Jul 14 10:00:14.684163 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:14.684133 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6acd9a7_7ba5_4c47_a46f_cf983aceb58b.slice/crio-6525f762c7c6e0f58c8b45d9cf10053ab1fd4292cb6b167217f01f6ea2ee6182 WatchSource:0}: Error finding container 6525f762c7c6e0f58c8b45d9cf10053ab1fd4292cb6b167217f01f6ea2ee6182: Status 404 returned error can't find the container with id 6525f762c7c6e0f58c8b45d9cf10053ab1fd4292cb6b167217f01f6ea2ee6182 Jul 14 10:00:14.686312 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.686288 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:14.694296 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:14.694266 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11e3dfb_042f_45a5_b118_3e59564ea508.slice/crio-03f79ba01d47e06e10f5746f9518c962d68c755d54e5d06981d6b5fba5676a5d WatchSource:0}: Error finding container 03f79ba01d47e06e10f5746f9518c962d68c755d54e5d06981d6b5fba5676a5d: Status 404 returned error can't find the container with id 03f79ba01d47e06e10f5746f9518c962d68c755d54e5d06981d6b5fba5676a5d Jul 14 10:00:14.698628 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:14.698452 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f67e5c_fcc3_4a0b_ae24_73ead64751b0.slice/crio-d00e7268fb0d909bccb66dac89984f935bebb8832f34c2859de5314371f6094b WatchSource:0}: Error finding container d00e7268fb0d909bccb66dac89984f935bebb8832f34c2859de5314371f6094b: Status 404 returned error can't find the container with id d00e7268fb0d909bccb66dac89984f935bebb8832f34c2859de5314371f6094b Jul 14 10:00:14.949227 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:14.949131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:14.949406 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.949288 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:14.949406 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:14.949357 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret podName:3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:15.949335977 +0000 UTC m=+4.046724166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret") pod "global-pull-secret-syncer-t64dj" (UID: "3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:15.050374 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.050329 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:15.050576 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.050476 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:15.050576 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.050540 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs podName:0e14bf74-373b-4b7d-a6a4-32b73e28a0d0 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:16.050521975 +0000 UTC m=+4.147910162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs") pod "network-metrics-daemon-vngw5" (UID: "0e14bf74-373b-4b7d-a6a4-32b73e28a0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:15.151661 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.151621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:15.151895 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.151874 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:15.152052 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.151904 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:15.152052 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.151920 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p5f4f for pod openshift-network-diagnostics/network-check-target-vx8xc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:15.152052 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.151990 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f podName:45cd99fa-b233-4420-b004-9284aabcba1a nodeName:}" failed. No retries permitted until 2026-07-14 10:00:16.151967382 +0000 UTC m=+4.249355569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5f4f" (UniqueName: "kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f") pod "network-check-target-vx8xc" (UID: "45cd99fa-b233-4420-b004-9284aabcba1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:15.369846 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.369739 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 09:55:14 +0000 UTC" deadline="2028-03-22 14:39:47.908450094 +0000 UTC" Jul 14 10:00:15.369846 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.369802 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14812h39m32.538652884s" Jul 14 10:00:15.443085 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.443044 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:15.443287 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.443195 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:15.443717 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.443044 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:15.443879 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.443831 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:15.451893 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.451842 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-47kxj" event={"ID":"c81bb332-2d6c-4f02-9378-c0274d81c038","Type":"ContainerStarted","Data":"3bd9d881165347aef1494587ba4cc6fb2140794890fb8047cb464244085213d1"} Jul 14 10:00:15.453642 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.453605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerStarted","Data":"c99ce8b45f2f346138c016cdbdb49f53eec03bbd6eef574036c59e06617fedab"} Jul 14 10:00:15.455091 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.455054 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rfwhk" event={"ID":"d7d7750a-ed94-4fce-8684-53b69c2befba","Type":"ContainerStarted","Data":"12314bdbafdc868b8ca980ecc9fe9faf26cc1e8e016cceffdbc45fe8b8e6704c"} Jul 14 10:00:15.456773 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.456741 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95xnl" event={"ID":"0efce125-9bae-4e39-a903-e19620955a88","Type":"ContainerStarted","Data":"360edf563d6a29ee51fae6f4e3ed211abb23962d1fcbc8f0c19ce46d5851be74"} Jul 14 10:00:15.458363 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.458329 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h7gzv" event={"ID":"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b","Type":"ContainerStarted","Data":"6525f762c7c6e0f58c8b45d9cf10053ab1fd4292cb6b167217f01f6ea2ee6182"} Jul 14 10:00:15.459770 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.459743 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" event={"ID":"dca51534-98f3-45a0-a191-f981cc9daa13","Type":"ContainerStarted","Data":"a7fece3896e69ea5559da98911725753cee9a05900f5b71d18cbc9b5fe3b5a27"} Jul 14 10:00:15.461127 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.461101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" event={"ID":"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3","Type":"ContainerStarted","Data":"1993d10eaae6d2e24dafd50af4755da8ad6458814580901e80e812096c0d6886"} Jul 14 10:00:15.462570 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.462528 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m67dp" event={"ID":"50f67e5c-fcc3-4a0b-ae24-73ead64751b0","Type":"ContainerStarted","Data":"d00e7268fb0d909bccb66dac89984f935bebb8832f34c2859de5314371f6094b"} Jul 14 10:00:15.463895 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.463874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2qd4v" event={"ID":"b11e3dfb-042f-45a5-b118-3e59564ea508","Type":"ContainerStarted","Data":"03f79ba01d47e06e10f5746f9518c962d68c755d54e5d06981d6b5fba5676a5d"} Jul 14 10:00:15.959042 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:15.958994 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:15.959237 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.959192 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:15.959304 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:15.959256 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret podName:3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:17.95923784 +0000 UTC m=+6.056626043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret") pod "global-pull-secret-syncer-t64dj" (UID: "3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:16.059971 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:16.059931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:16.060174 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:16.060153 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:16.060246 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:16.060220 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs podName:0e14bf74-373b-4b7d-a6a4-32b73e28a0d0 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:18.060199862 +0000 UTC m=+6.157588044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs") pod "network-metrics-daemon-vngw5" (UID: "0e14bf74-373b-4b7d-a6a4-32b73e28a0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:16.161409 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:16.161368 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:16.161620 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:16.161590 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:16.161620 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:16.161615 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:16.161731 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:16.161627 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p5f4f for pod openshift-network-diagnostics/network-check-target-vx8xc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:16.161731 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:16.161684 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f podName:45cd99fa-b233-4420-b004-9284aabcba1a nodeName:}" failed. No retries permitted until 2026-07-14 10:00:18.161666268 +0000 UTC m=+6.259054462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5f4f" (UniqueName: "kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f") pod "network-check-target-vx8xc" (UID: "45cd99fa-b233-4420-b004-9284aabcba1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:16.370094 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:16.369996 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 09:55:14 +0000 UTC" deadline="2027-12-16 08:21:27.535897628 +0000 UTC" Jul 14 10:00:16.370094 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:16.370046 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12478h21m11.165856925s" Jul 14 10:00:16.447723 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:16.447227 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:16.447723 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:16.447362 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:17.443220 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:17.443183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:17.443693 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:17.443338 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:17.443779 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:17.443715 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:17.443911 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:17.443832 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:17.977056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:17.976344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:17.977056 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:17.976515 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:17.977056 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:17.976583 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret podName:3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:21.976563107 +0000 UTC m=+10.073951290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret") pod "global-pull-secret-syncer-t64dj" (UID: "3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:18.077764 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:18.077722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:18.077959 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:18.077899 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:18.078024 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:18.077966 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs podName:0e14bf74-373b-4b7d-a6a4-32b73e28a0d0 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:22.077946256 +0000 UTC m=+10.175334460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs") pod "network-metrics-daemon-vngw5" (UID: "0e14bf74-373b-4b7d-a6a4-32b73e28a0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:18.179134 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:18.179085 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:18.179328 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:18.179308 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:18.179395 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:18.179331 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:18.179395 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:18.179345 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p5f4f for pod openshift-network-diagnostics/network-check-target-vx8xc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:18.179500 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:18.179401 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f podName:45cd99fa-b233-4420-b004-9284aabcba1a nodeName:}" failed. No retries permitted until 2026-07-14 10:00:22.179382753 +0000 UTC m=+10.276770939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5f4f" (UniqueName: "kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f") pod "network-check-target-vx8xc" (UID: "45cd99fa-b233-4420-b004-9284aabcba1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:18.445503 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:18.445421 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:18.446099 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:18.445570 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:19.443325 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:19.443288 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:19.443488 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:19.443445 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:19.443534 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:19.443497 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:19.443637 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:19.443611 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:20.444708 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:20.444005 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:20.444708 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:20.444196 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:21.442680 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:21.442454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:21.442680 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:21.442656 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:21.442917 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:21.442841 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:21.443227 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:21.443208 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:22.011043 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:22.010997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:22.011519 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:22.011186 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:22.011519 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:22.011241 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret podName:3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:30.011227941 +0000 UTC m=+18.108616121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret") pod "global-pull-secret-syncer-t64dj" (UID: "3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:22.111721 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:22.111682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:22.111932 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:22.111819 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:22.111932 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:22.111887 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs podName:0e14bf74-373b-4b7d-a6a4-32b73e28a0d0 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:30.11187289 +0000 UTC m=+18.209261072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs") pod "network-metrics-daemon-vngw5" (UID: "0e14bf74-373b-4b7d-a6a4-32b73e28a0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:22.212524 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:22.212484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:22.212699 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:22.212662 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:22.212699 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:22.212685 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:22.212699 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:22.212698 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p5f4f for pod openshift-network-diagnostics/network-check-target-vx8xc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:22.212904 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:22.212763 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f podName:45cd99fa-b233-4420-b004-9284aabcba1a nodeName:}" failed. No retries permitted until 2026-07-14 10:00:30.212744002 +0000 UTC m=+18.310132195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5f4f" (UniqueName: "kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f") pod "network-check-target-vx8xc" (UID: "45cd99fa-b233-4420-b004-9284aabcba1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:22.445210 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:22.445170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:22.445389 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:22.445310 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:23.442572 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:23.442536 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:23.443050 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:23.442673 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:23.443050 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:23.442972 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:23.443050 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:23.443040 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:24.443100 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:24.443062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:24.443481 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:24.443182 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:25.443217 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:25.443177 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:25.443217 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:25.443222 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:25.443623 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:25.443309 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:25.443623 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:25.443425 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:26.443222 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:26.443184 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:26.443694 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:26.443304 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:27.442631 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:27.442581 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:27.442881 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:27.442756 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:27.443253 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:27.443228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:27.443615 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:27.443336 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:28.443299 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:28.443256 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:28.443733 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:28.443469 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:29.442815 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:29.442767 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:29.443045 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:29.442828 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:29.443045 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:29.442926 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:29.443152 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:29.443045 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:30.071227 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:30.071169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:30.071702 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:30.071356 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:30.071702 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:30.071440 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret podName:3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:46.071418625 +0000 UTC m=+34.168806816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret") pod "global-pull-secret-syncer-t64dj" (UID: "3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:30.172351 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:30.172308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:30.172527 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:30.172425 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:30.172527 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:30.172507 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs podName:0e14bf74-373b-4b7d-a6a4-32b73e28a0d0 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:46.172486248 +0000 UTC m=+34.269874440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs") pod "network-metrics-daemon-vngw5" (UID: "0e14bf74-373b-4b7d-a6a4-32b73e28a0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:30.273581 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:30.273542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:30.273763 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:30.273734 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:30.273763 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:30.273761 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:30.273912 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:30.273772 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p5f4f for pod openshift-network-diagnostics/network-check-target-vx8xc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:30.273912 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:30.273850 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f podName:45cd99fa-b233-4420-b004-9284aabcba1a nodeName:}" failed. No retries permitted until 2026-07-14 10:00:46.273834064 +0000 UTC m=+34.371222249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5f4f" (UniqueName: "kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f") pod "network-check-target-vx8xc" (UID: "45cd99fa-b233-4420-b004-9284aabcba1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:30.443070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:30.442984 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:30.443215 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:30.443119 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:31.443240 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:31.443203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:31.443240 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:31.443238 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:31.443739 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:31.443348 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:31.443739 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:31.443494 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:32.443622 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:32.443589 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:32.444083 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:32.443692 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:33.442708 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:33.442666 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:33.442909 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:33.442725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:33.442909 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:33.442842 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:33.443014 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:33.442966 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:34.442763 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:34.442726 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:34.443303 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:34.442887 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:35.443631 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.443382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:35.444268 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.443421 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:35.444268 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:35.443712 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:35.444268 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:35.443769 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:35.512198 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.512163 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" event={"ID":"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3","Type":"ContainerStarted","Data":"c2209f2b8973c971679bf13e441778941d37d04328be3e83b2cb527dd4ec0114"} Jul 14 10:00:35.513882 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.513846 2561 generic.go:356] "Generic (PLEG): container finished" podID="fc6f6cfa993df0b5e88de23c598d0eff" containerID="278a392d0b930907cb5a819a940d2f2799cdb50fded892463f1bd9d190863cc2" exitCode=0 Jul 14 10:00:35.513986 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.513899 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" event={"ID":"fc6f6cfa993df0b5e88de23c598d0eff","Type":"ContainerDied","Data":"278a392d0b930907cb5a819a940d2f2799cdb50fded892463f1bd9d190863cc2"} Jul 14 10:00:35.515359 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.515327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m67dp" event={"ID":"50f67e5c-fcc3-4a0b-ae24-73ead64751b0","Type":"ContainerStarted","Data":"b94febd5e905a2984ede32f0e4a9b35a037dc0c3e6ed0c63e9547fb5ec78ee4b"} Jul 14 10:00:35.516838 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.516791 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2qd4v" event={"ID":"b11e3dfb-042f-45a5-b118-3e59564ea508","Type":"ContainerStarted","Data":"dc6852cda1fa9ec9b2a632379092c0cd87ffa966789ae3089866a4b4ed7d6f95"} Jul 14 10:00:35.518193 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.518172 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-47kxj" event={"ID":"c81bb332-2d6c-4f02-9378-c0274d81c038","Type":"ContainerStarted","Data":"907d63fd8e4ac3611454b1076e428cfa7c9fc91cfe27a9127e01b4ccbfef1c82"} Jul 14 10:00:35.520217 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.520201 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:00:35.520520 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.520501 2561 generic.go:356] "Generic (PLEG): container finished" podID="e83875eb-181b-474d-9c06-2a04e0db1ebb" containerID="6913573eff4cb7e8d61965f1561b9a9272519e06622a9c6d6288d294d1712935" exitCode=1 Jul 14 10:00:35.520599 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.520563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerStarted","Data":"67ba9a2d19892663f1fd20fce88aa725b99a6cb20283d0de812c8738f104411d"} Jul 14 10:00:35.520645 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.520610 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerStarted","Data":"e8bda56135207f1bd3c5e9c24284416f252988e1d0a9b114a921959c858e4dd8"} Jul 14 10:00:35.520684 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.520657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerDied","Data":"6913573eff4cb7e8d61965f1561b9a9272519e06622a9c6d6288d294d1712935"} Jul 14 10:00:35.520717 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.520691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerStarted","Data":"81396a5d876801876beb9620b2c4f1e9af04010edf772f8fc0c60fec2a855592"} Jul 14 10:00:35.521689 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.521666 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rfwhk" event={"ID":"d7d7750a-ed94-4fce-8684-53b69c2befba","Type":"ContainerStarted","Data":"7ea72a35fc9c405d142fe523e67565c5959dfca6ad5feff601dde970df59e16a"} Jul 14 10:00:35.523082 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.523061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95xnl" event={"ID":"0efce125-9bae-4e39-a903-e19620955a88","Type":"ContainerStarted","Data":"417cf2c736980be89e1a2f4c06685ea21e9d760c67c6b92e2e819ae6481ac3a6"} Jul 14 10:00:35.524385 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.524365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal" event={"ID":"48011e991b26b97b5ae0c1a3157566a6","Type":"ContainerStarted","Data":"ad75a91654d76e86bbb8c72b9bc1045ab626610d669800368d4bd308d1100868"} Jul 14 10:00:35.525713 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.525693 2561 generic.go:356] "Generic (PLEG): container finished" podID="dca51534-98f3-45a0-a191-f981cc9daa13" containerID="b3f25ba80d710c469caa062dfb2c60168bc9e43e2e1709847f9235094e75d8f6" exitCode=0 Jul 14 10:00:35.525788 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.525719 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" event={"ID":"dca51534-98f3-45a0-a191-f981cc9daa13","Type":"ContainerDied","Data":"b3f25ba80d710c469caa062dfb2c60168bc9e43e2e1709847f9235094e75d8f6"} Jul 14 10:00:35.545035 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.544944 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m67dp" podStartSLOduration=3.296814037 podStartE2EDuration="23.544931553s" totalImagesPullingTime="20.248117516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:35.531366923 +0000 UTC m=+23.628755125" watchObservedRunningTime="2026-07-14 10:00:35.544931553 +0000 UTC m=+23.642319758" Jul 14 10:00:35.545035 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.545021 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-82.ec2.internal" podStartSLOduration=22.545017347 podStartE2EDuration="22.545017347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:35.544420273 +0000 UTC m=+23.641808475" watchObservedRunningTime="2026-07-14 10:00:35.545017347 +0000 UTC m=+23.642405550" Jul 14 10:00:35.578983 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.578937 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2qd4v" podStartSLOduration=3.49392589 podStartE2EDuration="23.578919496s" totalImagesPullingTime="20.084993606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:35.578416974 +0000 UTC m=+23.675805178" watchObservedRunningTime="2026-07-14 10:00:35.578919496 +0000 UTC m=+23.676307697" Jul 14 10:00:35.595495 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.595440 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-95xnl" podStartSLOduration=3.240012454 podStartE2EDuration="23.595423729s" totalImagesPullingTime="20.355411275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:35.595399939 +0000 UTC m=+23.692788140" watchObservedRunningTime="2026-07-14 10:00:35.595423729 +0000 UTC m=+23.692811912" Jul 14 10:00:35.612367 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.612312 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rfwhk" podStartSLOduration=3.325064079 podStartE2EDuration="23.612296735s" totalImagesPullingTime="20.287232656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:35.612206979 +0000 UTC m=+23.709595180" watchObservedRunningTime="2026-07-14 10:00:35.612296735 +0000 UTC m=+23.709684933" Jul 14 10:00:35.628523 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:35.628480 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-47kxj" podStartSLOduration=3.36324093 podStartE2EDuration="23.62846488s" totalImagesPullingTime="20.26522395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:35.628131909 +0000 UTC m=+23.725520114" watchObservedRunningTime="2026-07-14 10:00:35.62846488 +0000 UTC m=+23.725853082" Jul 14 10:00:36.443175 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:36.443145 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:36.443331 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:36.443256 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:36.528564 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:36.528529 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h7gzv" event={"ID":"f6acd9a7-7ba5-4c47-a46f-cf983aceb58b","Type":"ContainerStarted","Data":"93dfa08e5bbc675feb775a4720d71768d6d8d4808eb20ec77975b77ff3438587"} Jul 14 10:00:36.531264 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:36.531240 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:00:36.531679 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:36.531656 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerStarted","Data":"fe77a84a34a71a3926dd76ff1acd12dfb86c269a581ec2e19b3d62caada5d551"} Jul 14 10:00:36.531743 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:36.531724 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerStarted","Data":"eb3824a84005ceb3e6362e7441fd00478a3eaca8f1914945f5f946dd66cde86b"} Jul 14 10:00:36.543779 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:36.543735 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h7gzv" podStartSLOduration=4.269931499 podStartE2EDuration="24.543721122s" totalImagesPullingTime="20.273789623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:36.543212967 +0000 UTC m=+24.640601168" watchObservedRunningTime="2026-07-14 10:00:36.543721122 +0000 UTC m=+24.641109323" Jul 14 10:00:36.870044 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:36.870017 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 10:00:37.401855 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:37.401734 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T10:00:36.870037397Z","UUID":"f1a886e8-bb30-4430-aa0d-d1b0a3164afb","Handler":null,"Name":"","Endpoint":""} Jul 14 10:00:37.403216 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:37.403194 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 10:00:37.403363 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:37.403236 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 10:00:37.443166 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:37.443128 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:37.443374 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:37.443260 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:37.443374 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:37.443318 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:37.443551 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:37.443437 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:37.536396 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:37.536356 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" event={"ID":"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3","Type":"ContainerStarted","Data":"afa958888bb7d4f8407c352e80a951038d52c0c921fe1e1cbcd7aa3a23aaeb02"} Jul 14 10:00:37.538601 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:37.538571 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" event={"ID":"fc6f6cfa993df0b5e88de23c598d0eff","Type":"ContainerStarted","Data":"4e6884e9ddbd0bc356ee1bb04318d61a7394ebd11a15474c5910aaa569f0f6dc"} Jul 14 10:00:37.554519 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:37.554462 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-82.ec2.internal" podStartSLOduration=24.554446527 podStartE2EDuration="24.554446527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:37.553727925 +0000 UTC m=+25.651116126" watchObservedRunningTime="2026-07-14 10:00:37.554446527 +0000 UTC m=+25.651834728" Jul 14 10:00:38.443178 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:38.443006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:38.443456 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:38.443294 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:38.544266 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:38.544235 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:00:38.544718 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:38.544566 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerStarted","Data":"4f00d2dea99c499becb85ad8ca44963defd2b70c92bb43a596924e560d0082cc"} Jul 14 10:00:39.272991 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:39.272954 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:39.273723 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:39.273700 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:39.443465 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:39.443434 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:39.443654 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:39.443575 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:39.443654 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:39.443629 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:39.443765 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:39.443737 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:39.549554 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:39.549520 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" event={"ID":"b3da3fb7-6be0-4a88-b0cb-5e94756ac2b3","Type":"ContainerStarted","Data":"3138f037b34afc65ac6bc0375c9946aea2a04db9cdbbca538e451ebace090c54"} Jul 14 10:00:39.550173 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:39.549691 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:39.550173 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:39.550162 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m67dp" Jul 14 10:00:39.567717 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:39.567658 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkfz4" podStartSLOduration=4.311643228 podStartE2EDuration="27.567643365s" totalImagesPullingTime="23.256000137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:39.567341262 +0000 UTC m=+27.664729470" watchObservedRunningTime="2026-07-14 10:00:39.567643365 +0000 UTC m=+27.665031595" Jul 14 10:00:40.443537 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:40.443487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:40.443725 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:40.443608 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:41.443351 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:41.443181 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:41.443946 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:41.443247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:41.443946 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:41.443425 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:41.443946 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:41.443522 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:41.556198 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:41.556118 2561 generic.go:356] "Generic (PLEG): container finished" podID="dca51534-98f3-45a0-a191-f981cc9daa13" containerID="98f8f00ca59b8c5e7021ac75f3b2dbf9865c67486b964d88092c1b875d05695f" exitCode=0 Jul 14 10:00:41.556354 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:41.556193 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" event={"ID":"dca51534-98f3-45a0-a191-f981cc9daa13","Type":"ContainerDied","Data":"98f8f00ca59b8c5e7021ac75f3b2dbf9865c67486b964d88092c1b875d05695f"} Jul 14 10:00:41.559833 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:41.559813 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:00:41.560220 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:41.560196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerStarted","Data":"17c015fef94a7f33f9d30a0f53b09464309ebfae597c6efb509e547c7345dd43"} Jul 14 10:00:41.560410 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:41.560393 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:41.560555 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:41.560540 2561 scope.go:117] "RemoveContainer" containerID="6913573eff4cb7e8d61965f1561b9a9272519e06622a9c6d6288d294d1712935" Jul 14 10:00:41.579546 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:41.579523 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:42.443930 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:42.443898 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:42.444424 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:42.443986 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:42.566231 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:42.566205 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:00:42.566510 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:42.566491 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" event={"ID":"e83875eb-181b-474d-9c06-2a04e0db1ebb","Type":"ContainerStarted","Data":"afcd2e8fdbac46e482904f8f236ac58e0140d9ca9eae602ddf47937caa215dd6"} Jul 14 10:00:42.566680 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:42.566658 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:42.566734 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:42.566717 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:42.583590 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:42.583550 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:00:42.595270 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:42.595222 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" podStartSLOduration=10.250138456 podStartE2EDuration="30.595208433s" totalImagesPullingTime="20.345069977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:00:42.593173372 +0000 UTC m=+30.690561573" watchObservedRunningTime="2026-07-14 10:00:42.595208433 +0000 UTC m=+30.692596634" Jul 14 10:00:43.019354 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:43.019261 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t64dj"] Jul 14 10:00:43.019519 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:43.019385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:43.019519 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:43.019479 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:43.025003 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:43.022788 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vx8xc"] Jul 14 10:00:43.025003 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:43.022981 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:43.025003 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:43.023123 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:43.025488 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:43.025468 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vngw5"] Jul 14 10:00:43.025612 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:43.025598 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:43.025758 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:43.025739 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:43.571064 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:43.571028 2561 generic.go:356] "Generic (PLEG): container finished" podID="dca51534-98f3-45a0-a191-f981cc9daa13" containerID="1e54483c49479340d0860338822842e32e479999b9155625a8705a23ddf74cae" exitCode=0 Jul 14 10:00:43.571460 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:43.571114 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" event={"ID":"dca51534-98f3-45a0-a191-f981cc9daa13","Type":"ContainerDied","Data":"1e54483c49479340d0860338822842e32e479999b9155625a8705a23ddf74cae"} Jul 14 10:00:44.443226 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:44.443002 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:44.443411 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:44.443033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:44.443411 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:44.443295 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:44.443411 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:44.443077 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:44.443567 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:44.443375 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:44.443567 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:44.443497 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:45.579341 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:45.579304 2561 generic.go:356] "Generic (PLEG): container finished" podID="dca51534-98f3-45a0-a191-f981cc9daa13" containerID="a783d83c09f32d304b46cad364a89189245dabe3e72848c1d165510b4f95c294" exitCode=0 Jul 14 10:00:45.579962 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:45.579375 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" event={"ID":"dca51534-98f3-45a0-a191-f981cc9daa13","Type":"ContainerDied","Data":"a783d83c09f32d304b46cad364a89189245dabe3e72848c1d165510b4f95c294"} Jul 14 10:00:46.100382 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:46.100337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:46.100566 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.100477 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:46.100566 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.100535 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret podName:3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea nodeName:}" failed. No retries permitted until 2026-07-14 10:01:18.100520321 +0000 UTC m=+66.197908501 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret") pod "global-pull-secret-syncer-t64dj" (UID: "3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea") : object "kube-system"/"original-pull-secret" not registered Jul 14 10:00:46.201411 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:46.201370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:46.201563 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.201486 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:46.201563 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.201544 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs podName:0e14bf74-373b-4b7d-a6a4-32b73e28a0d0 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:18.201525963 +0000 UTC m=+66.298914145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs") pod "network-metrics-daemon-vngw5" (UID: "0e14bf74-373b-4b7d-a6a4-32b73e28a0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 10:00:46.302199 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:46.302163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:46.302374 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.302311 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 10:00:46.302374 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.302334 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 10:00:46.302374 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.302344 2561 projected.go:196] Error preparing data for projected volume kube-api-access-p5f4f for pod openshift-network-diagnostics/network-check-target-vx8xc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:46.302461 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.302395 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f podName:45cd99fa-b233-4420-b004-9284aabcba1a nodeName:}" failed. No retries permitted until 2026-07-14 10:01:18.302381367 +0000 UTC m=+66.399769547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5f4f" (UniqueName: "kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f") pod "network-check-target-vx8xc" (UID: "45cd99fa-b233-4420-b004-9284aabcba1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 10:00:46.442747 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:46.442648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:46.442747 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:46.442689 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:46.442967 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:46.442649 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:46.442967 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.442774 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:46.442967 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.442866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:46.442967 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:46.442938 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:48.442587 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:48.442525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:48.442587 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:48.442567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:48.443116 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:48.442629 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:48.443116 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:48.442760 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vngw5" podUID="0e14bf74-373b-4b7d-a6a4-32b73e28a0d0" Jul 14 10:00:48.443116 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:48.442839 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t64dj" podUID="3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea" Jul 14 10:00:48.443116 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:48.442911 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx8xc" podUID="45cd99fa-b233-4420-b004-9284aabcba1a" Jul 14 10:00:49.115896 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.115866 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-82.ec2.internal" event="NodeReady" Jul 14 10:00:49.116090 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.116038 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 10:00:49.157004 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.156940 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fd5886fbf-f6257"] Jul 14 10:00:49.159498 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.159474 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-57rc5"] Jul 14 10:00:49.159604 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.159561 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.161200 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.161181 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822"] Jul 14 10:00:49.161331 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.161310 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.162098 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.162080 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 10:00:49.162650 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.162630 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zh9t2\"" Jul 14 10:00:49.162945 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.162927 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf"] Jul 14 10:00:49.163056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.162968 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 10:00:49.163056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.163030 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.163544 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.163525 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 10:00:49.164091 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.164072 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 10:00:49.164430 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.164413 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.164491 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.164433 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 10:00:49.164860 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.164841 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs"] Jul 14 10:00:49.165143 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.164979 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.165143 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.165087 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.165782 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.165532 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rvn9c\"" Jul 14 10:00:49.167010 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.166985 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75456cbc5d-9j95j"] Jul 14 10:00:49.168007 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.167108 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.169120 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.169642 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.169777 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.172443 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2qwl7\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.172659 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.175531 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.176300 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mj2k2\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.176460 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.176584 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.177134 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.177164 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.177292 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.177301 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.178129 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87"] Jul 14 10:00:49.178830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.178228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.180472 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.180155 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-4p7x6"] Jul 14 10:00:49.180472 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.180253 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:49.182716 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.182692 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.183926 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.183905 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dbz6h\"" Jul 14 10:00:49.185778 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.185758 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 10:00:49.186369 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.186348 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.186891 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.186844 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.187067 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.187042 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fpt26\"" Jul 14 10:00:49.187168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.187146 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 10:00:49.187920 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.187900 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 10:00:49.188195 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.187422 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 10:00:49.188446 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.187834 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.190287 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.188946 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.190287 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.187302 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 10:00:49.190287 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.189626 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ff27t\"" Jul 14 10:00:49.194292 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.194266 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-57rc5"] Jul 14 10:00:49.194387 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.194320 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822"] Jul 14 10:00:49.194387 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.194367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs"] Jul 14 10:00:49.195254 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.194442 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8zhsc"] Jul 14 10:00:49.195254 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.194441 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.199485 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.199468 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2cv9r\"" Jul 14 10:00:49.199625 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.199500 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 10:00:49.199704 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.199510 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.199855 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.199835 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.200054 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.200032 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 10:00:49.202461 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.202443 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds"] Jul 14 10:00:49.202612 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.202593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.204758 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.204738 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 10:00:49.205589 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.205570 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d25fg\"" Jul 14 10:00:49.205681 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.205591 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 10:00:49.205911 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.205892 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 10:00:49.207122 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.207102 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87"] Jul 14 10:00:49.207217 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.207185 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6"] Jul 14 10:00:49.207304 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.207289 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.209750 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.209733 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.209973 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.209956 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 10:00:49.210182 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.210165 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6lbgs\"" Jul 14 10:00:49.210317 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.210295 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.210584 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.210557 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 10:00:49.210830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.210789 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd5886fbf-f6257"] Jul 14 10:00:49.210925 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.210848 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2"] Jul 14 10:00:49.211362 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.211340 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6" Jul 14 10:00:49.214077 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.214057 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.214282 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.214261 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7"] Jul 14 10:00:49.214433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.214416 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.214926 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.214912 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hj2bd\"" Jul 14 10:00:49.215201 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.215181 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" Jul 14 10:00:49.216963 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.216945 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75456cbc5d-9j95j"] Jul 14 10:00:49.217054 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.216983 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-4p7x6"] Jul 14 10:00:49.217054 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.217006 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn"] Jul 14 10:00:49.217201 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.217173 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.217477 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.217456 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.217528 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.217494 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nmp6l\"" Jul 14 10:00:49.217577 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.217561 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 10:00:49.217854 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.217838 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.217934 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.217839 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 10:00:49.219282 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.219265 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x8bct"] Jul 14 10:00:49.219535 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.219355 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.220435 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.220415 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 14 10:00:49.221955 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.221936 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf"] Jul 14 10:00:49.222059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.221966 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds"] Jul 14 10:00:49.222059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.221987 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zhsc"] Jul 14 10:00:49.222059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222005 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2"] Jul 14 10:00:49.222059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222019 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x8bct"] Jul 14 10:00:49.222059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222037 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn"] Jul 14 10:00:49.222059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222042 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x8bct" Jul 14 10:00:49.222059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222059 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7"] Jul 14 10:00:49.222387 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222075 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6"] Jul 14 10:00:49.222387 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222250 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 14 10:00:49.222487 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222412 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 14 10:00:49.222905 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222874 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 14 10:00:49.222905 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.222890 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 14 10:00:49.224386 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.224369 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 10:00:49.224685 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.224667 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-26p75\"" Jul 14 10:00:49.224977 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.224960 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 10:00:49.225038 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.224996 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 10:00:49.326342 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326306 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/186f56af-a4b6-4c9c-a441-b07966fff28f-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.326509 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-hub\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.326509 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326380 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.326509 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326459 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-serving-cert\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.326509 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-installation-pull-secrets\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.326693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn744\" (UniqueName: \"kubernetes.io/projected/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-kube-api-access-dn744\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.326693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bedfb6fe-a253-4191-960b-325181dc222f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-r8cqf\" (UID: \"bedfb6fe-a253-4191-960b-325181dc222f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.326693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/904345be-f78b-4503-8bab-1c27c45f57c1-config-volume\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.326693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/904345be-f78b-4503-8bab-1c27c45f57c1-tmp-dir\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.326693 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7bbf\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-kube-api-access-v7bbf\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-image-registry-private-configuration\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bedfb6fe-a253-4191-960b-325181dc222f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-r8cqf\" (UID: \"bedfb6fe-a253-4191-960b-325181dc222f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326777 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-certificates\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xnb9\" (UniqueName: \"kubernetes.io/projected/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-kube-api-access-5xnb9\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-trusted-ca\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsjbp\" (UniqueName: \"kubernetes.io/projected/904345be-f78b-4503-8bab-1c27c45f57c1-kube-api-access-gsjbp\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmrs6\" (UniqueName: \"kubernetes.io/projected/f7b3142f-f86b-4b95-86e7-649c83e0704b-kube-api-access-qmrs6\") pod \"network-check-source-869dcfcdcd-w59l6\" (UID: \"f7b3142f-f86b-4b95-86e7-649c83e0704b\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326955 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-tmp\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.326997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jndhd\" (UniqueName: \"kubernetes.io/projected/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-kube-api-access-jndhd\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hl5m\" (UniqueName: \"kubernetes.io/projected/0cd01ca3-c784-4443-986a-007007226b0c-kube-api-access-7hl5m\") pod \"volume-data-source-validator-78495597f6-ktsxs\" (UID: \"0cd01ca3-c784-4443-986a-007007226b0c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs" Jul 14 10:00:49.327070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7ccf7777c5-7z6w7\" (UID: \"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327134 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kxw6\" (UniqueName: \"kubernetes.io/projected/498bbb4d-e731-46b0-a0cf-3649992e2ce6-kube-api-access-2kxw6\") pod \"service-ca-operator-7695fc6c8c-7czds\" (UID: \"498bbb4d-e731-46b0-a0cf-3649992e2ce6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327194 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-bound-sa-token\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrqjj\" (UniqueName: \"kubernetes.io/projected/bedfb6fe-a253-4191-960b-325181dc222f-kube-api-access-lrqjj\") pod \"kube-storage-version-migrator-operator-799cb7f958-r8cqf\" (UID: \"bedfb6fe-a253-4191-960b-325181dc222f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6nnp\" (UniqueName: \"kubernetes.io/projected/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-kube-api-access-q6nnp\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d62qc\" (UniqueName: \"kubernetes.io/projected/d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d-kube-api-access-d62qc\") pod \"klusterlet-addon-workmgr-7ccf7777c5-7z6w7\" (UID: \"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0931415-10d0-4e57-b02f-f5200ec5ac8a-cert\") pod \"ingress-canary-x8bct\" (UID: \"d0931415-10d0-4e57-b02f-f5200ec5ac8a\") " pod="openshift-ingress-canary/ingress-canary-x8bct" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klqz6\" (UniqueName: \"kubernetes.io/projected/186f56af-a4b6-4c9c-a441-b07966fff28f-kube-api-access-klqz6\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d-tmp\") pod \"klusterlet-addon-workmgr-7ccf7777c5-7z6w7\" (UID: \"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327523 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-default-certificate\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-trusted-ca\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.327786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327577 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8kvs\" (UniqueName: \"kubernetes.io/projected/0534641d-15e0-4b76-9fa1-fea5a403101a-kube-api-access-w8kvs\") pod \"managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2\" (UID: \"0534641d-15e0-4b76-9fa1-fea5a403101a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6967\" (UniqueName: \"kubernetes.io/projected/42efedaf-e494-4339-bdcd-a7a8730ab9ea-kube-api-access-j6967\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-ca-trust-extracted\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-snapshots\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-ca\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/498bbb4d-e731-46b0-a0cf-3649992e2ce6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7czds\" (UID: \"498bbb4d-e731-46b0-a0cf-3649992e2ce6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-serving-cert\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0534641d-15e0-4b76-9fa1-fea5a403101a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2\" (UID: \"0534641d-15e0-4b76-9fa1-fea5a403101a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/498bbb4d-e731-46b0-a0cf-3649992e2ce6-config\") pod \"service-ca-operator-7695fc6c8c-7czds\" (UID: \"498bbb4d-e731-46b0-a0cf-3649992e2ce6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327876 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-stats-auth\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-config\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.328474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.327995 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggr7w\" (UniqueName: \"kubernetes.io/projected/d0931415-10d0-4e57-b02f-f5200ec5ac8a-kube-api-access-ggr7w\") pod \"ingress-canary-x8bct\" (UID: \"d0931415-10d0-4e57-b02f-f5200ec5ac8a\") " pod="openshift-ingress-canary/ingress-canary-x8bct" Jul 14 10:00:49.340025 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.339986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m67dp_50f67e5c-fcc3-4a0b-ae24-73ead64751b0/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:49.428614 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmrs6\" (UniqueName: \"kubernetes.io/projected/f7b3142f-f86b-4b95-86e7-649c83e0704b-kube-api-access-qmrs6\") pod \"network-check-source-869dcfcdcd-w59l6\" (UID: \"f7b3142f-f86b-4b95-86e7-649c83e0704b\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6" Jul 14 10:00:49.428614 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:49.428614 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-tmp\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.428614 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.428614 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jndhd\" (UniqueName: \"kubernetes.io/projected/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-kube-api-access-jndhd\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428628 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hl5m\" (UniqueName: \"kubernetes.io/projected/0cd01ca3-c784-4443-986a-007007226b0c-kube-api-access-7hl5m\") pod \"volume-data-source-validator-78495597f6-ktsxs\" (UID: \"0cd01ca3-c784-4443-986a-007007226b0c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7ccf7777c5-7z6w7\" (UID: \"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428694 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kxw6\" (UniqueName: \"kubernetes.io/projected/498bbb4d-e731-46b0-a0cf-3649992e2ce6-kube-api-access-2kxw6\") pod \"service-ca-operator-7695fc6c8c-7czds\" (UID: \"498bbb4d-e731-46b0-a0cf-3649992e2ce6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-bound-sa-token\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrqjj\" (UniqueName: \"kubernetes.io/projected/bedfb6fe-a253-4191-960b-325181dc222f-kube-api-access-lrqjj\") pod \"kube-storage-version-migrator-operator-799cb7f958-r8cqf\" (UID: \"bedfb6fe-a253-4191-960b-325181dc222f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.428844 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m67dp_50f67e5c-fcc3-4a0b-ae24-73ead64751b0/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.429115 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.429188 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls podName:42efedaf-e494-4339-bdcd-a7a8730ab9ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:49.929167754 +0000 UTC m=+38.026555939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls") pod "cluster-samples-operator-65db858894-54l87" (UID: "42efedaf-e494-4339-bdcd-a7a8730ab9ea") : secret "samples-operator-tls" not found Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.429213 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:49.929195721 +0000 UTC m=+38.026583904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : configmap references non-existent config key: service-ca.crt Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6nnp\" (UniqueName: \"kubernetes.io/projected/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-kube-api-access-q6nnp\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d62qc\" (UniqueName: \"kubernetes.io/projected/d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d-kube-api-access-d62qc\") pod \"klusterlet-addon-workmgr-7ccf7777c5-7z6w7\" (UID: \"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.429305 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429302 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0931415-10d0-4e57-b02f-f5200ec5ac8a-cert\") pod \"ingress-canary-x8bct\" (UID: \"d0931415-10d0-4e57-b02f-f5200ec5ac8a\") " pod="openshift-ingress-canary/ingress-canary-x8bct" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klqz6\" (UniqueName: \"kubernetes.io/projected/186f56af-a4b6-4c9c-a441-b07966fff28f-kube-api-access-klqz6\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d-tmp\") pod \"klusterlet-addon-workmgr-7ccf7777c5-7z6w7\" (UID: \"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-default-certificate\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-trusted-ca\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8kvs\" (UniqueName: \"kubernetes.io/projected/0534641d-15e0-4b76-9fa1-fea5a403101a-kube-api-access-w8kvs\") pod \"managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2\" (UID: \"0534641d-15e0-4b76-9fa1-fea5a403101a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6967\" (UniqueName: \"kubernetes.io/projected/42efedaf-e494-4339-bdcd-a7a8730ab9ea-kube-api-access-j6967\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-ca-trust-extracted\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-snapshots\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-ca\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/498bbb4d-e731-46b0-a0cf-3649992e2ce6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7czds\" (UID: \"498bbb4d-e731-46b0-a0cf-3649992e2ce6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-serving-cert\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0534641d-15e0-4b76-9fa1-fea5a403101a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2\" (UID: \"0534641d-15e0-4b76-9fa1-fea5a403101a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429592 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/498bbb4d-e731-46b0-a0cf-3649992e2ce6-config\") pod \"service-ca-operator-7695fc6c8c-7czds\" (UID: \"498bbb4d-e731-46b0-a0cf-3649992e2ce6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-stats-auth\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.430168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-config\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggr7w\" (UniqueName: \"kubernetes.io/projected/d0931415-10d0-4e57-b02f-f5200ec5ac8a-kube-api-access-ggr7w\") pod \"ingress-canary-x8bct\" (UID: \"d0931415-10d0-4e57-b02f-f5200ec5ac8a\") " pod="openshift-ingress-canary/ingress-canary-x8bct" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/186f56af-a4b6-4c9c-a441-b07966fff28f-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-hub\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-serving-cert\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429829 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-installation-pull-secrets\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429890 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn744\" (UniqueName: \"kubernetes.io/projected/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-kube-api-access-dn744\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bedfb6fe-a253-4191-960b-325181dc222f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-r8cqf\" (UID: \"bedfb6fe-a253-4191-960b-325181dc222f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/904345be-f78b-4503-8bab-1c27c45f57c1-config-volume\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/904345be-f78b-4503-8bab-1c27c45f57c1-tmp-dir\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.429995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7bbf\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-kube-api-access-v7bbf\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.430948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-image-registry-private-configuration\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bedfb6fe-a253-4191-960b-325181dc222f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-r8cqf\" (UID: \"bedfb6fe-a253-4191-960b-325181dc222f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430088 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-certificates\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430148 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xnb9\" (UniqueName: \"kubernetes.io/projected/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-kube-api-access-5xnb9\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430171 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-trusted-ca\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430206 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-tmp\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsjbp\" (UniqueName: \"kubernetes.io/projected/904345be-f78b-4503-8bab-1c27c45f57c1-kube-api-access-gsjbp\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430330 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d-tmp\") pod \"klusterlet-addon-workmgr-7ccf7777c5-7z6w7\" (UID: \"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430441 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-snapshots\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.430821 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.431703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.431343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/498bbb4d-e731-46b0-a0cf-3649992e2ce6-config\") pod \"service-ca-operator-7695fc6c8c-7czds\" (UID: \"498bbb4d-e731-46b0-a0cf-3649992e2ce6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.432455 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.432072 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.432455 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.432382 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-trusted-ca\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.432557 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.432494 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-ca-trust-extracted\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.432607 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.432581 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:49.432658 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.432626 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 10:00:49.432658 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.432638 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd5886fbf-f6257: secret "image-registry-tls" not found Jul 14 10:00:49.432658 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.432640 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls podName:186f56af-a4b6-4c9c-a441-b07966fff28f nodeName:}" failed. No retries permitted until 2026-07-14 10:00:49.932623274 +0000 UTC m=+38.030011460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wj822" (UID: "186f56af-a4b6-4c9c-a441-b07966fff28f") : secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:49.432830 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.432683 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls podName:0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:49.932671 +0000 UTC m=+38.030059182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls") pod "image-registry-7fd5886fbf-f6257" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62") : secret "image-registry-tls" not found Jul 14 10:00:49.432964 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.432929 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/904345be-f78b-4503-8bab-1c27c45f57c1-tmp-dir\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.433098 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.432984 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:00:49.433098 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.433070 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls podName:904345be-f78b-4503-8bab-1c27c45f57c1 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:49.933052617 +0000 UTC m=+38.030440816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls") pod "dns-default-8zhsc" (UID: "904345be-f78b-4503-8bab-1c27c45f57c1") : secret "dns-default-metrics-tls" not found Jul 14 10:00:49.434509 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.433814 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/904345be-f78b-4503-8bab-1c27c45f57c1-config-volume\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.434509 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.433829 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/186f56af-a4b6-4c9c-a441-b07966fff28f-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.434681 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.434572 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-config\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.437837 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.435405 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0931415-10d0-4e57-b02f-f5200ec5ac8a-cert\") pod \"ingress-canary-x8bct\" (UID: \"d0931415-10d0-4e57-b02f-f5200ec5ac8a\") " pod="openshift-ingress-canary/ingress-canary-x8bct" Jul 14 10:00:49.437837 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.436223 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bedfb6fe-a253-4191-960b-325181dc222f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-r8cqf\" (UID: \"bedfb6fe-a253-4191-960b-325181dc222f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.437837 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.436634 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-image-registry-private-configuration\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.437837 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.436659 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-trusted-ca\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.437837 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.437293 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7ccf7777c5-7z6w7\" (UID: \"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.437837 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.437450 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0534641d-15e0-4b76-9fa1-fea5a403101a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2\" (UID: \"0534641d-15e0-4b76-9fa1-fea5a403101a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" Jul 14 10:00:49.437837 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.437511 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.437837 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.437748 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bedfb6fe-a253-4191-960b-325181dc222f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-r8cqf\" (UID: \"bedfb6fe-a253-4191-960b-325181dc222f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.438270 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.437927 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 10:00:49.438270 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.437976 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:49.937961073 +0000 UTC m=+38.035349253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : secret "router-metrics-certs-default" not found Jul 14 10:00:49.438270 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.437991 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-hub\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.438417 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.438269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-installation-pull-secrets\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.438509 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.438487 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-serving-cert\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.438613 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.438584 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-default-certificate\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.439638 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.438789 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-ca\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.439638 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.439096 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.441400 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.441337 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-certificates\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.442249 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.442222 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klqz6\" (UniqueName: \"kubernetes.io/projected/186f56af-a4b6-4c9c-a441-b07966fff28f-kube-api-access-klqz6\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.442674 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.442653 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrqjj\" (UniqueName: \"kubernetes.io/projected/bedfb6fe-a253-4191-960b-325181dc222f-kube-api-access-lrqjj\") pod \"kube-storage-version-migrator-operator-799cb7f958-r8cqf\" (UID: \"bedfb6fe-a253-4191-960b-325181dc222f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.443020 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.442706 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-stats-auth\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.443020 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.442893 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/498bbb4d-e731-46b0-a0cf-3649992e2ce6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7czds\" (UID: \"498bbb4d-e731-46b0-a0cf-3649992e2ce6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.443451 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.443429 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6967\" (UniqueName: \"kubernetes.io/projected/42efedaf-e494-4339-bdcd-a7a8730ab9ea-kube-api-access-j6967\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:49.445372 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.445349 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jndhd\" (UniqueName: \"kubernetes.io/projected/f55984f0-ca55-4b8e-96ce-eb5e9c7a826b-kube-api-access-jndhd\") pod \"cluster-proxy-proxy-agent-5f898856cb-d6vhn\" (UID: \"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.445542 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.445524 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn744\" (UniqueName: \"kubernetes.io/projected/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-kube-api-access-dn744\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.446154 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.446094 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d62qc\" (UniqueName: \"kubernetes.io/projected/d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d-kube-api-access-d62qc\") pod \"klusterlet-addon-workmgr-7ccf7777c5-7z6w7\" (UID: \"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.447611 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.447586 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggr7w\" (UniqueName: \"kubernetes.io/projected/d0931415-10d0-4e57-b02f-f5200ec5ac8a-kube-api-access-ggr7w\") pod \"ingress-canary-x8bct\" (UID: \"d0931415-10d0-4e57-b02f-f5200ec5ac8a\") " pod="openshift-ingress-canary/ingress-canary-x8bct" Jul 14 10:00:49.447708 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.447597 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmrs6\" (UniqueName: \"kubernetes.io/projected/f7b3142f-f86b-4b95-86e7-649c83e0704b-kube-api-access-qmrs6\") pod \"network-check-source-869dcfcdcd-w59l6\" (UID: \"f7b3142f-f86b-4b95-86e7-649c83e0704b\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6" Jul 14 10:00:49.447708 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.447630 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6nnp\" (UniqueName: \"kubernetes.io/projected/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-kube-api-access-q6nnp\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.448050 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.447999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7bbf\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-kube-api-access-v7bbf\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.448271 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.448228 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8kvs\" (UniqueName: \"kubernetes.io/projected/0534641d-15e0-4b76-9fa1-fea5a403101a-kube-api-access-w8kvs\") pod \"managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2\" (UID: \"0534641d-15e0-4b76-9fa1-fea5a403101a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" Jul 14 10:00:49.448432 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.448300 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kxw6\" (UniqueName: \"kubernetes.io/projected/498bbb4d-e731-46b0-a0cf-3649992e2ce6-kube-api-access-2kxw6\") pod \"service-ca-operator-7695fc6c8c-7czds\" (UID: \"498bbb4d-e731-46b0-a0cf-3649992e2ce6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.448846 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.448778 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xnb9\" (UniqueName: \"kubernetes.io/projected/2108d827-de3f-4d7d-ac89-c5a6b8895e5e-kube-api-access-5xnb9\") pod \"insights-operator-68d9dd94cf-57rc5\" (UID: \"2108d827-de3f-4d7d-ac89-c5a6b8895e5e\") " pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.448977 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.448873 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-bound-sa-token\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.449053 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.449024 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hl5m\" (UniqueName: \"kubernetes.io/projected/0cd01ca3-c784-4443-986a-007007226b0c-kube-api-access-7hl5m\") pod \"volume-data-source-validator-78495597f6-ktsxs\" (UID: \"0cd01ca3-c784-4443-986a-007007226b0c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs" Jul 14 10:00:49.450142 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.450121 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ef7c917-86a5-4f72-b6b5-8758e39ba40e-serving-cert\") pod \"console-operator-7866497494-4p7x6\" (UID: \"8ef7c917-86a5-4f72-b6b5-8758e39ba40e\") " pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.450447 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.450426 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsjbp\" (UniqueName: \"kubernetes.io/projected/904345be-f78b-4503-8bab-1c27c45f57c1-kube-api-access-gsjbp\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.493491 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.493446 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" Jul 14 10:00:49.501951 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.501921 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" Jul 14 10:00:49.517690 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.517533 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs" Jul 14 10:00:49.539706 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.539671 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:00:49.558157 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.557962 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" Jul 14 10:00:49.566277 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.566210 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6" Jul 14 10:00:49.586046 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.586016 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" Jul 14 10:00:49.594928 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.594657 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:00:49.604127 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.603354 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:00:49.614923 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.614636 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x8bct" Jul 14 10:00:49.727932 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.727811 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf"] Jul 14 10:00:49.738391 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.738317 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-57rc5"] Jul 14 10:00:49.738949 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:49.738887 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbedfb6fe_a253_4191_960b_325181dc222f.slice/crio-5f76db7db01f977d737809c29ed51fb3fd4a8a10020c173cb6dd632d273d200b WatchSource:0}: Error finding container 5f76db7db01f977d737809c29ed51fb3fd4a8a10020c173cb6dd632d273d200b: Status 404 returned error can't find the container with id 5f76db7db01f977d737809c29ed51fb3fd4a8a10020c173cb6dd632d273d200b Jul 14 10:00:49.763494 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:49.763442 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2108d827_de3f_4d7d_ac89_c5a6b8895e5e.slice/crio-b803ef44c16c141050cf4e4e198c3535edadfb20880a45da2f84e811523804f9 WatchSource:0}: Error finding container b803ef44c16c141050cf4e4e198c3535edadfb20880a45da2f84e811523804f9: Status 404 returned error can't find the container with id b803ef44c16c141050cf4e4e198c3535edadfb20880a45da2f84e811523804f9 Jul 14 10:00:49.793603 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.790454 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs"] Jul 14 10:00:49.798508 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.798432 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-4p7x6"] Jul 14 10:00:49.803679 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:49.803624 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd01ca3_c784_4443_986a_007007226b0c.slice/crio-88d1682a849a9a8d6bcf0843e9488a6ed295788edccf4caddabe49742dab4013 WatchSource:0}: Error finding container 88d1682a849a9a8d6bcf0843e9488a6ed295788edccf4caddabe49742dab4013: Status 404 returned error can't find the container with id 88d1682a849a9a8d6bcf0843e9488a6ed295788edccf4caddabe49742dab4013 Jul 14 10:00:49.868866 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.868836 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds"] Jul 14 10:00:49.873572 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:49.873523 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498bbb4d_e731_46b0_a0cf_3649992e2ce6.slice/crio-543b5514d33881868ed7959552c8c67bf2579d455376d0fe0b2258f7a1dfb77f WatchSource:0}: Error finding container 543b5514d33881868ed7959552c8c67bf2579d455376d0fe0b2258f7a1dfb77f: Status 404 returned error can't find the container with id 543b5514d33881868ed7959552c8c67bf2579d455376d0fe0b2258f7a1dfb77f Jul 14 10:00:49.902366 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.901944 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6"] Jul 14 10:00:49.906098 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:49.906063 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b3142f_f86b_4b95_86e7_649c83e0704b.slice/crio-74235298031d3f33af6d743504f6edb2e227d1cae4aacdffc75b15d22dc760ac WatchSource:0}: Error finding container 74235298031d3f33af6d743504f6edb2e227d1cae4aacdffc75b15d22dc760ac: Status 404 returned error can't find the container with id 74235298031d3f33af6d743504f6edb2e227d1cae4aacdffc75b15d22dc760ac Jul 14 10:00:49.935227 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.935194 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7"] Jul 14 10:00:49.935396 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.935285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:49.935396 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.935332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:49.935396 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.935367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:49.935527 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.935486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:49.935662 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.935532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:49.935662 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935650 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:49.935730 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935696 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls podName:186f56af-a4b6-4c9c-a441-b07966fff28f nodeName:}" failed. No retries permitted until 2026-07-14 10:00:50.935683629 +0000 UTC m=+39.033071822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wj822" (UID: "186f56af-a4b6-4c9c-a441-b07966fff28f") : secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:49.935772 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935738 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 10:00:49.935772 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935760 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls podName:42efedaf-e494-4339-bdcd-a7a8730ab9ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:50.935753547 +0000 UTC m=+39.033141726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls") pod "cluster-samples-operator-65db858894-54l87" (UID: "42efedaf-e494-4339-bdcd-a7a8730ab9ea") : secret "samples-operator-tls" not found Jul 14 10:00:49.935880 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935794 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:00:49.935880 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935840 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls podName:904345be-f78b-4503-8bab-1c27c45f57c1 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:50.935833089 +0000 UTC m=+39.033221269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls") pod "dns-default-8zhsc" (UID: "904345be-f78b-4503-8bab-1c27c45f57c1") : secret "dns-default-metrics-tls" not found Jul 14 10:00:49.935939 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935922 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:50.935915756 +0000 UTC m=+39.033303949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : configmap references non-existent config key: service-ca.crt Jul 14 10:00:49.935985 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935970 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 10:00:49.935985 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935977 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd5886fbf-f6257: secret "image-registry-tls" not found Jul 14 10:00:49.936062 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:49.935996 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls podName:0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:50.935990046 +0000 UTC m=+39.033378241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls") pod "image-registry-7fd5886fbf-f6257" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62") : secret "image-registry-tls" not found Jul 14 10:00:49.939187 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:49.939121 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d5c923_a6a1_4fc4_94fd_f41e33c48a9d.slice/crio-16261c76b4d3694a50c1f1dae5889d5d404a507aa0114b9de8c95cb441cd44b1 WatchSource:0}: Error finding container 16261c76b4d3694a50c1f1dae5889d5d404a507aa0114b9de8c95cb441cd44b1: Status 404 returned error can't find the container with id 16261c76b4d3694a50c1f1dae5889d5d404a507aa0114b9de8c95cb441cd44b1 Jul 14 10:00:49.939753 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.939722 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x8bct"] Jul 14 10:00:49.948437 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.948409 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2"] Jul 14 10:00:49.952585 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:49.952561 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0534641d_15e0_4b76_9fa1_fea5a403101a.slice/crio-78232b29a92ea895920c95935cf0f27000961e897a07565a3c5d650ae85d29d0 WatchSource:0}: Error finding container 78232b29a92ea895920c95935cf0f27000961e897a07565a3c5d650ae85d29d0: Status 404 returned error can't find the container with id 78232b29a92ea895920c95935cf0f27000961e897a07565a3c5d650ae85d29d0 Jul 14 10:00:49.970518 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:49.970492 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn"] Jul 14 10:00:49.973973 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:00:49.973939 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf55984f0_ca55_4b8e_96ce_eb5e9c7a826b.slice/crio-03d0ab50845c6bca3ef3c9a6a7115ab407bf9dfc4d00718de1a31708193f883c WatchSource:0}: Error finding container 03d0ab50845c6bca3ef3c9a6a7115ab407bf9dfc4d00718de1a31708193f883c: Status 404 returned error can't find the container with id 03d0ab50845c6bca3ef3c9a6a7115ab407bf9dfc4d00718de1a31708193f883c Jul 14 10:00:50.036942 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.036906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:50.037110 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.037079 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 10:00:50.037167 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.037151 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:51.037132648 +0000 UTC m=+39.134520832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : secret "router-metrics-certs-default" not found Jul 14 10:00:50.448470 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.448440 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:00:50.448979 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.448831 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:00:50.449201 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.449186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:00:50.451925 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.451902 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 10:00:50.453990 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.453325 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pz2v6\"" Jul 14 10:00:50.453990 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.453566 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 10:00:50.453990 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.453754 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vm2xk\"" Jul 14 10:00:50.607921 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.607835 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" event={"ID":"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d","Type":"ContainerStarted","Data":"16261c76b4d3694a50c1f1dae5889d5d404a507aa0114b9de8c95cb441cd44b1"} Jul 14 10:00:50.609323 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.609269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs" event={"ID":"0cd01ca3-c784-4443-986a-007007226b0c","Type":"ContainerStarted","Data":"88d1682a849a9a8d6bcf0843e9488a6ed295788edccf4caddabe49742dab4013"} Jul 14 10:00:50.610613 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.610566 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x8bct" event={"ID":"d0931415-10d0-4e57-b02f-f5200ec5ac8a","Type":"ContainerStarted","Data":"22bcb11a005ea1691b07bac5359f154383a78d6f14faeeeea6d55e9ff84bcf2f"} Jul 14 10:00:50.612058 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.612031 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4p7x6" event={"ID":"8ef7c917-86a5-4f72-b6b5-8758e39ba40e","Type":"ContainerStarted","Data":"f3b77f1bb44fe1504614b62d1ae94b55c908a4b3201ab348e06dfbfe6957c348"} Jul 14 10:00:50.613298 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.613276 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" event={"ID":"2108d827-de3f-4d7d-ac89-c5a6b8895e5e","Type":"ContainerStarted","Data":"b803ef44c16c141050cf4e4e198c3535edadfb20880a45da2f84e811523804f9"} Jul 14 10:00:50.614741 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.614717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" event={"ID":"0534641d-15e0-4b76-9fa1-fea5a403101a","Type":"ContainerStarted","Data":"78232b29a92ea895920c95935cf0f27000961e897a07565a3c5d650ae85d29d0"} Jul 14 10:00:50.616008 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.615987 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6" event={"ID":"f7b3142f-f86b-4b95-86e7-649c83e0704b","Type":"ContainerStarted","Data":"74235298031d3f33af6d743504f6edb2e227d1cae4aacdffc75b15d22dc760ac"} Jul 14 10:00:50.617088 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.617063 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" event={"ID":"498bbb4d-e731-46b0-a0cf-3649992e2ce6","Type":"ContainerStarted","Data":"543b5514d33881868ed7959552c8c67bf2579d455376d0fe0b2258f7a1dfb77f"} Jul 14 10:00:50.618592 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.618539 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" event={"ID":"bedfb6fe-a253-4191-960b-325181dc222f","Type":"ContainerStarted","Data":"5f76db7db01f977d737809c29ed51fb3fd4a8a10020c173cb6dd632d273d200b"} Jul 14 10:00:50.620054 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.620003 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" event={"ID":"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b","Type":"ContainerStarted","Data":"03d0ab50845c6bca3ef3c9a6a7115ab407bf9dfc4d00718de1a31708193f883c"} Jul 14 10:00:50.923731 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.923697 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m67dp_50f67e5c-fcc3-4a0b-ae24-73ead64751b0/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:50.947425 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.947386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:50.947594 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.947462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:50.947594 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.947512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:50.947594 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.947542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:50.947594 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:50.947568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:50.947788 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.947753 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:52.947732587 +0000 UTC m=+41.045120787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : configmap references non-existent config key: service-ca.crt Jul 14 10:00:50.948247 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.948225 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 10:00:50.948247 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.948249 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd5886fbf-f6257: secret "image-registry-tls" not found Jul 14 10:00:50.948404 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.948294 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls podName:0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:52.948279187 +0000 UTC m=+41.045667367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls") pod "image-registry-7fd5886fbf-f6257" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62") : secret "image-registry-tls" not found Jul 14 10:00:50.948404 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.948356 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:50.948404 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.948397 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls podName:186f56af-a4b6-4c9c-a441-b07966fff28f nodeName:}" failed. No retries permitted until 2026-07-14 10:00:52.948383322 +0000 UTC m=+41.045771505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wj822" (UID: "186f56af-a4b6-4c9c-a441-b07966fff28f") : secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:50.948572 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.948457 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 10:00:50.948572 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.948489 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls podName:42efedaf-e494-4339-bdcd-a7a8730ab9ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:52.948479202 +0000 UTC m=+41.045867382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls") pod "cluster-samples-operator-65db858894-54l87" (UID: "42efedaf-e494-4339-bdcd-a7a8730ab9ea") : secret "samples-operator-tls" not found Jul 14 10:00:50.948572 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.948546 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:00:50.948716 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:50.948576 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls podName:904345be-f78b-4503-8bab-1c27c45f57c1 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:52.948564671 +0000 UTC m=+41.045952856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls") pod "dns-default-8zhsc" (UID: "904345be-f78b-4503-8bab-1c27c45f57c1") : secret "dns-default-metrics-tls" not found Jul 14 10:00:51.027768 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:51.027730 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m67dp_50f67e5c-fcc3-4a0b-ae24-73ead64751b0/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:51.048459 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:51.048421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:51.048673 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:51.048656 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 10:00:51.048735 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:51.048723 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:53.048705203 +0000 UTC m=+41.146093402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : secret "router-metrics-certs-default" not found Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:52.968478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:52.968962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:52.969025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:52.969059 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:52.969094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.969371 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:56.969295098 +0000 UTC m=+45.066683283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : configmap references non-existent config key: service-ca.crt Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.969658 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.969676 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd5886fbf-f6257: secret "image-registry-tls" not found Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.969717 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls podName:0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:56.969702979 +0000 UTC m=+45.067091166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls") pod "image-registry-7fd5886fbf-f6257" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62") : secret "image-registry-tls" not found Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.969777 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.969830 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls podName:186f56af-a4b6-4c9c-a441-b07966fff28f nodeName:}" failed. No retries permitted until 2026-07-14 10:00:56.969816698 +0000 UTC m=+45.067204878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wj822" (UID: "186f56af-a4b6-4c9c-a441-b07966fff28f") : secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.969888 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.969918 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls podName:42efedaf-e494-4339-bdcd-a7a8730ab9ea nodeName:}" failed. No retries permitted until 2026-07-14 10:00:56.969908355 +0000 UTC m=+45.067296540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls") pod "cluster-samples-operator-65db858894-54l87" (UID: "42efedaf-e494-4339-bdcd-a7a8730ab9ea") : secret "samples-operator-tls" not found Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.969989 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:00:52.970439 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:52.970020 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls podName:904345be-f78b-4503-8bab-1c27c45f57c1 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:56.97001017 +0000 UTC m=+45.067398353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls") pod "dns-default-8zhsc" (UID: "904345be-f78b-4503-8bab-1c27c45f57c1") : secret "dns-default-metrics-tls" not found Jul 14 10:00:53.070537 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:53.070457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:53.070781 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:53.070761 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 10:00:53.070897 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:53.070853 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:00:57.070832184 +0000 UTC m=+45.168220378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : secret "router-metrics-certs-default" not found Jul 14 10:00:53.461260 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:53.461191 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m67dp_50f67e5c-fcc3-4a0b-ae24-73ead64751b0/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:53.838515 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:53.838447 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m67dp_50f67e5c-fcc3-4a0b-ae24-73ead64751b0/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:53.938033 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:53.937980 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m67dp_50f67e5c-fcc3-4a0b-ae24-73ead64751b0/konnectivity-agent/0.log" limit=1024 Jul 14 10:00:57.013740 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:57.013695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:57.013759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:57.013794 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.013886 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:57.013929 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.013930 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.013975 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls podName:42efedaf-e494-4339-bdcd-a7a8730ab9ea nodeName:}" failed. No retries permitted until 2026-07-14 10:01:05.013957793 +0000 UTC m=+53.111345974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls") pod "cluster-samples-operator-65db858894-54l87" (UID: "42efedaf-e494-4339-bdcd-a7a8730ab9ea") : secret "samples-operator-tls" not found Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.014018 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls podName:904345be-f78b-4503-8bab-1c27c45f57c1 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:05.014000523 +0000 UTC m=+53.111388704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls") pod "dns-default-8zhsc" (UID: "904345be-f78b-4503-8bab-1c27c45f57c1") : secret "dns-default-metrics-tls" not found Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.014022 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.014041 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd5886fbf-f6257: secret "image-registry-tls" not found Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.014062 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:05.014043923 +0000 UTC m=+53.111432104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : configmap references non-existent config key: service-ca.crt Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:57.014039 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.014107 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.014109 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls podName:0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:05.014093353 +0000 UTC m=+53.111481533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls") pod "image-registry-7fd5886fbf-f6257" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62") : secret "image-registry-tls" not found Jul 14 10:00:57.014189 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.014160 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls podName:186f56af-a4b6-4c9c-a441-b07966fff28f nodeName:}" failed. No retries permitted until 2026-07-14 10:01:05.014146988 +0000 UTC m=+53.111535171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wj822" (UID: "186f56af-a4b6-4c9c-a441-b07966fff28f") : secret "cluster-monitoring-operator-tls" not found Jul 14 10:00:57.115526 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:00:57.115481 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:00:57.115671 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.115622 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 10:00:57.115724 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:00:57.115689 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:05.115672956 +0000 UTC m=+53.213061158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : secret "router-metrics-certs-default" not found Jul 14 10:01:05.091739 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.091702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:01:05.092239 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.091779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:01:05.092239 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.091850 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:01:05.092239 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.091883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:01:05.092239 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.091913 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:05.092239 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092110 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:21.092091339 +0000 UTC m=+69.189479525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : configmap references non-existent config key: service-ca.crt Jul 14 10:01:05.092576 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092542 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 10:01:05.092576 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092556 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd5886fbf-f6257: secret "image-registry-tls" not found Jul 14 10:01:05.092674 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092595 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls podName:0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:21.092581668 +0000 UTC m=+69.189969857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls") pod "image-registry-7fd5886fbf-f6257" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62") : secret "image-registry-tls" not found Jul 14 10:01:05.092674 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092654 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 10:01:05.092778 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092684 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls podName:186f56af-a4b6-4c9c-a441-b07966fff28f nodeName:}" failed. No retries permitted until 2026-07-14 10:01:21.092674812 +0000 UTC m=+69.190062997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wj822" (UID: "186f56af-a4b6-4c9c-a441-b07966fff28f") : secret "cluster-monitoring-operator-tls" not found Jul 14 10:01:05.092778 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092738 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 10:01:05.092778 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092765 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls podName:42efedaf-e494-4339-bdcd-a7a8730ab9ea nodeName:}" failed. No retries permitted until 2026-07-14 10:01:21.092756098 +0000 UTC m=+69.190144284 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls") pod "cluster-samples-operator-65db858894-54l87" (UID: "42efedaf-e494-4339-bdcd-a7a8730ab9ea") : secret "samples-operator-tls" not found Jul 14 10:01:05.093284 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092894 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 10:01:05.093284 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.092924 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls podName:904345be-f78b-4503-8bab-1c27c45f57c1 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:21.092914803 +0000 UTC m=+69.190302988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls") pod "dns-default-8zhsc" (UID: "904345be-f78b-4503-8bab-1c27c45f57c1") : secret "dns-default-metrics-tls" not found Jul 14 10:01:05.193249 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.192595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:05.193249 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.192828 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 10:01:05.193249 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:05.192889 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs podName:d76890f3-a4e2-42ac-a7ed-2a8de69b57c2 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:21.19287129 +0000 UTC m=+69.290259473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs") pod "router-default-75456cbc5d-9j95j" (UID: "d76890f3-a4e2-42ac-a7ed-2a8de69b57c2") : secret "router-metrics-certs-default" not found Jul 14 10:01:05.673143 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.672623 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x8bct" event={"ID":"d0931415-10d0-4e57-b02f-f5200ec5ac8a","Type":"ContainerStarted","Data":"e2eee7462088a3bdcaac8df4bc2f0b144ab2cab336d7f64ad225012c0385dd8b"} Jul 14 10:01:05.674439 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.674417 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/0.log" Jul 14 10:01:05.674565 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.674462 2561 generic.go:356] "Generic (PLEG): container finished" podID="8ef7c917-86a5-4f72-b6b5-8758e39ba40e" containerID="07763c8adbfb2ae59a9116b8c0b3a654ba4e53be48369ed1e0de5b205bf9ee6a" exitCode=255 Jul 14 10:01:05.674565 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.674541 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4p7x6" event={"ID":"8ef7c917-86a5-4f72-b6b5-8758e39ba40e","Type":"ContainerDied","Data":"07763c8adbfb2ae59a9116b8c0b3a654ba4e53be48369ed1e0de5b205bf9ee6a"} Jul 14 10:01:05.674794 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.674773 2561 scope.go:117] "RemoveContainer" containerID="07763c8adbfb2ae59a9116b8c0b3a654ba4e53be48369ed1e0de5b205bf9ee6a" Jul 14 10:01:05.676509 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.676486 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" event={"ID":"2108d827-de3f-4d7d-ac89-c5a6b8895e5e","Type":"ContainerStarted","Data":"69a1965136027eb00d7e34345f3538303a414aa76d8f1b199443c0e24b3bed38"} Jul 14 10:01:05.679735 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.679710 2561 generic.go:356] "Generic (PLEG): container finished" podID="dca51534-98f3-45a0-a191-f981cc9daa13" containerID="41d8157cf78ee54c6074328477c84e6f23fac15e04d400c09215c0c3f4a2ff43" exitCode=0 Jul 14 10:01:05.679872 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.679781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" event={"ID":"dca51534-98f3-45a0-a191-f981cc9daa13","Type":"ContainerDied","Data":"41d8157cf78ee54c6074328477c84e6f23fac15e04d400c09215c0c3f4a2ff43"} Jul 14 10:01:05.681340 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.681310 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" event={"ID":"0534641d-15e0-4b76-9fa1-fea5a403101a","Type":"ContainerStarted","Data":"5e81f7e19f88c281116e60bdf6b423427736b5c95ba930ab076a3c4456b9e9dc"} Jul 14 10:01:05.682977 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.682954 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6" event={"ID":"f7b3142f-f86b-4b95-86e7-649c83e0704b","Type":"ContainerStarted","Data":"6f4f5508ba22acc3e00bb9a3de70c74559fc1cf6970eca2028bd2b9e0849cd03"} Jul 14 10:01:05.684847 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.684779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" event={"ID":"498bbb4d-e731-46b0-a0cf-3649992e2ce6","Type":"ContainerStarted","Data":"77e6ae3eb8603273a3a92de575409a2b148fcd15458aea59c2b55235000936c5"} Jul 14 10:01:05.686419 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.686398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" event={"ID":"bedfb6fe-a253-4191-960b-325181dc222f","Type":"ContainerStarted","Data":"86e80d85e9b24c74c59cbb3e62f242de330e355c943baf57ca5a006698b84a0d"} Jul 14 10:01:05.689959 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.689935 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" event={"ID":"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b","Type":"ContainerStarted","Data":"856c8942dbf4a4bb55ebbd820ff6a9cfb1ca6c16c9f4bc3fb44067d9949a8d2c"} Jul 14 10:01:05.690058 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.689973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" event={"ID":"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b","Type":"ContainerStarted","Data":"feec4dfb9430d6af96e13398bf571cd2b651d3509baab7521162781a0dbf7467"} Jul 14 10:01:05.690058 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.689990 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" event={"ID":"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b","Type":"ContainerStarted","Data":"470140a2ba0fa205eb9c87a84b11deb623154e3ca340332bba938e7017c8c57c"} Jul 14 10:01:05.690058 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.689975 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x8bct" podStartSLOduration=2.184474526 podStartE2EDuration="16.689961085s" totalImagesPullingTime="14.505486559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:05.688153182 +0000 UTC m=+53.785541385" watchObservedRunningTime="2026-07-14 10:01:05.689961085 +0000 UTC m=+53.787349265" Jul 14 10:01:05.691541 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.691507 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" event={"ID":"d3d5c923-a6a1-4fc4-94fd-f41e33c48a9d","Type":"ContainerStarted","Data":"504816bfc586716f3f2c0e6e5a0d559899caa93dcc3a22e46052f99cb00ab67f"} Jul 14 10:01:05.693044 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.693021 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs" event={"ID":"0cd01ca3-c784-4443-986a-007007226b0c","Type":"ContainerStarted","Data":"39b29335f124be1fe529d0b48c6c4584ffdc7b3d67cc27137566d818febd1072"} Jul 14 10:01:05.749989 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.749874 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" podStartSLOduration=16.078670287 podStartE2EDuration="29.749847853s" totalImagesPullingTime="13.671177566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:05.724572295 +0000 UTC m=+53.821960500" watchObservedRunningTime="2026-07-14 10:01:05.749847853 +0000 UTC m=+53.847236055" Jul 14 10:01:05.753484 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.753052 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8f9dc84bd-cxcv2" podStartSLOduration=14.154932932 podStartE2EDuration="28.753027551s" totalImagesPullingTime="14.598094619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:05.750314907 +0000 UTC m=+53.847703110" watchObservedRunningTime="2026-07-14 10:01:05.753027551 +0000 UTC m=+53.850415753" Jul 14 10:01:05.803886 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.803787 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w59l6" podStartSLOduration=15.172162416 podStartE2EDuration="29.80376668s" totalImagesPullingTime="14.631604264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:05.802710331 +0000 UTC m=+53.900098570" watchObservedRunningTime="2026-07-14 10:01:05.80376668 +0000 UTC m=+53.901154884" Jul 14 10:01:05.822517 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.822419 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" podStartSLOduration=15.067287954 podStartE2EDuration="29.822401903s" totalImagesPullingTime="14.755113949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:05.821468494 +0000 UTC m=+53.918856698" watchObservedRunningTime="2026-07-14 10:01:05.822401903 +0000 UTC m=+53.919790105" Jul 14 10:01:05.840531 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.840473 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" podStartSLOduration=14.241257571 podStartE2EDuration="28.840449252s" totalImagesPullingTime="14.599191681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:05.838851083 +0000 UTC m=+53.936239286" watchObservedRunningTime="2026-07-14 10:01:05.840449252 +0000 UTC m=+53.937837454" Jul 14 10:01:05.876512 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.876430 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ktsxs" podStartSLOduration=15.284291707 podStartE2EDuration="29.87640882s" totalImagesPullingTime="14.592117113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:05.85685596 +0000 UTC m=+53.954244162" watchObservedRunningTime="2026-07-14 10:01:05.87640882 +0000 UTC m=+53.973797025" Jul 14 10:01:05.877161 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.877121 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" podStartSLOduration=15.077045979 podStartE2EDuration="29.877087794s" totalImagesPullingTime="14.800041815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:05.874760005 +0000 UTC m=+53.972148207" watchObservedRunningTime="2026-07-14 10:01:05.877087794 +0000 UTC m=+53.974475996" Jul 14 10:01:05.897158 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:05.894559 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" podStartSLOduration=14.33088652 podStartE2EDuration="28.894535869s" totalImagesPullingTime="14.563649349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:05.893603338 +0000 UTC m=+53.990991553" watchObservedRunningTime="2026-07-14 10:01:05.894535869 +0000 UTC m=+53.991924074" Jul 14 10:01:06.468846 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.468789 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fcqjf"] Jul 14 10:01:06.485631 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.485588 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fcqjf"] Jul 14 10:01:06.485834 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.485712 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.488319 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.488298 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 10:01:06.488437 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.488372 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-szrgf\"" Jul 14 10:01:06.488437 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.488381 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 10:01:06.610253 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.610212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9155d2e1-cddd-47df-8b37-7f461a19f8c8-crio-socket\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.610429 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.610343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9155d2e1-cddd-47df-8b37-7f461a19f8c8-data-volume\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.610490 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.610423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.610564 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.610483 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdghd\" (UniqueName: \"kubernetes.io/projected/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-api-access-kdghd\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.610564 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.610510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.699180 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.699150 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:01:06.699576 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.699559 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/0.log" Jul 14 10:01:06.699678 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.699599 2561 generic.go:356] "Generic (PLEG): container finished" podID="8ef7c917-86a5-4f72-b6b5-8758e39ba40e" containerID="16f22f863bd166d885561e8400cd3e6c3723081df4ecd9c716c1e0c66015871d" exitCode=255 Jul 14 10:01:06.699729 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.699686 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4p7x6" event={"ID":"8ef7c917-86a5-4f72-b6b5-8758e39ba40e","Type":"ContainerDied","Data":"16f22f863bd166d885561e8400cd3e6c3723081df4ecd9c716c1e0c66015871d"} Jul 14 10:01:06.699779 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.699744 2561 scope.go:117] "RemoveContainer" containerID="07763c8adbfb2ae59a9116b8c0b3a654ba4e53be48369ed1e0de5b205bf9ee6a" Jul 14 10:01:06.699944 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.699926 2561 scope.go:117] "RemoveContainer" containerID="16f22f863bd166d885561e8400cd3e6c3723081df4ecd9c716c1e0c66015871d" Jul 14 10:01:06.700162 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:06.700135 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4p7x6_openshift-console-operator(8ef7c917-86a5-4f72-b6b5-8758e39ba40e)\"" pod="openshift-console-operator/console-operator-7866497494-4p7x6" podUID="8ef7c917-86a5-4f72-b6b5-8758e39ba40e" Jul 14 10:01:06.702939 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.702917 2561 generic.go:356] "Generic (PLEG): container finished" podID="dca51534-98f3-45a0-a191-f981cc9daa13" containerID="c14a51b8df7d2fadcb2d4b186ed755b051dfed9c7a616f5f2e79b77440e2d3b2" exitCode=0 Jul 14 10:01:06.703046 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.703000 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" event={"ID":"dca51534-98f3-45a0-a191-f981cc9daa13","Type":"ContainerDied","Data":"c14a51b8df7d2fadcb2d4b186ed755b051dfed9c7a616f5f2e79b77440e2d3b2"} Jul 14 10:01:06.703911 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.703889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:01:06.705736 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.705719 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ccf7777c5-7z6w7" Jul 14 10:01:06.711545 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.711516 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdghd\" (UniqueName: \"kubernetes.io/projected/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-api-access-kdghd\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.711652 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.711552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.711652 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:06.711636 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:06.711762 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:06.711694 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:07.211675063 +0000 UTC m=+55.309063257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : configmap "kube-rbac-proxy" not found Jul 14 10:01:06.711762 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.711752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9155d2e1-cddd-47df-8b37-7f461a19f8c8-crio-socket\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.711904 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.711859 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9155d2e1-cddd-47df-8b37-7f461a19f8c8-crio-socket\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.711904 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.711872 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9155d2e1-cddd-47df-8b37-7f461a19f8c8-data-volume\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.712002 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.711941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.712075 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:06.712060 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:06.712131 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.712105 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9155d2e1-cddd-47df-8b37-7f461a19f8c8-data-volume\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:06.712131 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:06.712111 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:07.212097334 +0000 UTC m=+55.309485518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:06.725398 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:06.725371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdghd\" (UniqueName: \"kubernetes.io/projected/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-api-access-kdghd\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:07.217311 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:07.217278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:07.217485 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:07.217322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:07.217485 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:07.217434 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:07.217610 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:07.217487 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:07.217610 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:07.217501 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:08.217486041 +0000 UTC m=+56.314874222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:07.217610 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:07.217556 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:08.21754047 +0000 UTC m=+56.314928654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : configmap "kube-rbac-proxy" not found Jul 14 10:01:07.708030 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:07.707994 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:01:07.708469 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:07.708401 2561 scope.go:117] "RemoveContainer" containerID="16f22f863bd166d885561e8400cd3e6c3723081df4ecd9c716c1e0c66015871d" Jul 14 10:01:07.708585 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:07.708557 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4p7x6_openshift-console-operator(8ef7c917-86a5-4f72-b6b5-8758e39ba40e)\"" pod="openshift-console-operator/console-operator-7866497494-4p7x6" podUID="8ef7c917-86a5-4f72-b6b5-8758e39ba40e" Jul 14 10:01:07.711229 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:07.711207 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" event={"ID":"dca51534-98f3-45a0-a191-f981cc9daa13","Type":"ContainerStarted","Data":"05ccb6af901d899fb256cd110380d17d439c286cdc5fefab7040995fb791cb2f"} Jul 14 10:01:07.749284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:07.749230 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mvv6p" podStartSLOduration=12.004666687 podStartE2EDuration="55.749212793s" totalImagesPullingTime="43.744546106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:07.748579804 +0000 UTC m=+55.845968005" watchObservedRunningTime="2026-07-14 10:01:07.749212793 +0000 UTC m=+55.846600995" Jul 14 10:01:08.227408 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:08.227365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:08.227408 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:08.227414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:08.227621 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:08.227489 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:08.227621 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:08.227522 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:08.227621 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:08.227543 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:10.227530008 +0000 UTC m=+58.324918188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : configmap "kube-rbac-proxy" not found Jul 14 10:01:08.227621 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:08.227577 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:10.227563802 +0000 UTC m=+58.324951981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:09.318144 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:09.318115 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rfwhk_d7d7750a-ed94-4fce-8684-53b69c2befba/dns-node-resolver/0.log" Jul 14 10:01:09.540269 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:09.540228 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:01:09.540463 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:09.540290 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:01:09.540656 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:09.540642 2561 scope.go:117] "RemoveContainer" containerID="16f22f863bd166d885561e8400cd3e6c3723081df4ecd9c716c1e0c66015871d" Jul 14 10:01:09.540831 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:09.540795 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4p7x6_openshift-console-operator(8ef7c917-86a5-4f72-b6b5-8758e39ba40e)\"" pod="openshift-console-operator/console-operator-7866497494-4p7x6" podUID="8ef7c917-86a5-4f72-b6b5-8758e39ba40e" Jul 14 10:01:10.118109 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:10.118079 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2qd4v_b11e3dfb-042f-45a5-b118-3e59564ea508/node-ca/0.log" Jul 14 10:01:10.246425 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:10.246391 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:10.246631 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:10.246471 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:14.246452999 +0000 UTC m=+62.343841186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : configmap "kube-rbac-proxy" not found Jul 14 10:01:10.246631 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:10.246388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:10.246754 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:10.246664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:10.246835 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:10.246764 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:10.246835 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:10.246821 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:14.24679282 +0000 UTC m=+62.344181003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:11.318587 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:11.318561 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x8bct_d0931415-10d0-4e57-b02f-f5200ec5ac8a/serve-healthcheck-canary/0.log" Jul 14 10:01:11.920163 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:11.920132 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-r8cqf_bedfb6fe-a253-4191-960b-325181dc222f/kube-storage-version-migrator-operator/0.log" Jul 14 10:01:14.281694 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:14.281655 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:14.282146 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:14.281704 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:14.282146 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:14.281791 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 10:01:14.282146 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:14.281843 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:14.282146 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:14.281891 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:22.28187311 +0000 UTC m=+70.379261290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : configmap "kube-rbac-proxy" not found Jul 14 10:01:14.282146 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:14.281905 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:22.281898844 +0000 UTC m=+70.379287024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:14.586207 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:14.586133 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6v5bh" Jul 14 10:01:18.116338 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.116294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:01:18.119488 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.119471 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 10:01:18.129884 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.129856 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea-original-pull-secret\") pod \"global-pull-secret-syncer-t64dj\" (UID: \"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea\") " pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:01:18.216878 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.216841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:01:18.219547 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.219524 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 10:01:18.227814 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:18.227784 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 10:01:18.227932 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:18.227896 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs podName:0e14bf74-373b-4b7d-a6a4-32b73e28a0d0 nodeName:}" failed. No retries permitted until 2026-07-14 10:02:22.227872295 +0000 UTC m=+130.325260478 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs") pod "network-metrics-daemon-vngw5" (UID: "0e14bf74-373b-4b7d-a6a4-32b73e28a0d0") : secret "metrics-daemon-secret" not found Jul 14 10:01:18.318218 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.318178 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:01:18.320901 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.320877 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5f4f\" (UniqueName: \"kubernetes.io/projected/45cd99fa-b233-4420-b004-9284aabcba1a-kube-api-access-p5f4f\") pod \"network-check-target-vx8xc\" (UID: \"45cd99fa-b233-4420-b004-9284aabcba1a\") " pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:01:18.389944 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.389854 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pz2v6\"" Jul 14 10:01:18.398364 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.398334 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:01:18.402372 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.402355 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t64dj" Jul 14 10:01:18.537611 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.537587 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t64dj"] Jul 14 10:01:18.543123 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:01:18.543079 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0db0c6_2d78_43f0_a36e_f7ceb3b7e0ea.slice/crio-e60632c957bce64e728fc3c97d4b71b4bec4ab2a1f7eee0a9c85493cba97fa14 WatchSource:0}: Error finding container e60632c957bce64e728fc3c97d4b71b4bec4ab2a1f7eee0a9c85493cba97fa14: Status 404 returned error can't find the container with id e60632c957bce64e728fc3c97d4b71b4bec4ab2a1f7eee0a9c85493cba97fa14 Jul 14 10:01:18.555880 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.555845 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vx8xc"] Jul 14 10:01:18.558425 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:01:18.558388 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cd99fa_b233_4420_b004_9284aabcba1a.slice/crio-915470eb802c9e0c31a3ad8d67bd381c563e769d9c3d5605507dad89f8be580e WatchSource:0}: Error finding container 915470eb802c9e0c31a3ad8d67bd381c563e769d9c3d5605507dad89f8be580e: Status 404 returned error can't find the container with id 915470eb802c9e0c31a3ad8d67bd381c563e769d9c3d5605507dad89f8be580e Jul 14 10:01:18.750544 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.750442 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vx8xc" event={"ID":"45cd99fa-b233-4420-b004-9284aabcba1a","Type":"ContainerStarted","Data":"0567c69fba071c50711dccd0119dc685d6fa66ece83db3308cc45e60edfaea7a"} Jul 14 10:01:18.750544 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.750499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vx8xc" event={"ID":"45cd99fa-b233-4420-b004-9284aabcba1a","Type":"ContainerStarted","Data":"915470eb802c9e0c31a3ad8d67bd381c563e769d9c3d5605507dad89f8be580e"} Jul 14 10:01:18.750544 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.750527 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:01:18.751641 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.751615 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t64dj" event={"ID":"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea","Type":"ContainerStarted","Data":"e60632c957bce64e728fc3c97d4b71b4bec4ab2a1f7eee0a9c85493cba97fa14"} Jul 14 10:01:18.769754 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:18.769703 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vx8xc" podStartSLOduration=65.769686223 podStartE2EDuration="1m5.769686223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:18.767938483 +0000 UTC m=+66.865326690" watchObservedRunningTime="2026-07-14 10:01:18.769686223 +0000 UTC m=+66.867074462" Jul 14 10:01:21.145254 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.145201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:01:21.145757 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.145305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:01:21.145757 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.145359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:01:21.145757 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.145392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:01:21.145757 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.145420 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:21.146367 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.146220 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-service-ca-bundle\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:21.148381 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.148354 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"image-registry-7fd5886fbf-f6257\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:01:21.148476 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.148437 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/186f56af-a4b6-4c9c-a441-b07966fff28f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wj822\" (UID: \"186f56af-a4b6-4c9c-a441-b07966fff28f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:01:21.148518 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.148474 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/904345be-f78b-4503-8bab-1c27c45f57c1-metrics-tls\") pod \"dns-default-8zhsc\" (UID: \"904345be-f78b-4503-8bab-1c27c45f57c1\") " pod="openshift-dns/dns-default-8zhsc" Jul 14 10:01:21.148857 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.148835 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42efedaf-e494-4339-bdcd-a7a8730ab9ea-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-54l87\" (UID: \"42efedaf-e494-4339-bdcd-a7a8730ab9ea\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:01:21.246612 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.246569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:21.249612 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.249580 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d76890f3-a4e2-42ac-a7ed-2a8de69b57c2-metrics-certs\") pod \"router-default-75456cbc5d-9j95j\" (UID: \"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2\") " pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:21.283361 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.283328 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zh9t2\"" Jul 14 10:01:21.291645 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.291606 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:01:21.313401 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.313372 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2qwl7\"" Jul 14 10:01:21.321419 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.321393 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" Jul 14 10:01:21.327316 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.327293 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fpt26\"" Jul 14 10:01:21.335515 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.335465 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:21.336757 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.336736 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ff27t\"" Jul 14 10:01:21.344934 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.344866 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" Jul 14 10:01:21.350135 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.348498 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d25fg\"" Jul 14 10:01:21.357035 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.356999 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zhsc" Jul 14 10:01:21.448264 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.444425 2561 scope.go:117] "RemoveContainer" containerID="16f22f863bd166d885561e8400cd3e6c3723081df4ecd9c716c1e0c66015871d" Jul 14 10:01:21.523649 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.523376 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd5886fbf-f6257"] Jul 14 10:01:21.539011 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:01:21.538378 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d534671_ac5c_4ba8_aa99_a2b3c0b7ce62.slice/crio-0443a8ad9d812c574fa53be0795c16f64532778cf35bc11b385982543166a97c WatchSource:0}: Error finding container 0443a8ad9d812c574fa53be0795c16f64532778cf35bc11b385982543166a97c: Status 404 returned error can't find the container with id 0443a8ad9d812c574fa53be0795c16f64532778cf35bc11b385982543166a97c Jul 14 10:01:21.552277 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.548123 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822"] Jul 14 10:01:21.555963 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:01:21.555929 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186f56af_a4b6_4c9c_a441_b07966fff28f.slice/crio-66e2a9259acc2d5b6dceddfdf384fca2314722261ad2a3c56ae19d653ce9c9bf WatchSource:0}: Error finding container 66e2a9259acc2d5b6dceddfdf384fca2314722261ad2a3c56ae19d653ce9c9bf: Status 404 returned error can't find the container with id 66e2a9259acc2d5b6dceddfdf384fca2314722261ad2a3c56ae19d653ce9c9bf Jul 14 10:01:21.587163 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.587121 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87"] Jul 14 10:01:21.765022 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.764931 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" event={"ID":"186f56af-a4b6-4c9c-a441-b07966fff28f","Type":"ContainerStarted","Data":"66e2a9259acc2d5b6dceddfdf384fca2314722261ad2a3c56ae19d653ce9c9bf"} Jul 14 10:01:21.766474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.766443 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" event={"ID":"42efedaf-e494-4339-bdcd-a7a8730ab9ea","Type":"ContainerStarted","Data":"3eb44929f0884d405296f8493abd161c5b01b958626b07d853a12c9803b929de"} Jul 14 10:01:21.768461 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.768423 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" event={"ID":"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62","Type":"ContainerStarted","Data":"893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9"} Jul 14 10:01:21.768606 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.768482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" event={"ID":"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62","Type":"ContainerStarted","Data":"0443a8ad9d812c574fa53be0795c16f64532778cf35bc11b385982543166a97c"} Jul 14 10:01:21.769384 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.769325 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:01:21.772169 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.771573 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:01:21.772169 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.771620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4p7x6" event={"ID":"8ef7c917-86a5-4f72-b6b5-8758e39ba40e","Type":"ContainerStarted","Data":"691ccd112ecfc4e67331111d8467b3e63c12be308a74378b75fcc421d72c91e0"} Jul 14 10:01:21.772169 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.771987 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:01:21.790248 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.789658 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" podStartSLOduration=46.78963655 podStartE2EDuration="46.78963655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:21.788381355 +0000 UTC m=+69.885769561" watchObservedRunningTime="2026-07-14 10:01:21.78963655 +0000 UTC m=+69.887024755" Jul 14 10:01:21.806364 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.806314 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-4p7x6" podStartSLOduration=32.070720155 podStartE2EDuration="45.806295151s" totalImagesPullingTime="13.735574996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:21.804968817 +0000 UTC m=+69.902357019" watchObservedRunningTime="2026-07-14 10:01:21.806295151 +0000 UTC m=+69.903683353" Jul 14 10:01:21.819161 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.819111 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75456cbc5d-9j95j"] Jul 14 10:01:21.820944 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:21.820915 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zhsc"] Jul 14 10:01:22.361207 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:22.361170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:22.361701 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:22.361222 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:22.361701 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:22.361356 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 10:01:22.361701 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:01:22.361433 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls podName:9155d2e1-cddd-47df-8b37-7f461a19f8c8 nodeName:}" failed. No retries permitted until 2026-07-14 10:01:38.361414579 +0000 UTC m=+86.458802768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcqjf" (UID: "9155d2e1-cddd-47df-8b37-7f461a19f8c8") : secret "insights-runtime-extractor-tls" not found Jul 14 10:01:22.361906 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:22.361835 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9155d2e1-cddd-47df-8b37-7f461a19f8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:22.772420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:22.772327 2561 patch_prober.go:28] interesting pod/console-operator-7866497494-4p7x6 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 10:01:22.772420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:22.772397 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-4p7x6" podUID="8ef7c917-86a5-4f72-b6b5-8758e39ba40e" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 14 10:01:22.842894 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:22.842860 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-4p7x6" Jul 14 10:01:23.167668 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:01:23.167632 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76890f3_a4e2_42ac_a7ed_2a8de69b57c2.slice/crio-000545ce411016532e7a11a3e5ec5fc1284f90e10d19822b20c2f5a2132cd8b6 WatchSource:0}: Error finding container 000545ce411016532e7a11a3e5ec5fc1284f90e10d19822b20c2f5a2132cd8b6: Status 404 returned error can't find the container with id 000545ce411016532e7a11a3e5ec5fc1284f90e10d19822b20c2f5a2132cd8b6 Jul 14 10:01:23.168536 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:01:23.168515 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904345be_f78b_4503_8bab_1c27c45f57c1.slice/crio-c332b5ae82eb7daa2c304cb19d9ceb63b2200f32da8d3eb77186221cb193be67 WatchSource:0}: Error finding container c332b5ae82eb7daa2c304cb19d9ceb63b2200f32da8d3eb77186221cb193be67: Status 404 returned error can't find the container with id c332b5ae82eb7daa2c304cb19d9ceb63b2200f32da8d3eb77186221cb193be67 Jul 14 10:01:23.782646 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:23.782535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zhsc" event={"ID":"904345be-f78b-4503-8bab-1c27c45f57c1","Type":"ContainerStarted","Data":"c332b5ae82eb7daa2c304cb19d9ceb63b2200f32da8d3eb77186221cb193be67"} Jul 14 10:01:23.785278 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:23.784752 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75456cbc5d-9j95j" event={"ID":"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2","Type":"ContainerStarted","Data":"0fae7665256cc817eeffc295713758e15539a81f5bde91fa844434bac90bac7b"} Jul 14 10:01:23.785278 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:23.784823 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75456cbc5d-9j95j" event={"ID":"d76890f3-a4e2-42ac-a7ed-2a8de69b57c2","Type":"ContainerStarted","Data":"000545ce411016532e7a11a3e5ec5fc1284f90e10d19822b20c2f5a2132cd8b6"} Jul 14 10:01:23.788115 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:23.788082 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t64dj" event={"ID":"3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea","Type":"ContainerStarted","Data":"4d42e9cfc2c165fd7113ce8d94138119c327cb9f65da3355fe3736d4b6effc4d"} Jul 14 10:01:23.805741 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:23.805684 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75456cbc5d-9j95j" podStartSLOduration=47.805660571 podStartE2EDuration="47.805660571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:23.804647999 +0000 UTC m=+71.902036214" watchObservedRunningTime="2026-07-14 10:01:23.805660571 +0000 UTC m=+71.903048775" Jul 14 10:01:23.821310 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:23.821251 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t64dj" podStartSLOduration=67.159133825 podStartE2EDuration="1m11.821228446s" totalImagesPullingTime="4.662094621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:23.820874264 +0000 UTC m=+71.918262467" watchObservedRunningTime="2026-07-14 10:01:23.821228446 +0000 UTC m=+71.918616649" Jul 14 10:01:24.336129 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:24.336086 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:24.340609 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:24.340575 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:24.791706 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:24.791670 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:24.793016 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:24.792994 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75456cbc5d-9j95j" Jul 14 10:01:26.801885 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:26.801827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" event={"ID":"42efedaf-e494-4339-bdcd-a7a8730ab9ea","Type":"ContainerStarted","Data":"ce02b478f70b73e3c5767b852771876d2be170bde7da21826c2d052e9c73be16"} Jul 14 10:01:26.802331 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:26.801948 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" event={"ID":"42efedaf-e494-4339-bdcd-a7a8730ab9ea","Type":"ContainerStarted","Data":"86eda17e942cd77cc1bee0bb66afcf22e60ed5ad14e757b24f94a9620d490536"} Jul 14 10:01:26.803499 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:26.803471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" event={"ID":"186f56af-a4b6-4c9c-a441-b07966fff28f","Type":"ContainerStarted","Data":"c774a450d0c6aff612491d72eaff059bf23832b7bdb75168bcd2893793fb8577"} Jul 14 10:01:26.805317 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:26.805291 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zhsc" event={"ID":"904345be-f78b-4503-8bab-1c27c45f57c1","Type":"ContainerStarted","Data":"90310530d8c71f03df4a4cbb820e6b6a2f862e0cb83bbe42cab61849b9d2eb19"} Jul 14 10:01:26.805432 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:26.805341 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zhsc" event={"ID":"904345be-f78b-4503-8bab-1c27c45f57c1","Type":"ContainerStarted","Data":"5b1940b534ffac8ec6677af3995aa0892692ff97e37c8268996d647e280e0903"} Jul 14 10:01:26.819792 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:26.819728 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-54l87" podStartSLOduration=46.137032753 podStartE2EDuration="50.819710185s" totalImagesPullingTime="4.682677432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:26.819242227 +0000 UTC m=+74.916630430" watchObservedRunningTime="2026-07-14 10:01:26.819710185 +0000 UTC m=+74.917098457" Jul 14 10:01:26.834893 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:26.834843 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8zhsc" podStartSLOduration=34.687244546 podStartE2EDuration="37.834824803s" totalImagesPullingTime="3.147580257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:26.83418621 +0000 UTC m=+74.931574412" watchObservedRunningTime="2026-07-14 10:01:26.834824803 +0000 UTC m=+74.932213006" Jul 14 10:01:26.848998 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:26.848886 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wj822" podStartSLOduration=46.095734351 podStartE2EDuration="50.848866107s" totalImagesPullingTime="4.753131756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:26.848754922 +0000 UTC m=+74.946143127" watchObservedRunningTime="2026-07-14 10:01:26.848866107 +0000 UTC m=+74.946254311" Jul 14 10:01:27.809285 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:27.809247 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8zhsc" Jul 14 10:01:37.825390 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:37.825279 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8zhsc" Jul 14 10:01:38.301716 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.301681 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2l55t"] Jul 14 10:01:38.329998 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.329966 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.332652 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.332611 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 10:01:38.332827 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.332741 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 10:01:38.334022 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.333995 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 10:01:38.334124 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.333993 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wkhrf\"" Jul 14 10:01:38.334124 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.333995 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 10:01:38.406816 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.406750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:38.409532 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.409504 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9155d2e1-cddd-47df-8b37-7f461a19f8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcqjf\" (UID: \"9155d2e1-cddd-47df-8b37-7f461a19f8c8\") " pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:38.507922 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.507886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-tls\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.508098 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.507927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-wtmp\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.508098 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.507955 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-accelerators-collector-config\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.508098 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.508058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqlqm\" (UniqueName: \"kubernetes.io/projected/e8580db5-0553-4857-8ded-b68128848b01-kube-api-access-bqlqm\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.508217 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.508131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-textfile\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.508217 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.508166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8580db5-0553-4857-8ded-b68128848b01-metrics-client-ca\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.508217 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.508193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8580db5-0553-4857-8ded-b68128848b01-root\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.508327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.508249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8580db5-0553-4857-8ded-b68128848b01-sys\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.508327 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.508292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.598742 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.598662 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-szrgf\"" Jul 14 10:01:38.606665 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.606639 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fcqjf" Jul 14 10:01:38.609191 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8580db5-0553-4857-8ded-b68128848b01-sys\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609286 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609286 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-tls\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609286 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-wtmp\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609443 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609282 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8580db5-0553-4857-8ded-b68128848b01-sys\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609443 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-accelerators-collector-config\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609443 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609403 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-wtmp\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609443 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqlqm\" (UniqueName: \"kubernetes.io/projected/e8580db5-0553-4857-8ded-b68128848b01-kube-api-access-bqlqm\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609579 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-textfile\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609579 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8580db5-0553-4857-8ded-b68128848b01-metrics-client-ca\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609579 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8580db5-0553-4857-8ded-b68128848b01-root\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609838 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609775 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8580db5-0553-4857-8ded-b68128848b01-root\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.609970 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609926 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-textfile\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.610195 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.609971 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-accelerators-collector-config\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.610195 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.610149 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8580db5-0553-4857-8ded-b68128848b01-metrics-client-ca\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.612458 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.612413 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-tls\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.612566 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.612477 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8580db5-0553-4857-8ded-b68128848b01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.617891 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.617865 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqlqm\" (UniqueName: \"kubernetes.io/projected/e8580db5-0553-4857-8ded-b68128848b01-kube-api-access-bqlqm\") pod \"node-exporter-2l55t\" (UID: \"e8580db5-0553-4857-8ded-b68128848b01\") " pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.640164 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.640141 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2l55t" Jul 14 10:01:38.669039 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:01:38.668954 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8580db5_0553_4857_8ded_b68128848b01.slice/crio-e9037a1e8e866fa78474df4dab14c4f5c689b17740cd2602ceb48208b29a9e33 WatchSource:0}: Error finding container e9037a1e8e866fa78474df4dab14c4f5c689b17740cd2602ceb48208b29a9e33: Status 404 returned error can't find the container with id e9037a1e8e866fa78474df4dab14c4f5c689b17740cd2602ceb48208b29a9e33 Jul 14 10:01:38.779336 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.779187 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fcqjf"] Jul 14 10:01:38.781638 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:01:38.781612 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9155d2e1_cddd_47df_8b37_7f461a19f8c8.slice/crio-3c2dd5e8be6f6d2825ce4f7029643b31697289cc380ac8b7b9c0c1445002216a WatchSource:0}: Error finding container 3c2dd5e8be6f6d2825ce4f7029643b31697289cc380ac8b7b9c0c1445002216a: Status 404 returned error can't find the container with id 3c2dd5e8be6f6d2825ce4f7029643b31697289cc380ac8b7b9c0c1445002216a Jul 14 10:01:38.849935 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.849828 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2l55t" event={"ID":"e8580db5-0553-4857-8ded-b68128848b01","Type":"ContainerStarted","Data":"e9037a1e8e866fa78474df4dab14c4f5c689b17740cd2602ceb48208b29a9e33"} Jul 14 10:01:38.851082 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:38.851057 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcqjf" event={"ID":"9155d2e1-cddd-47df-8b37-7f461a19f8c8","Type":"ContainerStarted","Data":"3c2dd5e8be6f6d2825ce4f7029643b31697289cc380ac8b7b9c0c1445002216a"} Jul 14 10:01:40.868467 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:40.868426 2561 generic.go:356] "Generic (PLEG): container finished" podID="e8580db5-0553-4857-8ded-b68128848b01" containerID="f9994be29cb2fdf4e9daa560f54524466f081ff5956791a12039158450400b19" exitCode=0 Jul 14 10:01:40.868930 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:40.868499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2l55t" event={"ID":"e8580db5-0553-4857-8ded-b68128848b01","Type":"ContainerDied","Data":"f9994be29cb2fdf4e9daa560f54524466f081ff5956791a12039158450400b19"} Jul 14 10:01:41.296679 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:41.296634 2561 patch_prober.go:28] interesting pod/image-registry-7fd5886fbf-f6257 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 10:01:41.296903 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:41.296696 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" podUID="0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 10:01:42.879322 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:42.879284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2l55t" event={"ID":"e8580db5-0553-4857-8ded-b68128848b01","Type":"ContainerStarted","Data":"e5abb77e54b1a7a3dc99f92471dc2da481ab7fa661d3fc0d66b37feb7213157e"} Jul 14 10:01:42.879699 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:42.879338 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2l55t" event={"ID":"e8580db5-0553-4857-8ded-b68128848b01","Type":"ContainerStarted","Data":"f2f2d5d3fdbac51e292b6ebdeeaf7ef60bcd96216b8c5f673c7f62a1ab38df45"} Jul 14 10:01:42.881249 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:42.881219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcqjf" event={"ID":"9155d2e1-cddd-47df-8b37-7f461a19f8c8","Type":"ContainerStarted","Data":"7dab015a7f88321ea7ae1e79748c42c7c6955b59c140d41e1b81295302ab8f83"} Jul 14 10:01:42.899877 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:42.899827 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2l55t" podStartSLOduration=3.469524432 podStartE2EDuration="4.899810356s" totalImagesPullingTime="1.347118323s" totalInitContainerRuntime="83.167601ms" isStatefulPod=true podCreationTimestamp="2026-07-14 10:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:42.899552955 +0000 UTC m=+90.996941156" watchObservedRunningTime="2026-07-14 10:01:42.899810356 +0000 UTC m=+90.997198550" Jul 14 10:01:43.793647 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:43.793618 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:01:43.887558 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:43.887516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcqjf" event={"ID":"9155d2e1-cddd-47df-8b37-7f461a19f8c8","Type":"ContainerStarted","Data":"8238397349ec1bd4d9b95d221ad03d96da5e28bd4708f518d31159ba06d39575"} Jul 14 10:01:46.901547 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:46.901513 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcqjf" event={"ID":"9155d2e1-cddd-47df-8b37-7f461a19f8c8","Type":"ContainerStarted","Data":"56a0f723edde2bf73845ca2b51733ad11460958ddb4d5f632ee8ee2761de79e2"} Jul 14 10:01:46.919933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:46.919877 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fcqjf" podStartSLOduration=33.887410692 podStartE2EDuration="40.919859795s" totalImagesPullingTime="7.032449103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:01:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:01:46.919349537 +0000 UTC m=+95.016737738" watchObservedRunningTime="2026-07-14 10:01:46.919859795 +0000 UTC m=+95.017247996" Jul 14 10:01:49.757960 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:49.757921 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vx8xc" Jul 14 10:01:50.573647 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:01:50.573606 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fd5886fbf-f6257"] Jul 14 10:02:15.595089 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:15.595000 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" podUID="0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" containerName="registry" containerID="cri-o://893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9" gracePeriod=30 Jul 14 10:02:15.889203 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:15.889172 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:02:16.008091 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.008059 2561 generic.go:356] "Generic (PLEG): container finished" podID="498bbb4d-e731-46b0-a0cf-3649992e2ce6" containerID="77e6ae3eb8603273a3a92de575409a2b148fcd15458aea59c2b55235000936c5" exitCode=0 Jul 14 10:02:16.008291 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.008134 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" event={"ID":"498bbb4d-e731-46b0-a0cf-3649992e2ce6","Type":"ContainerDied","Data":"77e6ae3eb8603273a3a92de575409a2b148fcd15458aea59c2b55235000936c5"} Jul 14 10:02:16.008556 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.008536 2561 scope.go:117] "RemoveContainer" containerID="77e6ae3eb8603273a3a92de575409a2b148fcd15458aea59c2b55235000936c5" Jul 14 10:02:16.009529 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.009507 2561 generic.go:356] "Generic (PLEG): container finished" podID="0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" containerID="893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9" exitCode=0 Jul 14 10:02:16.009623 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.009544 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" event={"ID":"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62","Type":"ContainerDied","Data":"893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9"} Jul 14 10:02:16.009623 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.009565 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" Jul 14 10:02:16.009623 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.009583 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd5886fbf-f6257" event={"ID":"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62","Type":"ContainerDied","Data":"0443a8ad9d812c574fa53be0795c16f64532778cf35bc11b385982543166a97c"} Jul 14 10:02:16.009623 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.009603 2561 scope.go:117] "RemoveContainer" containerID="893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9" Jul 14 10:02:16.022128 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.022105 2561 scope.go:117] "RemoveContainer" containerID="893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9" Jul 14 10:02:16.022451 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:02:16.022426 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9\": container with ID starting with 893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9 not found: ID does not exist" containerID="893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9" Jul 14 10:02:16.022561 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.022458 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9"} err="failed to get container status \"893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9\": rpc error: code = NotFound desc = could not find container \"893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9\": container with ID starting with 893bd60a4a3ce287f935dfb7c52a03e2de80c288489626cbcbdd5125df12d0c9 not found: ID does not exist" Jul 14 10:02:16.047556 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.047525 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-trusted-ca\") pod \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " Jul 14 10:02:16.047756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.047569 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-bound-sa-token\") pod \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " Jul 14 10:02:16.047756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.047614 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7bbf\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-kube-api-access-v7bbf\") pod \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " Jul 14 10:02:16.047756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.047666 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-ca-trust-extracted\") pod \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " Jul 14 10:02:16.047756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.047702 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-certificates\") pod \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " Jul 14 10:02:16.047756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.047741 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-installation-pull-secrets\") pod \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " Jul 14 10:02:16.048011 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.047789 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") pod \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " Jul 14 10:02:16.048011 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.047847 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-image-registry-private-configuration\") pod \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\" (UID: \"0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62\") " Jul 14 10:02:16.048122 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.048042 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:02:16.048172 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.048148 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-trusted-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:02:16.048866 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.048794 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:02:16.050944 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.050888 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:16.051126 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.051095 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-kube-api-access-v7bbf" (OuterVolumeSpecName: "kube-api-access-v7bbf") pod "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62"). InnerVolumeSpecName "kube-api-access-v7bbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:02:16.051252 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.051137 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:02:16.051252 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.051230 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:02:16.051569 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.051547 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:02:16.060302 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.060265 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" (UID: "0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:02:16.149075 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.149040 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:02:16.149075 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.149072 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-image-registry-private-configuration\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:02:16.149075 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.149082 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-bound-sa-token\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:02:16.149378 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.149092 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7bbf\" (UniqueName: \"kubernetes.io/projected/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-kube-api-access-v7bbf\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:02:16.149378 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.149108 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-ca-trust-extracted\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:02:16.149378 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.149120 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-registry-certificates\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:02:16.149378 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.149131 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62-installation-pull-secrets\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:02:16.330717 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.330684 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fd5886fbf-f6257"] Jul 14 10:02:16.334678 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.334646 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fd5886fbf-f6257"] Jul 14 10:02:16.453625 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:16.453536 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" path="/var/lib/kubelet/pods/0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62/volumes" Jul 14 10:02:17.015334 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:17.015300 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7czds" event={"ID":"498bbb4d-e731-46b0-a0cf-3649992e2ce6","Type":"ContainerStarted","Data":"3a514b5fc1773d81e45561de62fed0ac403c8a7949c14bdda0bbb85f83e5c7e8"} Jul 14 10:02:22.301058 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:22.301015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:02:22.303597 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:22.303572 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e14bf74-373b-4b7d-a6a4-32b73e28a0d0-metrics-certs\") pod \"network-metrics-daemon-vngw5\" (UID: \"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0\") " pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:02:22.597704 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:22.597618 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vm2xk\"" Jul 14 10:02:22.608331 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:22.608284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vngw5" Jul 14 10:02:22.779340 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:22.779304 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vngw5"] Jul 14 10:02:22.782853 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:02:22.782822 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e14bf74_373b_4b7d_a6a4_32b73e28a0d0.slice/crio-5d250c763955f2d3a5c76c6173f23bf74078456be8a87bf86adec51bdcbb6a07 WatchSource:0}: Error finding container 5d250c763955f2d3a5c76c6173f23bf74078456be8a87bf86adec51bdcbb6a07: Status 404 returned error can't find the container with id 5d250c763955f2d3a5c76c6173f23bf74078456be8a87bf86adec51bdcbb6a07 Jul 14 10:02:23.039692 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:23.039657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vngw5" event={"ID":"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0","Type":"ContainerStarted","Data":"5d250c763955f2d3a5c76c6173f23bf74078456be8a87bf86adec51bdcbb6a07"} Jul 14 10:02:25.049783 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:25.049689 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vngw5" event={"ID":"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0","Type":"ContainerStarted","Data":"0c2842510de5beb8df8fa2874233e1fdfcf149da7dbe6b592a1b3bdc46a45c9b"} Jul 14 10:02:26.055340 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:26.055298 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vngw5" event={"ID":"0e14bf74-373b-4b7d-a6a4-32b73e28a0d0","Type":"ContainerStarted","Data":"a8a0f82a3fb325ba0c1348c253eb6449db070bedf23106111f9b5d59fad52e66"} Jul 14 10:02:26.073744 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:26.073683 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vngw5" podStartSLOduration=131.907594202 podStartE2EDuration="2m14.073666735s" totalImagesPullingTime="2.166072533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:02:26.07234588 +0000 UTC m=+134.169734083" watchObservedRunningTime="2026-07-14 10:02:26.073666735 +0000 UTC m=+134.171054937" Jul 14 10:02:29.604788 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:29.604742 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" podUID="f55984f0-ca55-4b8e-96ce-eb5e9c7a826b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 10:02:31.077272 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:31.077237 2561 generic.go:356] "Generic (PLEG): container finished" podID="2108d827-de3f-4d7d-ac89-c5a6b8895e5e" containerID="69a1965136027eb00d7e34345f3538303a414aa76d8f1b199443c0e24b3bed38" exitCode=0 Jul 14 10:02:31.077645 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:31.077312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" event={"ID":"2108d827-de3f-4d7d-ac89-c5a6b8895e5e","Type":"ContainerDied","Data":"69a1965136027eb00d7e34345f3538303a414aa76d8f1b199443c0e24b3bed38"} Jul 14 10:02:31.077702 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:31.077683 2561 scope.go:117] "RemoveContainer" containerID="69a1965136027eb00d7e34345f3538303a414aa76d8f1b199443c0e24b3bed38" Jul 14 10:02:32.082994 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:32.082960 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-57rc5" event={"ID":"2108d827-de3f-4d7d-ac89-c5a6b8895e5e","Type":"ContainerStarted","Data":"f53c77f6b97fc3fc3f240b379b766944813b2eda4dba658ef42f8ef708a7ef12"} Jul 14 10:02:36.099695 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:36.099656 2561 generic.go:356] "Generic (PLEG): container finished" podID="bedfb6fe-a253-4191-960b-325181dc222f" containerID="86e80d85e9b24c74c59cbb3e62f242de330e355c943baf57ca5a006698b84a0d" exitCode=0 Jul 14 10:02:36.100215 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:36.099730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" event={"ID":"bedfb6fe-a253-4191-960b-325181dc222f","Type":"ContainerDied","Data":"86e80d85e9b24c74c59cbb3e62f242de330e355c943baf57ca5a006698b84a0d"} Jul 14 10:02:36.100215 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:36.100075 2561 scope.go:117] "RemoveContainer" containerID="86e80d85e9b24c74c59cbb3e62f242de330e355c943baf57ca5a006698b84a0d" Jul 14 10:02:37.105153 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:37.105120 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-r8cqf" event={"ID":"bedfb6fe-a253-4191-960b-325181dc222f","Type":"ContainerStarted","Data":"751d32220ca9f74987843a8be173f81b211ec8d944625c448b7450779fe0e8a9"} Jul 14 10:02:39.604750 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:39.604709 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" podUID="f55984f0-ca55-4b8e-96ce-eb5e9c7a826b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 10:02:49.605422 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:49.605376 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" podUID="f55984f0-ca55-4b8e-96ce-eb5e9c7a826b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 10:02:49.605847 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:49.605461 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" Jul 14 10:02:49.605990 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:49.605972 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"856c8942dbf4a4bb55ebbd820ff6a9cfb1ca6c16c9f4bc3fb44067d9949a8d2c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 14 10:02:49.606027 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:49.606012 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" podUID="f55984f0-ca55-4b8e-96ce-eb5e9c7a826b" containerName="service-proxy" containerID="cri-o://856c8942dbf4a4bb55ebbd820ff6a9cfb1ca6c16c9f4bc3fb44067d9949a8d2c" gracePeriod=30 Jul 14 10:02:50.161146 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:50.161113 2561 generic.go:356] "Generic (PLEG): container finished" podID="f55984f0-ca55-4b8e-96ce-eb5e9c7a826b" containerID="856c8942dbf4a4bb55ebbd820ff6a9cfb1ca6c16c9f4bc3fb44067d9949a8d2c" exitCode=2 Jul 14 10:02:50.161310 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:50.161168 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" event={"ID":"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b","Type":"ContainerDied","Data":"856c8942dbf4a4bb55ebbd820ff6a9cfb1ca6c16c9f4bc3fb44067d9949a8d2c"} Jul 14 10:02:50.161310 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:02:50.161201 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f898856cb-d6vhn" event={"ID":"f55984f0-ca55-4b8e-96ce-eb5e9c7a826b","Type":"ContainerStarted","Data":"08aa4ad9374eb3b75188deb115b407e80a3a1d9fa3d4a25788dbe2e6e102801c"} Jul 14 10:05:12.340778 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:05:12.340742 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:05:12.341332 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:05:12.340845 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:05:12.346285 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:05:12.346258 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:05:12.346285 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:05:12.346277 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:05:12.358752 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:05:12.358726 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 10:06:29.184391 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.184357 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj"] Jul 14 10:06:29.184931 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.184673 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" containerName="registry" Jul 14 10:06:29.184931 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.184685 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" containerName="registry" Jul 14 10:06:29.184931 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.184740 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d534671-ac5c-4ba8-aa99-a2b3c0b7ce62" containerName="registry" Jul 14 10:06:29.186945 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.186927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.191005 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.190969 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 10:06:29.191005 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.190997 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 10:06:29.191455 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.191428 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 10:06:29.191455 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.191449 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7mwsq\"" Jul 14 10:06:29.192157 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.192137 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 10:06:29.210481 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.210445 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj"] Jul 14 10:06:29.247022 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.246987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffa8a37-d116-47e6-ae71-36831a3cedcb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.247223 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.247045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ffa8a37-d116-47e6-ae71-36831a3cedcb-tmp\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.247223 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.247074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ffa8a37-d116-47e6-ae71-36831a3cedcb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.247223 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.247138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ffa8a37-d116-47e6-ae71-36831a3cedcb-manifests\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.247223 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.247158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx2tk\" (UniqueName: \"kubernetes.io/projected/0ffa8a37-d116-47e6-ae71-36831a3cedcb-kube-api-access-kx2tk\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.348144 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.348112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffa8a37-d116-47e6-ae71-36831a3cedcb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.348335 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.348157 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ffa8a37-d116-47e6-ae71-36831a3cedcb-tmp\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.348335 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.348179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ffa8a37-d116-47e6-ae71-36831a3cedcb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.348335 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.348209 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ffa8a37-d116-47e6-ae71-36831a3cedcb-manifests\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.348335 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.348231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx2tk\" (UniqueName: \"kubernetes.io/projected/0ffa8a37-d116-47e6-ae71-36831a3cedcb-kube-api-access-kx2tk\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.348716 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.348695 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ffa8a37-d116-47e6-ae71-36831a3cedcb-manifests\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.350773 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.350745 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ffa8a37-d116-47e6-ae71-36831a3cedcb-tmp\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.350925 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.350830 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffa8a37-d116-47e6-ae71-36831a3cedcb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.350984 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.350926 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ffa8a37-d116-47e6-ae71-36831a3cedcb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.360489 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.360460 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx2tk\" (UniqueName: \"kubernetes.io/projected/0ffa8a37-d116-47e6-ae71-36831a3cedcb-kube-api-access-kx2tk\") pod \"opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj\" (UID: \"0ffa8a37-d116-47e6-ae71-36831a3cedcb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.498065 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.497941 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:29.675831 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.675760 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj"] Jul 14 10:06:29.680514 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:06:29.680487 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffa8a37_d116_47e6_ae71_36831a3cedcb.slice/crio-b0ae2dc9f48f0db97b2ff924a0b271098824a2e4661dfd14638adb65db4202bb WatchSource:0}: Error finding container b0ae2dc9f48f0db97b2ff924a0b271098824a2e4661dfd14638adb65db4202bb: Status 404 returned error can't find the container with id b0ae2dc9f48f0db97b2ff924a0b271098824a2e4661dfd14638adb65db4202bb Jul 14 10:06:29.682201 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:29.682181 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 10:06:30.003752 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:30.003711 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" event={"ID":"0ffa8a37-d116-47e6-ae71-36831a3cedcb","Type":"ContainerStarted","Data":"b0ae2dc9f48f0db97b2ff924a0b271098824a2e4661dfd14638adb65db4202bb"} Jul 14 10:06:33.019561 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:33.019463 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" event={"ID":"0ffa8a37-d116-47e6-ae71-36831a3cedcb","Type":"ContainerStarted","Data":"4e867e74773a70b777a6ca538a77302e3b52f6ff776e820948335727182d4ff3"} Jul 14 10:06:34.025016 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:34.024927 2561 generic.go:356] "Generic (PLEG): container finished" podID="0ffa8a37-d116-47e6-ae71-36831a3cedcb" containerID="4e867e74773a70b777a6ca538a77302e3b52f6ff776e820948335727182d4ff3" exitCode=0 Jul 14 10:06:34.025375 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:34.025001 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" event={"ID":"0ffa8a37-d116-47e6-ae71-36831a3cedcb","Type":"ContainerDied","Data":"4e867e74773a70b777a6ca538a77302e3b52f6ff776e820948335727182d4ff3"} Jul 14 10:06:35.031325 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:35.031284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" event={"ID":"0ffa8a37-d116-47e6-ae71-36831a3cedcb","Type":"ContainerStarted","Data":"3061cca474967311885ab88e9d101513b86f2179315ea3548ddfe384c6b6f193"} Jul 14 10:06:35.031719 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:35.031384 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:35.061779 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:35.061690 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" podStartSLOduration=1.652813409 podStartE2EDuration="6.061668346s" totalImagesPullingTime="3.385273152s" totalInitContainerRuntime="1.023581785s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:06:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:06:35.057916929 +0000 UTC m=+383.155305135" watchObservedRunningTime="2026-07-14 10:06:35.061668346 +0000 UTC m=+383.159056549" Jul 14 10:06:46.038940 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:46.038903 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj" Jul 14 10:06:49.664961 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.664914 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq"] Jul 14 10:06:49.676238 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.676192 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:49.677399 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.677375 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hvdpk"] Jul 14 10:06:49.678963 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.678944 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 10:06:49.679070 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.678972 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kc454\"" Jul 14 10:06:49.679243 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.679225 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 10:06:49.679490 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.679472 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:49.682064 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.682040 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq"] Jul 14 10:06:49.682359 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.682340 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-h99ps\"" Jul 14 10:06:49.682452 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.682340 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 14 10:06:49.697109 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.697080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hvdpk"] Jul 14 10:06:49.823561 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.823522 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e65fc22-e005-4dbd-97ac-cf0d6e394117-tls-certs\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:49.823784 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.823575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzkc6\" (UniqueName: \"kubernetes.io/projected/5e65fc22-e005-4dbd-97ac-cf0d6e394117-kube-api-access-dzkc6\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:49.823784 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.823638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e65fc22-e005-4dbd-97ac-cf0d6e394117-tmp\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:49.823784 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.823682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58109363-0ac2-4352-85c2-c2489c2e3e64-cert\") pod \"odh-model-controller-7998c67dc4-hvdpk\" (UID: \"58109363-0ac2-4352-85c2-c2489c2e3e64\") " pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:49.823784 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.823708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm926\" (UniqueName: \"kubernetes.io/projected/58109363-0ac2-4352-85c2-c2489c2e3e64-kube-api-access-cm926\") pod \"odh-model-controller-7998c67dc4-hvdpk\" (UID: \"58109363-0ac2-4352-85c2-c2489c2e3e64\") " pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:49.924412 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.924307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58109363-0ac2-4352-85c2-c2489c2e3e64-cert\") pod \"odh-model-controller-7998c67dc4-hvdpk\" (UID: \"58109363-0ac2-4352-85c2-c2489c2e3e64\") " pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:49.924412 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.924346 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm926\" (UniqueName: \"kubernetes.io/projected/58109363-0ac2-4352-85c2-c2489c2e3e64-kube-api-access-cm926\") pod \"odh-model-controller-7998c67dc4-hvdpk\" (UID: \"58109363-0ac2-4352-85c2-c2489c2e3e64\") " pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:49.924412 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.924396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e65fc22-e005-4dbd-97ac-cf0d6e394117-tls-certs\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:49.924690 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.924415 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkc6\" (UniqueName: \"kubernetes.io/projected/5e65fc22-e005-4dbd-97ac-cf0d6e394117-kube-api-access-dzkc6\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:49.924690 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.924440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e65fc22-e005-4dbd-97ac-cf0d6e394117-tmp\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:49.924690 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:06:49.924464 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 14 10:06:49.924690 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:06:49.924536 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 14 10:06:49.924690 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:06:49.924544 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58109363-0ac2-4352-85c2-c2489c2e3e64-cert podName:58109363-0ac2-4352-85c2-c2489c2e3e64 nodeName:}" failed. No retries permitted until 2026-07-14 10:06:50.424517961 +0000 UTC m=+398.521906145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/58109363-0ac2-4352-85c2-c2489c2e3e64-cert") pod "odh-model-controller-7998c67dc4-hvdpk" (UID: "58109363-0ac2-4352-85c2-c2489c2e3e64") : secret "odh-model-controller-webhook-cert" not found Jul 14 10:06:49.924690 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:06:49.924617 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e65fc22-e005-4dbd-97ac-cf0d6e394117-tls-certs podName:5e65fc22-e005-4dbd-97ac-cf0d6e394117 nodeName:}" failed. No retries permitted until 2026-07-14 10:06:50.424598531 +0000 UTC m=+398.521986713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5e65fc22-e005-4dbd-97ac-cf0d6e394117-tls-certs") pod "kube-auth-proxy-66cfd9dd7c-zn2lq" (UID: "5e65fc22-e005-4dbd-97ac-cf0d6e394117") : secret "kube-auth-proxy-tls" not found Jul 14 10:06:49.926980 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.926956 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e65fc22-e005-4dbd-97ac-cf0d6e394117-tmp\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:49.935129 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.935092 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm926\" (UniqueName: \"kubernetes.io/projected/58109363-0ac2-4352-85c2-c2489c2e3e64-kube-api-access-cm926\") pod \"odh-model-controller-7998c67dc4-hvdpk\" (UID: \"58109363-0ac2-4352-85c2-c2489c2e3e64\") " pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:49.935724 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:49.935705 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzkc6\" (UniqueName: \"kubernetes.io/projected/5e65fc22-e005-4dbd-97ac-cf0d6e394117-kube-api-access-dzkc6\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:50.429773 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.429733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e65fc22-e005-4dbd-97ac-cf0d6e394117-tls-certs\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:50.429992 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.429794 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58109363-0ac2-4352-85c2-c2489c2e3e64-cert\") pod \"odh-model-controller-7998c67dc4-hvdpk\" (UID: \"58109363-0ac2-4352-85c2-c2489c2e3e64\") " pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:50.432831 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.432764 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e65fc22-e005-4dbd-97ac-cf0d6e394117-tls-certs\") pod \"kube-auth-proxy-66cfd9dd7c-zn2lq\" (UID: \"5e65fc22-e005-4dbd-97ac-cf0d6e394117\") " pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:50.432831 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.432765 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58109363-0ac2-4352-85c2-c2489c2e3e64-cert\") pod \"odh-model-controller-7998c67dc4-hvdpk\" (UID: \"58109363-0ac2-4352-85c2-c2489c2e3e64\") " pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:50.585055 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.585017 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vd9x9"] Jul 14 10:06:50.587503 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.587477 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:06:50.587633 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.587517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" Jul 14 10:06:50.590171 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.590144 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 14 10:06:50.593518 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.593492 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:50.604073 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.604044 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vd9x9"] Jul 14 10:06:50.732390 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.732356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7882\" (UniqueName: \"kubernetes.io/projected/0a81b349-8442-4865-873f-90371db2d6d8-kube-api-access-c7882\") pod \"model-serving-api-54d89bd5fc-vd9x9\" (UID: \"0a81b349-8442-4865-873f-90371db2d6d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:06:50.732783 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.732504 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a81b349-8442-4865-873f-90371db2d6d8-tls-certs\") pod \"model-serving-api-54d89bd5fc-vd9x9\" (UID: \"0a81b349-8442-4865-873f-90371db2d6d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:06:50.742707 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.742674 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq"] Jul 14 10:06:50.746143 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:06:50.746114 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e65fc22_e005_4dbd_97ac_cf0d6e394117.slice/crio-5bc3200211f20a02ff447ef523a80a1d1c715392e51b3fea0f507ed4b70f3464 WatchSource:0}: Error finding container 5bc3200211f20a02ff447ef523a80a1d1c715392e51b3fea0f507ed4b70f3464: Status 404 returned error can't find the container with id 5bc3200211f20a02ff447ef523a80a1d1c715392e51b3fea0f507ed4b70f3464 Jul 14 10:06:50.766726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.766644 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hvdpk"] Jul 14 10:06:50.768865 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:06:50.768829 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58109363_0ac2_4352_85c2_c2489c2e3e64.slice/crio-d9fe4a7523abf815252a2b55e014366ba6b97e973a91765eccb274facf2d35fe WatchSource:0}: Error finding container d9fe4a7523abf815252a2b55e014366ba6b97e973a91765eccb274facf2d35fe: Status 404 returned error can't find the container with id d9fe4a7523abf815252a2b55e014366ba6b97e973a91765eccb274facf2d35fe Jul 14 10:06:50.833772 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.833735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a81b349-8442-4865-873f-90371db2d6d8-tls-certs\") pod \"model-serving-api-54d89bd5fc-vd9x9\" (UID: \"0a81b349-8442-4865-873f-90371db2d6d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:06:50.834011 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.833790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7882\" (UniqueName: \"kubernetes.io/projected/0a81b349-8442-4865-873f-90371db2d6d8-kube-api-access-c7882\") pod \"model-serving-api-54d89bd5fc-vd9x9\" (UID: \"0a81b349-8442-4865-873f-90371db2d6d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:06:50.836558 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.836529 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a81b349-8442-4865-873f-90371db2d6d8-tls-certs\") pod \"model-serving-api-54d89bd5fc-vd9x9\" (UID: \"0a81b349-8442-4865-873f-90371db2d6d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:06:50.845183 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.845155 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7882\" (UniqueName: \"kubernetes.io/projected/0a81b349-8442-4865-873f-90371db2d6d8-kube-api-access-c7882\") pod \"model-serving-api-54d89bd5fc-vd9x9\" (UID: \"0a81b349-8442-4865-873f-90371db2d6d8\") " pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:06:50.899054 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:50.899018 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:06:51.056771 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.056597 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vd9x9"] Jul 14 10:06:51.074165 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.074125 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4"] Jul 14 10:06:51.077407 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.077382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.080690 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.080654 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 10:06:51.080856 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.080728 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 10:06:51.080919 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.080890 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 10:06:51.081091 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.081072 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-psm7t\"" Jul 14 10:06:51.081312 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.081298 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 10:06:51.088842 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.088818 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4"] Jul 14 10:06:51.102587 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.102550 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" event={"ID":"5e65fc22-e005-4dbd-97ac-cf0d6e394117","Type":"ContainerStarted","Data":"5bc3200211f20a02ff447ef523a80a1d1c715392e51b3fea0f507ed4b70f3464"} Jul 14 10:06:51.103714 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.103689 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" event={"ID":"58109363-0ac2-4352-85c2-c2489c2e3e64","Type":"ContainerStarted","Data":"d9fe4a7523abf815252a2b55e014366ba6b97e973a91765eccb274facf2d35fe"} Jul 14 10:06:51.104781 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.104759 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" event={"ID":"0a81b349-8442-4865-873f-90371db2d6d8","Type":"ContainerStarted","Data":"8853d88e16477c54466e8c86017fc908b6afa157f78fbf564a5a1c8889b867ca"} Jul 14 10:06:51.237999 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.237895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch8fw\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-kube-api-access-ch8fw\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.237999 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.237949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4552e173-0b24-4b28-b6f5-01582284b18c-local-certs\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.237999 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.237976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.238253 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.238026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-cacerts\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.238253 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.238055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.238253 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.238082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-istio-token\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.238253 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.238126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.339344 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.339309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8fw\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-kube-api-access-ch8fw\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.339526 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.339355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4552e173-0b24-4b28-b6f5-01582284b18c-local-certs\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.339526 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.339379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.339526 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.339411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-cacerts\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.339526 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.339444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.339526 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.339473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-istio-token\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.339526 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.339513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.340369 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.340305 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.342097 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.342063 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4552e173-0b24-4b28-b6f5-01582284b18c-local-certs\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.342503 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.342471 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-cacerts\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.342600 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.342557 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.342821 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.342780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.348925 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.348894 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-istio-token\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.349737 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.349710 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch8fw\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-kube-api-access-ch8fw\") pod \"istiod-openshift-gateway-7574459656-mkmz4\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.388750 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.388712 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:51.569279 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:51.569214 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4"] Jul 14 10:06:51.574640 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:06:51.574599 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4552e173_0b24_4b28_b6f5_01582284b18c.slice/crio-2170412bfc58dfba8c9b94e04daec855d2bb6b6f3a097afe75d8dcad647a3265 WatchSource:0}: Error finding container 2170412bfc58dfba8c9b94e04daec855d2bb6b6f3a097afe75d8dcad647a3265: Status 404 returned error can't find the container with id 2170412bfc58dfba8c9b94e04daec855d2bb6b6f3a097afe75d8dcad647a3265 Jul 14 10:06:52.113307 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:52.113264 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" event={"ID":"4552e173-0b24-4b28-b6f5-01582284b18c","Type":"ContainerStarted","Data":"2170412bfc58dfba8c9b94e04daec855d2bb6b6f3a097afe75d8dcad647a3265"} Jul 14 10:06:55.130829 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:55.130767 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" event={"ID":"0a81b349-8442-4865-873f-90371db2d6d8","Type":"ContainerStarted","Data":"d90f7df6ea8dbdd3e4273a5f22dc0a7d3129757908e67d7fbf7899155251b17a"} Jul 14 10:06:55.131298 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:55.130890 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:06:55.132716 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:55.132679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" event={"ID":"5e65fc22-e005-4dbd-97ac-cf0d6e394117","Type":"ContainerStarted","Data":"62fa0270b94ea0f0a02cf0bf02e9ac53cd945de97593023949c050ba4be1257f"} Jul 14 10:06:55.134205 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:55.134178 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" event={"ID":"58109363-0ac2-4352-85c2-c2489c2e3e64","Type":"ContainerStarted","Data":"50ae6cccbf17b8d4de622eb42a762b9888bc2c68c255ea6673919407e9d62be3"} Jul 14 10:06:55.134342 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:55.134321 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:06:55.151781 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:55.151728 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" podStartSLOduration=1.296179532 podStartE2EDuration="5.151711746s" totalImagesPullingTime="3.855532214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:06:55.150299038 +0000 UTC m=+403.247687240" watchObservedRunningTime="2026-07-14 10:06:55.151711746 +0000 UTC m=+403.249099948" Jul 14 10:06:55.170161 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:55.170062 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66cfd9dd7c-zn2lq" podStartSLOduration=2.821821053 podStartE2EDuration="6.170042823s" totalImagesPullingTime="3.34822177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:06:55.168106556 +0000 UTC m=+403.265494780" watchObservedRunningTime="2026-07-14 10:06:55.170042823 +0000 UTC m=+403.267431022" Jul 14 10:06:55.185318 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:55.185266 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" podStartSLOduration=2.858692664 podStartE2EDuration="6.185248934s" totalImagesPullingTime="3.32655627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:06:55.183714101 +0000 UTC m=+403.281102304" watchObservedRunningTime="2026-07-14 10:06:55.185248934 +0000 UTC m=+403.282637320" Jul 14 10:06:56.006332 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:56.006294 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 14 10:06:56.006433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:56.006364 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 14 10:06:56.140777 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:56.140742 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" event={"ID":"4552e173-0b24-4b28-b6f5-01582284b18c","Type":"ContainerStarted","Data":"ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c"} Jul 14 10:06:56.141278 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:56.141040 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:06:56.166542 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:56.166491 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" podStartSLOduration=0.737216956 podStartE2EDuration="5.166473497s" totalImagesPullingTime="4.429256541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:06:56.164569015 +0000 UTC m=+404.261957217" watchObservedRunningTime="2026-07-14 10:06:56.166473497 +0000 UTC m=+404.263861699" Jul 14 10:06:57.147595 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:06:57.147569 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:07:00.022975 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.022923 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd"] Jul 14 10:07:00.026368 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.026343 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:00.029373 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.029346 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 10:07:00.029512 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.029385 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tnrfr\"" Jul 14 10:07:00.042414 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.042370 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd"] Jul 14 10:07:00.127944 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.127908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b71d1e2-c4d2-49f8-8ac2-2011988960f9-cert\") pod \"kserve-controller-manager-d6f4b65b8-7wbvd\" (UID: \"1b71d1e2-c4d2-49f8-8ac2-2011988960f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:00.128135 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.127981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhrdb\" (UniqueName: \"kubernetes.io/projected/1b71d1e2-c4d2-49f8-8ac2-2011988960f9-kube-api-access-qhrdb\") pod \"kserve-controller-manager-d6f4b65b8-7wbvd\" (UID: \"1b71d1e2-c4d2-49f8-8ac2-2011988960f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:00.228792 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.228752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b71d1e2-c4d2-49f8-8ac2-2011988960f9-cert\") pod \"kserve-controller-manager-d6f4b65b8-7wbvd\" (UID: \"1b71d1e2-c4d2-49f8-8ac2-2011988960f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:00.228993 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.228871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhrdb\" (UniqueName: \"kubernetes.io/projected/1b71d1e2-c4d2-49f8-8ac2-2011988960f9-kube-api-access-qhrdb\") pod \"kserve-controller-manager-d6f4b65b8-7wbvd\" (UID: \"1b71d1e2-c4d2-49f8-8ac2-2011988960f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:00.231376 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.231346 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b71d1e2-c4d2-49f8-8ac2-2011988960f9-cert\") pod \"kserve-controller-manager-d6f4b65b8-7wbvd\" (UID: \"1b71d1e2-c4d2-49f8-8ac2-2011988960f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:00.242505 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.242475 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhrdb\" (UniqueName: \"kubernetes.io/projected/1b71d1e2-c4d2-49f8-8ac2-2011988960f9-kube-api-access-qhrdb\") pod \"kserve-controller-manager-d6f4b65b8-7wbvd\" (UID: \"1b71d1e2-c4d2-49f8-8ac2-2011988960f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:00.336852 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.336776 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:00.484007 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:00.483981 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd"] Jul 14 10:07:00.486466 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:07:00.486434 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b71d1e2_c4d2_49f8_8ac2_2011988960f9.slice/crio-e2aa2d80b9086bd7d22ee9127bdb33e5c0bb8bc0fd3f047618aabcce4ee3e12d WatchSource:0}: Error finding container e2aa2d80b9086bd7d22ee9127bdb33e5c0bb8bc0fd3f047618aabcce4ee3e12d: Status 404 returned error can't find the container with id e2aa2d80b9086bd7d22ee9127bdb33e5c0bb8bc0fd3f047618aabcce4ee3e12d Jul 14 10:07:01.164275 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:01.164228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" event={"ID":"1b71d1e2-c4d2-49f8-8ac2-2011988960f9","Type":"ContainerStarted","Data":"e2aa2d80b9086bd7d22ee9127bdb33e5c0bb8bc0fd3f047618aabcce4ee3e12d"} Jul 14 10:07:02.800167 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:02.800124 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4"] Jul 14 10:07:02.800671 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:02.800372 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" podUID="4552e173-0b24-4b28-b6f5-01582284b18c" containerName="discovery" containerID="cri-o://ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c" gracePeriod=30 Jul 14 10:07:03.105041 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.105010 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:07:03.158876 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.158842 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-dns-cert\") pod \"4552e173-0b24-4b28-b6f5-01582284b18c\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " Jul 14 10:07:03.158876 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.158886 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-ca-configmap\") pod \"4552e173-0b24-4b28-b6f5-01582284b18c\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " Jul 14 10:07:03.159113 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.158912 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-istio-token\") pod \"4552e173-0b24-4b28-b6f5-01582284b18c\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " Jul 14 10:07:03.159113 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.158953 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch8fw\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-kube-api-access-ch8fw\") pod \"4552e173-0b24-4b28-b6f5-01582284b18c\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " Jul 14 10:07:03.159113 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.158986 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-kubeconfig\") pod \"4552e173-0b24-4b28-b6f5-01582284b18c\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " Jul 14 10:07:03.159271 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.159119 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-cacerts\") pod \"4552e173-0b24-4b28-b6f5-01582284b18c\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " Jul 14 10:07:03.159271 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.159191 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4552e173-0b24-4b28-b6f5-01582284b18c-local-certs\") pod \"4552e173-0b24-4b28-b6f5-01582284b18c\" (UID: \"4552e173-0b24-4b28-b6f5-01582284b18c\") " Jul 14 10:07:03.159370 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.159284 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4552e173-0b24-4b28-b6f5-01582284b18c" (UID: "4552e173-0b24-4b28-b6f5-01582284b18c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:07:03.159499 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.159479 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-ca-configmap\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:07:03.161695 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.161666 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-cacerts" (OuterVolumeSpecName: "cacerts") pod "4552e173-0b24-4b28-b6f5-01582284b18c" (UID: "4552e173-0b24-4b28-b6f5-01582284b18c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:07:03.161917 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.161883 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4552e173-0b24-4b28-b6f5-01582284b18c" (UID: "4552e173-0b24-4b28-b6f5-01582284b18c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:07:03.161917 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.161889 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4552e173-0b24-4b28-b6f5-01582284b18c-local-certs" (OuterVolumeSpecName: "local-certs") pod "4552e173-0b24-4b28-b6f5-01582284b18c" (UID: "4552e173-0b24-4b28-b6f5-01582284b18c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:07:03.162094 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.161968 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-kube-api-access-ch8fw" (OuterVolumeSpecName: "kube-api-access-ch8fw") pod "4552e173-0b24-4b28-b6f5-01582284b18c" (UID: "4552e173-0b24-4b28-b6f5-01582284b18c"). InnerVolumeSpecName "kube-api-access-ch8fw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:07:03.162155 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.162117 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-istio-token" (OuterVolumeSpecName: "istio-token") pod "4552e173-0b24-4b28-b6f5-01582284b18c" (UID: "4552e173-0b24-4b28-b6f5-01582284b18c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:07:03.162209 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.162165 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4552e173-0b24-4b28-b6f5-01582284b18c" (UID: "4552e173-0b24-4b28-b6f5-01582284b18c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:07:03.174407 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.174375 2561 generic.go:356] "Generic (PLEG): container finished" podID="4552e173-0b24-4b28-b6f5-01582284b18c" containerID="ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c" exitCode=0 Jul 14 10:07:03.174542 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.174432 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" Jul 14 10:07:03.174542 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.174461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" event={"ID":"4552e173-0b24-4b28-b6f5-01582284b18c","Type":"ContainerDied","Data":"ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c"} Jul 14 10:07:03.174542 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.174522 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4" event={"ID":"4552e173-0b24-4b28-b6f5-01582284b18c","Type":"ContainerDied","Data":"2170412bfc58dfba8c9b94e04daec855d2bb6b6f3a097afe75d8dcad647a3265"} Jul 14 10:07:03.174691 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.174549 2561 scope.go:117] "RemoveContainer" containerID="ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c" Jul 14 10:07:03.176779 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.176725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" event={"ID":"1b71d1e2-c4d2-49f8-8ac2-2011988960f9","Type":"ContainerStarted","Data":"48032a11474a8ead9144873d9756fa079ac554c274574aae872c478a26c1394e"} Jul 14 10:07:03.176968 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.176946 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:03.184237 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.184056 2561 scope.go:117] "RemoveContainer" containerID="ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c" Jul 14 10:07:03.184493 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:07:03.184465 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c\": container with ID starting with ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c not found: ID does not exist" containerID="ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c" Jul 14 10:07:03.184585 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.184506 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c"} err="failed to get container status \"ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c\": rpc error: code = NotFound desc = could not find container \"ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c\": container with ID starting with ada7c5bc7f6d713df2cf69e106a169e4ba65319c78c1ed739442b786ac16b50c not found: ID does not exist" Jul 14 10:07:03.197282 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.197231 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" podStartSLOduration=0.67804907 podStartE2EDuration="3.197217054s" totalImagesPullingTime="2.519167984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:07:03.195691386 +0000 UTC m=+411.293079589" watchObservedRunningTime="2026-07-14 10:07:03.197217054 +0000 UTC m=+411.294605256" Jul 14 10:07:03.210400 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.210372 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4"] Jul 14 10:07:03.214391 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.214371 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mkmz4"] Jul 14 10:07:03.260345 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.260309 2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4552e173-0b24-4b28-b6f5-01582284b18c-local-certs\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:07:03.260345 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.260338 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-csr-dns-cert\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:07:03.260345 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.260348 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-istio-token\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:07:03.260345 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.260357 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch8fw\" (UniqueName: \"kubernetes.io/projected/4552e173-0b24-4b28-b6f5-01582284b18c-kube-api-access-ch8fw\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:07:03.260695 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.260365 2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-istio-kubeconfig\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:07:03.260695 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:03.260373 2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4552e173-0b24-4b28-b6f5-01582284b18c-cacerts\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:07:04.448785 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:04.448741 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4552e173-0b24-4b28-b6f5-01582284b18c" path="/var/lib/kubelet/pods/4552e173-0b24-4b28-b6f5-01582284b18c/volumes" Jul 14 10:07:06.143343 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:06.143303 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hvdpk" Jul 14 10:07:06.145134 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:06.145115 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vd9x9" Jul 14 10:07:34.187971 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:34.187873 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wbvd" Jul 14 10:07:50.242455 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.242414 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd78p"] Jul 14 10:07:50.242938 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.242746 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4552e173-0b24-4b28-b6f5-01582284b18c" containerName="discovery" Jul 14 10:07:50.242938 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.242757 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4552e173-0b24-4b28-b6f5-01582284b18c" containerName="discovery" Jul 14 10:07:50.242938 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.242838 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4552e173-0b24-4b28-b6f5-01582284b18c" containerName="discovery" Jul 14 10:07:50.244951 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.244924 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" Jul 14 10:07:50.247845 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.247820 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 10:07:50.248087 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.248069 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 10:07:50.249096 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.249076 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gmwlz\"" Jul 14 10:07:50.255686 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.255656 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd78p"] Jul 14 10:07:50.264904 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.264872 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g5mh\" (UniqueName: \"kubernetes.io/projected/8c51fb53-0954-4bd9-822d-fec3d687eb3e-kube-api-access-9g5mh\") pod \"kuadrant-operator-catalog-kd78p\" (UID: \"8c51fb53-0954-4bd9-822d-fec3d687eb3e\") " pod="kuadrant-system/kuadrant-operator-catalog-kd78p" Jul 14 10:07:50.366092 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.366046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g5mh\" (UniqueName: \"kubernetes.io/projected/8c51fb53-0954-4bd9-822d-fec3d687eb3e-kube-api-access-9g5mh\") pod \"kuadrant-operator-catalog-kd78p\" (UID: \"8c51fb53-0954-4bd9-822d-fec3d687eb3e\") " pod="kuadrant-system/kuadrant-operator-catalog-kd78p" Jul 14 10:07:50.374020 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.373999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g5mh\" (UniqueName: \"kubernetes.io/projected/8c51fb53-0954-4bd9-822d-fec3d687eb3e-kube-api-access-9g5mh\") pod \"kuadrant-operator-catalog-kd78p\" (UID: \"8c51fb53-0954-4bd9-822d-fec3d687eb3e\") " pod="kuadrant-system/kuadrant-operator-catalog-kd78p" Jul 14 10:07:50.557076 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.557040 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" Jul 14 10:07:50.595898 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.595861 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd78p"] Jul 14 10:07:50.695386 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.695358 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd78p"] Jul 14 10:07:50.697988 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:07:50.697957 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c51fb53_0954_4bd9_822d_fec3d687eb3e.slice/crio-f0fb8994182f695e179aeb5a3b5dfaf3c57f01599e5b9344fa99fda0e088703c WatchSource:0}: Error finding container f0fb8994182f695e179aeb5a3b5dfaf3c57f01599e5b9344fa99fda0e088703c: Status 404 returned error can't find the container with id f0fb8994182f695e179aeb5a3b5dfaf3c57f01599e5b9344fa99fda0e088703c Jul 14 10:07:50.805710 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.805676 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b7tzw"] Jul 14 10:07:50.809181 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.809130 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" Jul 14 10:07:50.817143 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.817104 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b7tzw"] Jul 14 10:07:50.869948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.869914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pbs4\" (UniqueName: \"kubernetes.io/projected/605243f9-ae2f-445a-a752-e9467c9c24e3-kube-api-access-2pbs4\") pod \"kuadrant-operator-catalog-b7tzw\" (UID: \"605243f9-ae2f-445a-a752-e9467c9c24e3\") " pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" Jul 14 10:07:50.970929 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.970892 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pbs4\" (UniqueName: \"kubernetes.io/projected/605243f9-ae2f-445a-a752-e9467c9c24e3-kube-api-access-2pbs4\") pod \"kuadrant-operator-catalog-b7tzw\" (UID: \"605243f9-ae2f-445a-a752-e9467c9c24e3\") " pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" Jul 14 10:07:50.979056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:50.979016 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pbs4\" (UniqueName: \"kubernetes.io/projected/605243f9-ae2f-445a-a752-e9467c9c24e3-kube-api-access-2pbs4\") pod \"kuadrant-operator-catalog-b7tzw\" (UID: \"605243f9-ae2f-445a-a752-e9467c9c24e3\") " pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" Jul 14 10:07:51.119970 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:51.119872 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" Jul 14 10:07:51.265628 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:51.265594 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b7tzw"] Jul 14 10:07:51.267907 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:07:51.267879 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605243f9_ae2f_445a_a752_e9467c9c24e3.slice/crio-cbbd1a572481d29cf6882c6286432b0d0c2aa72f3ff2cc17144679324b4c1f95 WatchSource:0}: Error finding container cbbd1a572481d29cf6882c6286432b0d0c2aa72f3ff2cc17144679324b4c1f95: Status 404 returned error can't find the container with id cbbd1a572481d29cf6882c6286432b0d0c2aa72f3ff2cc17144679324b4c1f95 Jul 14 10:07:51.389533 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:51.389449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" event={"ID":"8c51fb53-0954-4bd9-822d-fec3d687eb3e","Type":"ContainerStarted","Data":"f0fb8994182f695e179aeb5a3b5dfaf3c57f01599e5b9344fa99fda0e088703c"} Jul 14 10:07:51.390642 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:51.390620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" event={"ID":"605243f9-ae2f-445a-a752-e9467c9c24e3","Type":"ContainerStarted","Data":"cbbd1a572481d29cf6882c6286432b0d0c2aa72f3ff2cc17144679324b4c1f95"} Jul 14 10:07:53.402094 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:53.402040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" event={"ID":"8c51fb53-0954-4bd9-822d-fec3d687eb3e","Type":"ContainerStarted","Data":"b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5"} Jul 14 10:07:53.402586 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:53.402099 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" podUID="8c51fb53-0954-4bd9-822d-fec3d687eb3e" containerName="registry-server" containerID="cri-o://b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5" gracePeriod=2 Jul 14 10:07:53.403756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:53.403683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" event={"ID":"605243f9-ae2f-445a-a752-e9467c9c24e3","Type":"ContainerStarted","Data":"9d56522654c41f52cb9837ac6a1810e20bd9ee82c4a42c03a18fc0ed995e782f"} Jul 14 10:07:53.420049 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:53.420006 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" podStartSLOduration=0.957293824 podStartE2EDuration="3.419990686s" totalImagesPullingTime="2.462696862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:07:53.41861429 +0000 UTC m=+461.516002493" watchObservedRunningTime="2026-07-14 10:07:53.419990686 +0000 UTC m=+461.517378887" Jul 14 10:07:53.435539 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:53.435496 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" podStartSLOduration=1.541699519 podStartE2EDuration="3.435480788s" totalImagesPullingTime="1.893781269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:07:53.43520283 +0000 UTC m=+461.532591032" watchObservedRunningTime="2026-07-14 10:07:53.435480788 +0000 UTC m=+461.532868989" Jul 14 10:07:53.651397 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:53.651371 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" Jul 14 10:07:53.692173 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:53.692083 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g5mh\" (UniqueName: \"kubernetes.io/projected/8c51fb53-0954-4bd9-822d-fec3d687eb3e-kube-api-access-9g5mh\") pod \"8c51fb53-0954-4bd9-822d-fec3d687eb3e\" (UID: \"8c51fb53-0954-4bd9-822d-fec3d687eb3e\") " Jul 14 10:07:53.694388 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:53.694362 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c51fb53-0954-4bd9-822d-fec3d687eb3e-kube-api-access-9g5mh" (OuterVolumeSpecName: "kube-api-access-9g5mh") pod "8c51fb53-0954-4bd9-822d-fec3d687eb3e" (UID: "8c51fb53-0954-4bd9-822d-fec3d687eb3e"). InnerVolumeSpecName "kube-api-access-9g5mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:07:53.793044 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:53.792986 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g5mh\" (UniqueName: \"kubernetes.io/projected/8c51fb53-0954-4bd9-822d-fec3d687eb3e-kube-api-access-9g5mh\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:07:54.409670 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.409633 2561 generic.go:356] "Generic (PLEG): container finished" podID="8c51fb53-0954-4bd9-822d-fec3d687eb3e" containerID="b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5" exitCode=0 Jul 14 10:07:54.410127 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.409676 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" Jul 14 10:07:54.410127 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.409727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" event={"ID":"8c51fb53-0954-4bd9-822d-fec3d687eb3e","Type":"ContainerDied","Data":"b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5"} Jul 14 10:07:54.410127 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.409781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kd78p" event={"ID":"8c51fb53-0954-4bd9-822d-fec3d687eb3e","Type":"ContainerDied","Data":"f0fb8994182f695e179aeb5a3b5dfaf3c57f01599e5b9344fa99fda0e088703c"} Jul 14 10:07:54.410127 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.409825 2561 scope.go:117] "RemoveContainer" containerID="b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5" Jul 14 10:07:54.419081 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.419061 2561 scope.go:117] "RemoveContainer" containerID="b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5" Jul 14 10:07:54.419364 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:07:54.419345 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5\": container with ID starting with b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5 not found: ID does not exist" containerID="b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5" Jul 14 10:07:54.419421 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.419374 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5"} err="failed to get container status \"b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5\": rpc error: code = NotFound desc = could not find container \"b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5\": container with ID starting with b4dc692e30d3d7ab8490f6bdd3a47e44ca8317f59bce2dc864ec1bb4ca2979a5 not found: ID does not exist" Jul 14 10:07:54.430578 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.430549 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd78p"] Jul 14 10:07:54.434855 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.434779 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd78p"] Jul 14 10:07:54.449121 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:07:54.449093 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c51fb53-0954-4bd9-822d-fec3d687eb3e" path="/var/lib/kubelet/pods/8c51fb53-0954-4bd9-822d-fec3d687eb3e/volumes" Jul 14 10:08:01.120074 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:01.120032 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" Jul 14 10:08:01.120547 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:01.120095 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" Jul 14 10:08:01.143599 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:01.143571 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" Jul 14 10:08:01.463718 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:01.463633 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-b7tzw" Jul 14 10:08:25.681351 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.681305 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dp28k"] Jul 14 10:08:25.681875 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.681771 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c51fb53-0954-4bd9-822d-fec3d687eb3e" containerName="registry-server" Jul 14 10:08:25.681875 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.681790 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c51fb53-0954-4bd9-822d-fec3d687eb3e" containerName="registry-server" Jul 14 10:08:25.682001 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.681948 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c51fb53-0954-4bd9-822d-fec3d687eb3e" containerName="registry-server" Jul 14 10:08:25.684747 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.684724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" Jul 14 10:08:25.687215 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.687194 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tt89r\"" Jul 14 10:08:25.693425 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.693398 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dp28k"] Jul 14 10:08:25.760153 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.760116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqjzb\" (UniqueName: \"kubernetes.io/projected/8b5ee7eb-3c58-44fc-be37-d0d9027e1785-kube-api-access-sqjzb\") pod \"authorino-operator-75cc8d5cb7-dp28k\" (UID: \"8b5ee7eb-3c58-44fc-be37-d0d9027e1785\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" Jul 14 10:08:25.860719 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.860685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqjzb\" (UniqueName: \"kubernetes.io/projected/8b5ee7eb-3c58-44fc-be37-d0d9027e1785-kube-api-access-sqjzb\") pod \"authorino-operator-75cc8d5cb7-dp28k\" (UID: \"8b5ee7eb-3c58-44fc-be37-d0d9027e1785\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" Jul 14 10:08:25.887974 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.887934 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqjzb\" (UniqueName: \"kubernetes.io/projected/8b5ee7eb-3c58-44fc-be37-d0d9027e1785-kube-api-access-sqjzb\") pod \"authorino-operator-75cc8d5cb7-dp28k\" (UID: \"8b5ee7eb-3c58-44fc-be37-d0d9027e1785\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" Jul 14 10:08:25.995954 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:25.995858 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" Jul 14 10:08:26.133255 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:26.133228 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dp28k"] Jul 14 10:08:26.135598 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:08:26.135567 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5ee7eb_3c58_44fc_be37_d0d9027e1785.slice/crio-0c4190ad23085eaa01d1a2de0f9b357fd21cdf2565c8276b6221113427d7cd65 WatchSource:0}: Error finding container 0c4190ad23085eaa01d1a2de0f9b357fd21cdf2565c8276b6221113427d7cd65: Status 404 returned error can't find the container with id 0c4190ad23085eaa01d1a2de0f9b357fd21cdf2565c8276b6221113427d7cd65 Jul 14 10:08:26.554072 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:26.554027 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" event={"ID":"8b5ee7eb-3c58-44fc-be37-d0d9027e1785","Type":"ContainerStarted","Data":"0c4190ad23085eaa01d1a2de0f9b357fd21cdf2565c8276b6221113427d7cd65"} Jul 14 10:08:29.570859 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:29.570823 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" event={"ID":"8b5ee7eb-3c58-44fc-be37-d0d9027e1785","Type":"ContainerStarted","Data":"0a2779e46c250eca69fe1a43854aaec819f04308de1e3648ff69b171b62934bf"} Jul 14 10:08:29.571269 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:29.570880 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" Jul 14 10:08:29.588075 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:29.588024 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" podStartSLOduration=2.135595718 podStartE2EDuration="4.588010104s" totalImagesPullingTime="2.452414386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:08:29.587786344 +0000 UTC m=+497.685174545" watchObservedRunningTime="2026-07-14 10:08:29.588010104 +0000 UTC m=+497.685398307" Jul 14 10:08:30.593205 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.593173 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7"] Jul 14 10:08:30.596589 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.596568 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:30.599334 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.599311 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h9tp9\"" Jul 14 10:08:30.609480 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.609455 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7"] Jul 14 10:08:30.708610 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.708575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" (UID: \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:30.708610 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.708614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdljr\" (UniqueName: \"kubernetes.io/projected/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-kube-api-access-vdljr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" (UID: \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:30.809903 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.809866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdljr\" (UniqueName: \"kubernetes.io/projected/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-kube-api-access-vdljr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" (UID: \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:30.810127 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.809983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" (UID: \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:30.810348 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.810331 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" (UID: \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:30.818393 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.818359 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdljr\" (UniqueName: \"kubernetes.io/projected/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-kube-api-access-vdljr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" (UID: \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:30.906377 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:30.906283 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:31.067982 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:31.067958 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7"] Jul 14 10:08:31.070077 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:08:31.070046 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c59f0ed_0268_4b7c_bdd0_02cb7ea5e978.slice/crio-8d5278b16c7861334844023316007dd665a1987353a0d283639cb9d1dd6152c4 WatchSource:0}: Error finding container 8d5278b16c7861334844023316007dd665a1987353a0d283639cb9d1dd6152c4: Status 404 returned error can't find the container with id 8d5278b16c7861334844023316007dd665a1987353a0d283639cb9d1dd6152c4 Jul 14 10:08:31.586147 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:31.586114 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" event={"ID":"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978","Type":"ContainerStarted","Data":"8d5278b16c7861334844023316007dd665a1987353a0d283639cb9d1dd6152c4"} Jul 14 10:08:34.018100 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.018066 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx"] Jul 14 10:08:34.021562 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.021540 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" Jul 14 10:08:34.024400 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.024377 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mlprs\"" Jul 14 10:08:34.024532 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.024423 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 10:08:34.031761 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.031733 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx"] Jul 14 10:08:34.140655 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.140614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzks5\" (UniqueName: \"kubernetes.io/projected/d2982406-ba9a-4a2d-9286-f4c54346b2c5-kube-api-access-mzks5\") pod \"dns-operator-controller-manager-864dd78c4c-wf7tx\" (UID: \"d2982406-ba9a-4a2d-9286-f4c54346b2c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" Jul 14 10:08:34.241919 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.241878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzks5\" (UniqueName: \"kubernetes.io/projected/d2982406-ba9a-4a2d-9286-f4c54346b2c5-kube-api-access-mzks5\") pod \"dns-operator-controller-manager-864dd78c4c-wf7tx\" (UID: \"d2982406-ba9a-4a2d-9286-f4c54346b2c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" Jul 14 10:08:34.251092 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.251058 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzks5\" (UniqueName: \"kubernetes.io/projected/d2982406-ba9a-4a2d-9286-f4c54346b2c5-kube-api-access-mzks5\") pod \"dns-operator-controller-manager-864dd78c4c-wf7tx\" (UID: \"d2982406-ba9a-4a2d-9286-f4c54346b2c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" Jul 14 10:08:34.335898 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.335861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" Jul 14 10:08:34.510656 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.510622 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx"] Jul 14 10:08:34.512387 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:08:34.512348 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2982406_ba9a_4a2d_9286_f4c54346b2c5.slice/crio-a1b34c8fdb2f7a2ab52c69aad16675b009d5e7031093547f44151cb6332f5b81 WatchSource:0}: Error finding container a1b34c8fdb2f7a2ab52c69aad16675b009d5e7031093547f44151cb6332f5b81: Status 404 returned error can't find the container with id a1b34c8fdb2f7a2ab52c69aad16675b009d5e7031093547f44151cb6332f5b81 Jul 14 10:08:34.601608 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:34.601522 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" event={"ID":"d2982406-ba9a-4a2d-9286-f4c54346b2c5","Type":"ContainerStarted","Data":"a1b34c8fdb2f7a2ab52c69aad16675b009d5e7031093547f44151cb6332f5b81"} Jul 14 10:08:36.679958 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:36.679919 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c"] Jul 14 10:08:36.683521 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:36.683493 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:36.686389 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:36.686363 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cvq7t\"" Jul 14 10:08:36.695323 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:36.695253 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c"] Jul 14 10:08:36.766777 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:36.766732 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvrhp\" (UniqueName: \"kubernetes.io/projected/8ea20c2b-d28c-4784-91d4-4491cc7f9965-kube-api-access-rvrhp\") pod \"limitador-operator-controller-manager-859d7b78bd-8wc7c\" (UID: \"8ea20c2b-d28c-4784-91d4-4491cc7f9965\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:36.868388 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:36.868346 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvrhp\" (UniqueName: \"kubernetes.io/projected/8ea20c2b-d28c-4784-91d4-4491cc7f9965-kube-api-access-rvrhp\") pod \"limitador-operator-controller-manager-859d7b78bd-8wc7c\" (UID: \"8ea20c2b-d28c-4784-91d4-4491cc7f9965\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:36.884164 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:36.884127 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvrhp\" (UniqueName: \"kubernetes.io/projected/8ea20c2b-d28c-4784-91d4-4491cc7f9965-kube-api-access-rvrhp\") pod \"limitador-operator-controller-manager-859d7b78bd-8wc7c\" (UID: \"8ea20c2b-d28c-4784-91d4-4491cc7f9965\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:36.997737 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:36.997527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:38.212568 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:38.212543 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c"] Jul 14 10:08:38.215032 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:08:38.215007 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea20c2b_d28c_4784_91d4_4491cc7f9965.slice/crio-fbc3c3b69e4379fddf453034daaf2559055d887be17e5ef9d054b17471de243a WatchSource:0}: Error finding container fbc3c3b69e4379fddf453034daaf2559055d887be17e5ef9d054b17471de243a: Status 404 returned error can't find the container with id fbc3c3b69e4379fddf453034daaf2559055d887be17e5ef9d054b17471de243a Jul 14 10:08:38.625041 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:38.625005 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" event={"ID":"d2982406-ba9a-4a2d-9286-f4c54346b2c5","Type":"ContainerStarted","Data":"981174a4273d8b0994ab9c1ba278e891a71d0e49c198f43b8e9cc21e6a736e7e"} Jul 14 10:08:38.625232 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:38.625069 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" Jul 14 10:08:38.626818 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:38.626765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" event={"ID":"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978","Type":"ContainerStarted","Data":"596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a"} Jul 14 10:08:38.626940 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:38.626867 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:38.628984 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:38.628961 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" event={"ID":"8ea20c2b-d28c-4784-91d4-4491cc7f9965","Type":"ContainerStarted","Data":"fbc3c3b69e4379fddf453034daaf2559055d887be17e5ef9d054b17471de243a"} Jul 14 10:08:38.645913 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:38.645861 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" podStartSLOduration=1.096821131 podStartE2EDuration="4.645841775s" totalImagesPullingTime="3.549020644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:08:38.643089276 +0000 UTC m=+506.740477478" watchObservedRunningTime="2026-07-14 10:08:38.645841775 +0000 UTC m=+506.743229976" Jul 14 10:08:38.666751 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:38.666683 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" podStartSLOduration=1.66103223 podStartE2EDuration="8.666660586s" totalImagesPullingTime="7.005628356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:08:38.663888774 +0000 UTC m=+506.761276989" watchObservedRunningTime="2026-07-14 10:08:38.666660586 +0000 UTC m=+506.764048789" Jul 14 10:08:40.577232 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:40.577198 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dp28k" Jul 14 10:08:40.643242 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:40.643209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" event={"ID":"8ea20c2b-d28c-4784-91d4-4491cc7f9965","Type":"ContainerStarted","Data":"a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784"} Jul 14 10:08:40.643429 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:40.643413 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:40.676140 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:40.676086 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" podStartSLOduration=2.978399964 podStartE2EDuration="4.67606823s" totalImagesPullingTime="1.697668266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:08:40.675511815 +0000 UTC m=+508.772900018" watchObservedRunningTime="2026-07-14 10:08:40.67606823 +0000 UTC m=+508.773456431" Jul 14 10:08:49.637762 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:49.637726 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:49.638233 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:49.637914 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wf7tx" Jul 14 10:08:51.069221 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.069181 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk"] Jul 14 10:08:51.072598 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.072579 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:51.086398 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.086371 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk"] Jul 14 10:08:51.086953 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.086933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pgxq\" (UniqueName: \"kubernetes.io/projected/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-kube-api-access-7pgxq\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jzsk\" (UID: \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:51.087120 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.087091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jzsk\" (UID: \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:51.188541 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.188502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jzsk\" (UID: \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:51.188541 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.188543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pgxq\" (UniqueName: \"kubernetes.io/projected/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-kube-api-access-7pgxq\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jzsk\" (UID: \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:51.188963 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.188938 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jzsk\" (UID: \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:51.198826 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.198780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pgxq\" (UniqueName: \"kubernetes.io/projected/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-kube-api-access-7pgxq\") pod \"kuadrant-operator-controller-manager-55467d9f7-6jzsk\" (UID: \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:51.382953 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.382861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:51.527672 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.527636 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk"] Jul 14 10:08:51.530984 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:08:51.530942 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120d482d_1cdf_4a98_ac43_5b2dd613b6e6.slice/crio-20f50f18b73d647209524dde0355daf8a62764c115c525789b813126c7e326d2 WatchSource:0}: Error finding container 20f50f18b73d647209524dde0355daf8a62764c115c525789b813126c7e326d2: Status 404 returned error can't find the container with id 20f50f18b73d647209524dde0355daf8a62764c115c525789b813126c7e326d2 Jul 14 10:08:51.574397 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.574371 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk"] Jul 14 10:08:51.580475 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.580447 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk"] Jul 14 10:08:51.589734 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.589708 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7"] Jul 14 10:08:51.589965 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.589940 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" containerName="manager" containerID="cri-o://596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a" gracePeriod=2 Jul 14 10:08:51.601654 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.601628 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7"] Jul 14 10:08:51.603757 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.603332 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-whhc7\": pods \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:51.604084 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.604024 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86"] Jul 14 10:08:51.604611 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.604543 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" containerName="manager" Jul 14 10:08:51.604611 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.604564 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" containerName="manager" Jul 14 10:08:51.605085 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.604686 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" containerName="manager" Jul 14 10:08:51.608465 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.608444 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:08:51.614546 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.614516 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c"] Jul 14 10:08:51.614903 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.614835 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" containerName="manager" containerID="cri-o://a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784" gracePeriod=2 Jul 14 10:08:51.618134 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.618110 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:51.618588 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.618513 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm"] Jul 14 10:08:51.619059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.619031 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120d482d-1cdf-4a98-ac43-5b2dd613b6e6" containerName="manager" Jul 14 10:08:51.619059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.619053 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="120d482d-1cdf-4a98-ac43-5b2dd613b6e6" containerName="manager" Jul 14 10:08:51.619196 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.619159 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="120d482d-1cdf-4a98-ac43-5b2dd613b6e6" containerName="manager" Jul 14 10:08:51.622554 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.622327 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86"] Jul 14 10:08:51.622554 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.622432 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:08:51.622719 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.622695 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c"] Jul 14 10:08:51.633192 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.633133 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm"] Jul 14 10:08:51.636755 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.636714 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:51.639099 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.639077 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9"] Jul 14 10:08:51.639456 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.639440 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" containerName="manager" Jul 14 10:08:51.639531 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.639460 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" containerName="manager" Jul 14 10:08:51.639583 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.639564 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" containerName="manager" Jul 14 10:08:51.642511 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.642488 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" Jul 14 10:08:51.652884 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.652758 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9"] Jul 14 10:08:51.661309 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.661277 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8wc7c\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:51.663318 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.663286 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:51.689503 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.689464 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8wc7c\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:51.694342 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.694205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b2b3ae-1b93-4362-9d58-58df694bebb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7p8sm\" (UID: \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:08:51.694342 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.694256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtzvr\" (UniqueName: \"kubernetes.io/projected/b2b2b3ae-1b93-4362-9d58-58df694bebb8-kube-api-access-xtzvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7p8sm\" (UID: \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:08:51.694488 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.694349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9894c18-5858-4745-8c23-50881e3fa03b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjg86\" (UID: \"d9894c18-5858-4745-8c23-50881e3fa03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:08:51.694488 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.694406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8ntb\" (UniqueName: \"kubernetes.io/projected/3b3fe38f-d9c5-48a8-9eb8-334038d6db2b-kube-api-access-p8ntb\") pod \"limitador-operator-controller-manager-859d7b78bd-bdvq9\" (UID: \"3b3fe38f-d9c5-48a8-9eb8-334038d6db2b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" Jul 14 10:08:51.694488 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.694411 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:51.694488 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.694467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zr8v\" (UniqueName: \"kubernetes.io/projected/d9894c18-5858-4745-8c23-50881e3fa03b-kube-api-access-6zr8v\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjg86\" (UID: \"d9894c18-5858-4745-8c23-50881e3fa03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:08:51.795480 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.795440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9894c18-5858-4745-8c23-50881e3fa03b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjg86\" (UID: \"d9894c18-5858-4745-8c23-50881e3fa03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:08:51.795646 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.795511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8ntb\" (UniqueName: \"kubernetes.io/projected/3b3fe38f-d9c5-48a8-9eb8-334038d6db2b-kube-api-access-p8ntb\") pod \"limitador-operator-controller-manager-859d7b78bd-bdvq9\" (UID: \"3b3fe38f-d9c5-48a8-9eb8-334038d6db2b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" Jul 14 10:08:51.795646 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.795560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zr8v\" (UniqueName: \"kubernetes.io/projected/d9894c18-5858-4745-8c23-50881e3fa03b-kube-api-access-6zr8v\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjg86\" (UID: \"d9894c18-5858-4745-8c23-50881e3fa03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:08:51.795646 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.795595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b2b3ae-1b93-4362-9d58-58df694bebb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7p8sm\" (UID: \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:08:51.795646 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.795631 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtzvr\" (UniqueName: \"kubernetes.io/projected/b2b2b3ae-1b93-4362-9d58-58df694bebb8-kube-api-access-xtzvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7p8sm\" (UID: \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:08:51.795896 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.795855 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9894c18-5858-4745-8c23-50881e3fa03b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjg86\" (UID: \"d9894c18-5858-4745-8c23-50881e3fa03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:08:51.795991 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.795966 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b2b3ae-1b93-4362-9d58-58df694bebb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7p8sm\" (UID: \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:08:51.807430 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.807359 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8ntb\" (UniqueName: \"kubernetes.io/projected/3b3fe38f-d9c5-48a8-9eb8-334038d6db2b-kube-api-access-p8ntb\") pod \"limitador-operator-controller-manager-859d7b78bd-bdvq9\" (UID: \"3b3fe38f-d9c5-48a8-9eb8-334038d6db2b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" Jul 14 10:08:51.807590 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.807572 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zr8v\" (UniqueName: \"kubernetes.io/projected/d9894c18-5858-4745-8c23-50881e3fa03b-kube-api-access-6zr8v\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjg86\" (UID: \"d9894c18-5858-4745-8c23-50881e3fa03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:08:51.808909 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.808853 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtzvr\" (UniqueName: \"kubernetes.io/projected/b2b2b3ae-1b93-4362-9d58-58df694bebb8-kube-api-access-xtzvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7p8sm\" (UID: \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:08:51.847869 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.847843 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:51.850339 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.850308 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8wc7c\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:51.852272 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.852245 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:51.855459 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.855439 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:51.857827 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.857777 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:51.859843 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:51.859824 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8wc7c\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:51.896381 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.896293 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvrhp\" (UniqueName: \"kubernetes.io/projected/8ea20c2b-d28c-4784-91d4-4491cc7f9965-kube-api-access-rvrhp\") pod \"8ea20c2b-d28c-4784-91d4-4491cc7f9965\" (UID: \"8ea20c2b-d28c-4784-91d4-4491cc7f9965\") " Jul 14 10:08:51.896381 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.896344 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-extensions-socket-volume\") pod \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\" (UID: \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\") " Jul 14 10:08:51.896556 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.896417 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdljr\" (UniqueName: \"kubernetes.io/projected/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-kube-api-access-vdljr\") pod \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\" (UID: \"3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978\") " Jul 14 10:08:51.896945 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.896917 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" (UID: "3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:08:51.898581 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.898559 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ea20c2b-d28c-4784-91d4-4491cc7f9965-kube-api-access-rvrhp" (OuterVolumeSpecName: "kube-api-access-rvrhp") pod "8ea20c2b-d28c-4784-91d4-4491cc7f9965" (UID: "8ea20c2b-d28c-4784-91d4-4491cc7f9965"). InnerVolumeSpecName "kube-api-access-rvrhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:08:51.898647 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.898574 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-kube-api-access-vdljr" (OuterVolumeSpecName: "kube-api-access-vdljr") pod "3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" (UID: "3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978"). InnerVolumeSpecName "kube-api-access-vdljr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:08:51.997207 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.997171 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvrhp\" (UniqueName: \"kubernetes.io/projected/8ea20c2b-d28c-4784-91d4-4491cc7f9965-kube-api-access-rvrhp\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:08:51.997207 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.997200 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-extensions-socket-volume\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:08:51.997207 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:51.997211 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdljr\" (UniqueName: \"kubernetes.io/projected/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978-kube-api-access-vdljr\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:08:52.010558 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.010534 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:08:52.018408 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.018380 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:08:52.024513 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.024489 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" Jul 14 10:08:52.169705 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.169613 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86"] Jul 14 10:08:52.173575 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:08:52.173540 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9894c18_5858_4745_8c23_50881e3fa03b.slice/crio-3322d5e7ffc185c918a15d5642206d66247bd18b67bd8a6562bda664d1a248a4 WatchSource:0}: Error finding container 3322d5e7ffc185c918a15d5642206d66247bd18b67bd8a6562bda664d1a248a4: Status 404 returned error can't find the container with id 3322d5e7ffc185c918a15d5642206d66247bd18b67bd8a6562bda664d1a248a4 Jul 14 10:08:52.406160 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.406105 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9"] Jul 14 10:08:52.408261 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.408238 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm"] Jul 14 10:08:52.410143 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:08:52.410109 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3fe38f_d9c5_48a8_9eb8_334038d6db2b.slice/crio-1409ffba34791ea7f9e9b8636ddd374df9b7dd6751a61dcfeb994a209cdbb2f5 WatchSource:0}: Error finding container 1409ffba34791ea7f9e9b8636ddd374df9b7dd6751a61dcfeb994a209cdbb2f5: Status 404 returned error can't find the container with id 1409ffba34791ea7f9e9b8636ddd374df9b7dd6751a61dcfeb994a209cdbb2f5 Jul 14 10:08:52.410444 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:08:52.410425 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b2b3ae_1b93_4362_9d58_58df694bebb8.slice/crio-c46dc3a4bd2e752a6836f3b73658cee36f361066e822322a216557b22eb0ac52 WatchSource:0}: Error finding container c46dc3a4bd2e752a6836f3b73658cee36f361066e822322a216557b22eb0ac52: Status 404 returned error can't find the container with id c46dc3a4bd2e752a6836f3b73658cee36f361066e822322a216557b22eb0ac52 Jul 14 10:08:52.447863 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:52.447829 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8wc7c\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:52.450039 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:52.450003 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-whhc7\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:52.450848 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.450829 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" path="/var/lib/kubelet/pods/3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978/volumes" Jul 14 10:08:52.451193 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.451180 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" path="/var/lib/kubelet/pods/8ea20c2b-d28c-4784-91d4-4491cc7f9965/volumes" Jul 14 10:08:52.703115 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.703003 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" podUID="120d482d-1cdf-4a98-ac43-5b2dd613b6e6" containerName="manager" containerID="cri-o://fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096" gracePeriod=2 Jul 14 10:08:52.704657 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.704605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" event={"ID":"d9894c18-5858-4745-8c23-50881e3fa03b","Type":"ContainerStarted","Data":"23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0"} Jul 14 10:08:52.704786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.704705 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" event={"ID":"d9894c18-5858-4745-8c23-50881e3fa03b","Type":"ContainerStarted","Data":"3322d5e7ffc185c918a15d5642206d66247bd18b67bd8a6562bda664d1a248a4"} Jul 14 10:08:52.704786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.704741 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:08:52.706391 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.706359 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" event={"ID":"b2b2b3ae-1b93-4362-9d58-58df694bebb8","Type":"ContainerStarted","Data":"ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59"} Jul 14 10:08:52.706477 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.706405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" event={"ID":"b2b2b3ae-1b93-4362-9d58-58df694bebb8","Type":"ContainerStarted","Data":"c46dc3a4bd2e752a6836f3b73658cee36f361066e822322a216557b22eb0ac52"} Jul 14 10:08:52.706477 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.706454 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:08:52.708141 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.707646 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c59f0ed-0268-4b7c-bdd0-02cb7ea5e978" containerID="596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a" exitCode=0 Jul 14 10:08:52.708141 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.707761 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whhc7" Jul 14 10:08:52.708141 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.707777 2561 scope.go:117] "RemoveContainer" containerID="596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a" Jul 14 10:08:52.713922 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.713772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" event={"ID":"3b3fe38f-d9c5-48a8-9eb8-334038d6db2b","Type":"ContainerStarted","Data":"490a32cf640d0c5dd24a2c794d66da5e26c0e550019d836778e9b644e95aeed8"} Jul 14 10:08:52.713922 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.713847 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" event={"ID":"3b3fe38f-d9c5-48a8-9eb8-334038d6db2b","Type":"ContainerStarted","Data":"1409ffba34791ea7f9e9b8636ddd374df9b7dd6751a61dcfeb994a209cdbb2f5"} Jul 14 10:08:52.713922 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.713878 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" Jul 14 10:08:52.715472 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.715447 2561 generic.go:356] "Generic (PLEG): container finished" podID="8ea20c2b-d28c-4784-91d4-4491cc7f9965" containerID="a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784" exitCode=0 Jul 14 10:08:52.715788 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.715491 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8wc7c" Jul 14 10:08:52.720058 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.720037 2561 scope.go:117] "RemoveContainer" containerID="596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a" Jul 14 10:08:52.720316 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:52.720298 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a\": container with ID starting with 596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a not found: ID does not exist" containerID="596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a" Jul 14 10:08:52.720371 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.720325 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a"} err="failed to get container status \"596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a\": rpc error: code = NotFound desc = could not find container \"596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a\": container with ID starting with 596a389b407c46233e56694a19626c07bcb566ecf84ac39f6b383071540bb37a not found: ID does not exist" Jul 14 10:08:52.720371 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.720342 2561 scope.go:117] "RemoveContainer" containerID="a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784" Jul 14 10:08:52.725360 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.725322 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" podStartSLOduration=1.725309679 podStartE2EDuration="1.725309679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:08:52.724048262 +0000 UTC m=+520.821436463" watchObservedRunningTime="2026-07-14 10:08:52.725309679 +0000 UTC m=+520.822697881" Jul 14 10:08:52.741650 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.741604 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" podStartSLOduration=1.741591546 podStartE2EDuration="1.741591546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:08:52.739746576 +0000 UTC m=+520.837134789" watchObservedRunningTime="2026-07-14 10:08:52.741591546 +0000 UTC m=+520.838979747" Jul 14 10:08:52.759858 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.759779 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" podStartSLOduration=1.759758983 podStartE2EDuration="1.759758983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:08:52.756975455 +0000 UTC m=+520.854363650" watchObservedRunningTime="2026-07-14 10:08:52.759758983 +0000 UTC m=+520.857147187" Jul 14 10:08:52.814608 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.814587 2561 scope.go:117] "RemoveContainer" containerID="a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784" Jul 14 10:08:52.814958 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:52.814936 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784\": container with ID starting with a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784 not found: ID does not exist" containerID="a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784" Jul 14 10:08:52.815048 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.814965 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784"} err="failed to get container status \"a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784\": rpc error: code = NotFound desc = could not find container \"a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784\": container with ID starting with a808ea444726720aa1088f9238e01acb9902ad4a7b79bb0b7432fcf72966c784 not found: ID does not exist" Jul 14 10:08:52.941256 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:52.941233 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:52.943947 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:52.943917 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6jzsk\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="120d482d-1cdf-4a98-ac43-5b2dd613b6e6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:53.006396 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.006314 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pgxq\" (UniqueName: \"kubernetes.io/projected/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-kube-api-access-7pgxq\") pod \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\" (UID: \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\") " Jul 14 10:08:53.006571 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.006399 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-extensions-socket-volume\") pod \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\" (UID: \"120d482d-1cdf-4a98-ac43-5b2dd613b6e6\") " Jul 14 10:08:53.006659 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.006628 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "120d482d-1cdf-4a98-ac43-5b2dd613b6e6" (UID: "120d482d-1cdf-4a98-ac43-5b2dd613b6e6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:08:53.008497 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.008475 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-kube-api-access-7pgxq" (OuterVolumeSpecName: "kube-api-access-7pgxq") pod "120d482d-1cdf-4a98-ac43-5b2dd613b6e6" (UID: "120d482d-1cdf-4a98-ac43-5b2dd613b6e6"). InnerVolumeSpecName "kube-api-access-7pgxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:08:53.107103 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.107072 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pgxq\" (UniqueName: \"kubernetes.io/projected/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-kube-api-access-7pgxq\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:08:53.107103 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.107100 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120d482d-1cdf-4a98-ac43-5b2dd613b6e6-extensions-socket-volume\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:08:53.721813 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.721775 2561 generic.go:356] "Generic (PLEG): container finished" podID="120d482d-1cdf-4a98-ac43-5b2dd613b6e6" containerID="fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096" exitCode=2 Jul 14 10:08:53.722228 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.721867 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:53.722228 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.721880 2561 scope.go:117] "RemoveContainer" containerID="fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096" Jul 14 10:08:53.724708 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:53.724677 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6jzsk\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="120d482d-1cdf-4a98-ac43-5b2dd613b6e6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:53.731254 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.731237 2561 scope.go:117] "RemoveContainer" containerID="fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096" Jul 14 10:08:53.731486 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:53.731470 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096\": container with ID starting with fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096 not found: ID does not exist" containerID="fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096" Jul 14 10:08:53.731551 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:53.731493 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096"} err="failed to get container status \"fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096\": rpc error: code = NotFound desc = could not find container \"fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096\": container with ID starting with fde670be9139321dcb20c2e8e800fa9bbcc5f4ab5fe99be5c36e432f061f5096 not found: ID does not exist" Jul 14 10:08:53.732843 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:08:53.732820 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6jzsk\" is forbidden: User \"system:node:ip-10-0-139-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-82.ec2.internal' and this object" podUID="120d482d-1cdf-4a98-ac43-5b2dd613b6e6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6jzsk" Jul 14 10:08:54.449136 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:08:54.449095 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="120d482d-1cdf-4a98-ac43-5b2dd613b6e6" path="/var/lib/kubelet/pods/120d482d-1cdf-4a98-ac43-5b2dd613b6e6/volumes" Jul 14 10:09:03.727010 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:03.726917 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdvq9" Jul 14 10:09:03.727433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:03.727100 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:09:03.727433 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:03.727177 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:09:03.818201 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:03.818164 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm"] Jul 14 10:09:03.818453 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:03.818406 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" podUID="b2b2b3ae-1b93-4362-9d58-58df694bebb8" containerName="manager" containerID="cri-o://ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59" gracePeriod=10 Jul 14 10:09:04.071012 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.070987 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:09:04.144617 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.144566 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn"] Jul 14 10:09:04.144970 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.144956 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b2b3ae-1b93-4362-9d58-58df694bebb8" containerName="manager" Jul 14 10:09:04.145020 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.144972 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b2b3ae-1b93-4362-9d58-58df694bebb8" containerName="manager" Jul 14 10:09:04.145055 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.145037 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b2b3ae-1b93-4362-9d58-58df694bebb8" containerName="manager" Jul 14 10:09:04.147918 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.147902 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:04.163823 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.163773 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn"] Jul 14 10:09:04.198659 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.198621 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtzvr\" (UniqueName: \"kubernetes.io/projected/b2b2b3ae-1b93-4362-9d58-58df694bebb8-kube-api-access-xtzvr\") pod \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\" (UID: \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\") " Jul 14 10:09:04.198659 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.198666 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b2b3ae-1b93-4362-9d58-58df694bebb8-extensions-socket-volume\") pod \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\" (UID: \"b2b2b3ae-1b93-4362-9d58-58df694bebb8\") " Jul 14 10:09:04.198939 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.198735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlt28\" (UniqueName: \"kubernetes.io/projected/68d948b4-4d68-497a-9a6b-a140b1b71425-kube-api-access-vlt28\") pod \"kuadrant-operator-controller-manager-86878c769f-5gcbn\" (UID: \"68d948b4-4d68-497a-9a6b-a140b1b71425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:04.198939 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.198843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d948b4-4d68-497a-9a6b-a140b1b71425-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5gcbn\" (UID: \"68d948b4-4d68-497a-9a6b-a140b1b71425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:04.199132 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.199110 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b2b3ae-1b93-4362-9d58-58df694bebb8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b2b2b3ae-1b93-4362-9d58-58df694bebb8" (UID: "b2b2b3ae-1b93-4362-9d58-58df694bebb8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:09:04.201098 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.201070 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b2b3ae-1b93-4362-9d58-58df694bebb8-kube-api-access-xtzvr" (OuterVolumeSpecName: "kube-api-access-xtzvr") pod "b2b2b3ae-1b93-4362-9d58-58df694bebb8" (UID: "b2b2b3ae-1b93-4362-9d58-58df694bebb8"). InnerVolumeSpecName "kube-api-access-xtzvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:09:04.299550 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.299511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d948b4-4d68-497a-9a6b-a140b1b71425-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5gcbn\" (UID: \"68d948b4-4d68-497a-9a6b-a140b1b71425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:04.299550 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.299556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlt28\" (UniqueName: \"kubernetes.io/projected/68d948b4-4d68-497a-9a6b-a140b1b71425-kube-api-access-vlt28\") pod \"kuadrant-operator-controller-manager-86878c769f-5gcbn\" (UID: \"68d948b4-4d68-497a-9a6b-a140b1b71425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:04.299765 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.299606 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtzvr\" (UniqueName: \"kubernetes.io/projected/b2b2b3ae-1b93-4362-9d58-58df694bebb8-kube-api-access-xtzvr\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:09:04.299765 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.299618 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b2b3ae-1b93-4362-9d58-58df694bebb8-extensions-socket-volume\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:09:04.299944 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.299922 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d948b4-4d68-497a-9a6b-a140b1b71425-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5gcbn\" (UID: \"68d948b4-4d68-497a-9a6b-a140b1b71425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:04.314961 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.314930 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlt28\" (UniqueName: \"kubernetes.io/projected/68d948b4-4d68-497a-9a6b-a140b1b71425-kube-api-access-vlt28\") pod \"kuadrant-operator-controller-manager-86878c769f-5gcbn\" (UID: \"68d948b4-4d68-497a-9a6b-a140b1b71425\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:04.457565 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.457534 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:04.610157 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.610133 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn"] Jul 14 10:09:04.612095 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:09:04.612070 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d948b4_4d68_497a_9a6b_a140b1b71425.slice/crio-ec56f624df90466ec3585b07b74e94410daa585b4f08bb33e48f1cdeead092c5 WatchSource:0}: Error finding container ec56f624df90466ec3585b07b74e94410daa585b4f08bb33e48f1cdeead092c5: Status 404 returned error can't find the container with id ec56f624df90466ec3585b07b74e94410daa585b4f08bb33e48f1cdeead092c5 Jul 14 10:09:04.780836 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.780783 2561 generic.go:356] "Generic (PLEG): container finished" podID="b2b2b3ae-1b93-4362-9d58-58df694bebb8" containerID="ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59" exitCode=0 Jul 14 10:09:04.780836 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.780828 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" event={"ID":"b2b2b3ae-1b93-4362-9d58-58df694bebb8","Type":"ContainerDied","Data":"ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59"} Jul 14 10:09:04.781352 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.780844 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" Jul 14 10:09:04.781352 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.780891 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm" event={"ID":"b2b2b3ae-1b93-4362-9d58-58df694bebb8","Type":"ContainerDied","Data":"c46dc3a4bd2e752a6836f3b73658cee36f361066e822322a216557b22eb0ac52"} Jul 14 10:09:04.781352 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.780915 2561 scope.go:117] "RemoveContainer" containerID="ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59" Jul 14 10:09:04.782694 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.782645 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" event={"ID":"68d948b4-4d68-497a-9a6b-a140b1b71425","Type":"ContainerStarted","Data":"3ae46eb28df41606cb8bb9228ce98b01e997a71661720abbfb2aca81913b1b39"} Jul 14 10:09:04.782694 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.782691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" event={"ID":"68d948b4-4d68-497a-9a6b-a140b1b71425","Type":"ContainerStarted","Data":"ec56f624df90466ec3585b07b74e94410daa585b4f08bb33e48f1cdeead092c5"} Jul 14 10:09:04.782912 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.782793 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:04.790069 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.790049 2561 scope.go:117] "RemoveContainer" containerID="ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59" Jul 14 10:09:04.790362 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:09:04.790341 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59\": container with ID starting with ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59 not found: ID does not exist" containerID="ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59" Jul 14 10:09:04.790408 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.790371 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59"} err="failed to get container status \"ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59\": rpc error: code = NotFound desc = could not find container \"ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59\": container with ID starting with ffa59031138a3dc8592247ae8ccac930070e3091cde3878e8c50335fea151f59 not found: ID does not exist" Jul 14 10:09:04.819150 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.819090 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" podStartSLOduration=0.819069701 podStartE2EDuration="819.069701ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:09:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:09:04.818586022 +0000 UTC m=+532.915974223" watchObservedRunningTime="2026-07-14 10:09:04.819069701 +0000 UTC m=+532.916457903" Jul 14 10:09:04.842541 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.842496 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm"] Jul 14 10:09:04.845186 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:04.845162 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7p8sm"] Jul 14 10:09:06.449298 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:06.449259 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b2b3ae-1b93-4362-9d58-58df694bebb8" path="/var/lib/kubelet/pods/b2b2b3ae-1b93-4362-9d58-58df694bebb8/volumes" Jul 14 10:09:15.791785 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:15.791750 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:09:15.844310 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:15.844282 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86"] Jul 14 10:09:15.844516 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:15.844491 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" podUID="d9894c18-5858-4745-8c23-50881e3fa03b" containerName="manager" containerID="cri-o://23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0" gracePeriod=10 Jul 14 10:09:16.096214 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.096175 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:09:16.202956 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.202925 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zr8v\" (UniqueName: \"kubernetes.io/projected/d9894c18-5858-4745-8c23-50881e3fa03b-kube-api-access-6zr8v\") pod \"d9894c18-5858-4745-8c23-50881e3fa03b\" (UID: \"d9894c18-5858-4745-8c23-50881e3fa03b\") " Jul 14 10:09:16.203135 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.202971 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9894c18-5858-4745-8c23-50881e3fa03b-extensions-socket-volume\") pod \"d9894c18-5858-4745-8c23-50881e3fa03b\" (UID: \"d9894c18-5858-4745-8c23-50881e3fa03b\") " Jul 14 10:09:16.203384 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.203348 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9894c18-5858-4745-8c23-50881e3fa03b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9894c18-5858-4745-8c23-50881e3fa03b" (UID: "d9894c18-5858-4745-8c23-50881e3fa03b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:09:16.205186 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.205159 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9894c18-5858-4745-8c23-50881e3fa03b-kube-api-access-6zr8v" (OuterVolumeSpecName: "kube-api-access-6zr8v") pod "d9894c18-5858-4745-8c23-50881e3fa03b" (UID: "d9894c18-5858-4745-8c23-50881e3fa03b"). InnerVolumeSpecName "kube-api-access-6zr8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:09:16.304543 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.304504 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zr8v\" (UniqueName: \"kubernetes.io/projected/d9894c18-5858-4745-8c23-50881e3fa03b-kube-api-access-6zr8v\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:09:16.304543 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.304539 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9894c18-5858-4745-8c23-50881e3fa03b-extensions-socket-volume\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:09:16.842074 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.842035 2561 generic.go:356] "Generic (PLEG): container finished" podID="d9894c18-5858-4745-8c23-50881e3fa03b" containerID="23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0" exitCode=0 Jul 14 10:09:16.842074 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.842076 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" Jul 14 10:09:16.842494 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.842123 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" event={"ID":"d9894c18-5858-4745-8c23-50881e3fa03b","Type":"ContainerDied","Data":"23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0"} Jul 14 10:09:16.842494 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.842169 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86" event={"ID":"d9894c18-5858-4745-8c23-50881e3fa03b","Type":"ContainerDied","Data":"3322d5e7ffc185c918a15d5642206d66247bd18b67bd8a6562bda664d1a248a4"} Jul 14 10:09:16.842494 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.842194 2561 scope.go:117] "RemoveContainer" containerID="23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0" Jul 14 10:09:16.851165 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.851005 2561 scope.go:117] "RemoveContainer" containerID="23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0" Jul 14 10:09:16.851302 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:09:16.851283 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0\": container with ID starting with 23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0 not found: ID does not exist" containerID="23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0" Jul 14 10:09:16.851342 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.851312 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0"} err="failed to get container status \"23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0\": rpc error: code = NotFound desc = could not find container \"23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0\": container with ID starting with 23af3924defe9f5dd023742b5581655b9b1e79557302f068ae505a5167dcbaf0 not found: ID does not exist" Jul 14 10:09:16.861408 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.861386 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86"] Jul 14 10:09:16.867274 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:16.867250 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjg86"] Jul 14 10:09:18.448713 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:18.448677 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9894c18-5858-4745-8c23-50881e3fa03b" path="/var/lib/kubelet/pods/d9894c18-5858-4745-8c23-50881e3fa03b/volumes" Jul 14 10:09:35.283738 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.283705 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccckd"] Jul 14 10:09:35.284147 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.284093 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9894c18-5858-4745-8c23-50881e3fa03b" containerName="manager" Jul 14 10:09:35.284147 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.284105 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9894c18-5858-4745-8c23-50881e3fa03b" containerName="manager" Jul 14 10:09:35.284231 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.284172 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9894c18-5858-4745-8c23-50881e3fa03b" containerName="manager" Jul 14 10:09:35.286281 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.286259 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:35.288982 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.288963 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sxmr7\"" Jul 14 10:09:35.289137 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.289120 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 10:09:35.296815 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.296774 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccckd"] Jul 14 10:09:35.382440 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.382409 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccckd"] Jul 14 10:09:35.478564 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.478529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v6d9\" (UniqueName: \"kubernetes.io/projected/36852877-443c-45e4-9168-e01a3103de37-kube-api-access-7v6d9\") pod \"limitador-limitador-64c94fd64f-ccckd\" (UID: \"36852877-443c-45e4-9168-e01a3103de37\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:35.478732 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.478574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36852877-443c-45e4-9168-e01a3103de37-config-file\") pod \"limitador-limitador-64c94fd64f-ccckd\" (UID: \"36852877-443c-45e4-9168-e01a3103de37\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:35.580010 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.579901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v6d9\" (UniqueName: \"kubernetes.io/projected/36852877-443c-45e4-9168-e01a3103de37-kube-api-access-7v6d9\") pod \"limitador-limitador-64c94fd64f-ccckd\" (UID: \"36852877-443c-45e4-9168-e01a3103de37\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:35.580010 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.579968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36852877-443c-45e4-9168-e01a3103de37-config-file\") pod \"limitador-limitador-64c94fd64f-ccckd\" (UID: \"36852877-443c-45e4-9168-e01a3103de37\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:35.580774 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.580745 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36852877-443c-45e4-9168-e01a3103de37-config-file\") pod \"limitador-limitador-64c94fd64f-ccckd\" (UID: \"36852877-443c-45e4-9168-e01a3103de37\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:35.587974 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.587943 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v6d9\" (UniqueName: \"kubernetes.io/projected/36852877-443c-45e4-9168-e01a3103de37-kube-api-access-7v6d9\") pod \"limitador-limitador-64c94fd64f-ccckd\" (UID: \"36852877-443c-45e4-9168-e01a3103de37\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:35.597813 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.597770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:35.739300 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.739277 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccckd"] Jul 14 10:09:35.741724 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:09:35.741697 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36852877_443c_45e4_9168_e01a3103de37.slice/crio-083de7762abe1f835b73b28142350ec1036e8c36df47ff43093abdbf5c33df41 WatchSource:0}: Error finding container 083de7762abe1f835b73b28142350ec1036e8c36df47ff43093abdbf5c33df41: Status 404 returned error can't find the container with id 083de7762abe1f835b73b28142350ec1036e8c36df47ff43093abdbf5c33df41 Jul 14 10:09:35.931119 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:35.931029 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" event={"ID":"36852877-443c-45e4-9168-e01a3103de37","Type":"ContainerStarted","Data":"083de7762abe1f835b73b28142350ec1036e8c36df47ff43093abdbf5c33df41"} Jul 14 10:09:36.102883 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.102843 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-z9rqr"] Jul 14 10:09:36.106304 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.106284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z9rqr" Jul 14 10:09:36.109551 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.109531 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5wb9f\"" Jul 14 10:09:36.117533 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.117509 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9rqr"] Jul 14 10:09:36.186155 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.186075 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkr5f\" (UniqueName: \"kubernetes.io/projected/0e9e4301-e87e-4058-9a0c-90208bf6ef43-kube-api-access-xkr5f\") pod \"authorino-58cd955675-z9rqr\" (UID: \"0e9e4301-e87e-4058-9a0c-90208bf6ef43\") " pod="kuadrant-system/authorino-58cd955675-z9rqr" Jul 14 10:09:36.220041 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.220001 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bsbpq"] Jul 14 10:09:36.222495 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.222478 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bsbpq" Jul 14 10:09:36.230315 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.230287 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bsbpq"] Jul 14 10:09:36.286543 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.286513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkr5f\" (UniqueName: \"kubernetes.io/projected/0e9e4301-e87e-4058-9a0c-90208bf6ef43-kube-api-access-xkr5f\") pod \"authorino-58cd955675-z9rqr\" (UID: \"0e9e4301-e87e-4058-9a0c-90208bf6ef43\") " pod="kuadrant-system/authorino-58cd955675-z9rqr" Jul 14 10:09:36.286956 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.286553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnl92\" (UniqueName: \"kubernetes.io/projected/a3453d77-89e1-44e0-8ed9-29e5782d1c1d-kube-api-access-fnl92\") pod \"authorino-75d556bd77-bsbpq\" (UID: \"a3453d77-89e1-44e0-8ed9-29e5782d1c1d\") " pod="kuadrant-system/authorino-75d556bd77-bsbpq" Jul 14 10:09:36.296114 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.296087 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkr5f\" (UniqueName: \"kubernetes.io/projected/0e9e4301-e87e-4058-9a0c-90208bf6ef43-kube-api-access-xkr5f\") pod \"authorino-58cd955675-z9rqr\" (UID: \"0e9e4301-e87e-4058-9a0c-90208bf6ef43\") " pod="kuadrant-system/authorino-58cd955675-z9rqr" Jul 14 10:09:36.387974 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.387945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnl92\" (UniqueName: \"kubernetes.io/projected/a3453d77-89e1-44e0-8ed9-29e5782d1c1d-kube-api-access-fnl92\") pod \"authorino-75d556bd77-bsbpq\" (UID: \"a3453d77-89e1-44e0-8ed9-29e5782d1c1d\") " pod="kuadrant-system/authorino-75d556bd77-bsbpq" Jul 14 10:09:36.396338 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.396316 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnl92\" (UniqueName: \"kubernetes.io/projected/a3453d77-89e1-44e0-8ed9-29e5782d1c1d-kube-api-access-fnl92\") pod \"authorino-75d556bd77-bsbpq\" (UID: \"a3453d77-89e1-44e0-8ed9-29e5782d1c1d\") " pod="kuadrant-system/authorino-75d556bd77-bsbpq" Jul 14 10:09:36.415720 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.415688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z9rqr" Jul 14 10:09:36.532170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.532135 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bsbpq" Jul 14 10:09:36.552051 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.551979 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9rqr"] Jul 14 10:09:36.555491 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:09:36.555458 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e9e4301_e87e_4058_9a0c_90208bf6ef43.slice/crio-0d15004cf57fd31ca4472508cf6d654157f1b9aad183d8c8ab8c6f75ceb40c3c WatchSource:0}: Error finding container 0d15004cf57fd31ca4472508cf6d654157f1b9aad183d8c8ab8c6f75ceb40c3c: Status 404 returned error can't find the container with id 0d15004cf57fd31ca4472508cf6d654157f1b9aad183d8c8ab8c6f75ceb40c3c Jul 14 10:09:36.715338 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.715223 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bsbpq"] Jul 14 10:09:36.719967 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:09:36.719935 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3453d77_89e1_44e0_8ed9_29e5782d1c1d.slice/crio-345b06eac482d0b6701b8849dbed98390abe7bf1b8414b79161b896ef8672809 WatchSource:0}: Error finding container 345b06eac482d0b6701b8849dbed98390abe7bf1b8414b79161b896ef8672809: Status 404 returned error can't find the container with id 345b06eac482d0b6701b8849dbed98390abe7bf1b8414b79161b896ef8672809 Jul 14 10:09:36.939198 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.939159 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z9rqr" event={"ID":"0e9e4301-e87e-4058-9a0c-90208bf6ef43","Type":"ContainerStarted","Data":"0d15004cf57fd31ca4472508cf6d654157f1b9aad183d8c8ab8c6f75ceb40c3c"} Jul 14 10:09:36.940865 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:36.940826 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bsbpq" event={"ID":"a3453d77-89e1-44e0-8ed9-29e5782d1c1d","Type":"ContainerStarted","Data":"345b06eac482d0b6701b8849dbed98390abe7bf1b8414b79161b896ef8672809"} Jul 14 10:09:41.977786 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:41.977747 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z9rqr" event={"ID":"0e9e4301-e87e-4058-9a0c-90208bf6ef43","Type":"ContainerStarted","Data":"436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6"} Jul 14 10:09:41.979384 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:41.979357 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" event={"ID":"36852877-443c-45e4-9168-e01a3103de37","Type":"ContainerStarted","Data":"e6452b11cdab8be84ff9d87aa5b267e20de2a3a057e37411cf01e7e6458e7ad2"} Jul 14 10:09:41.979525 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:41.979418 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:41.980828 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:41.980787 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bsbpq" event={"ID":"a3453d77-89e1-44e0-8ed9-29e5782d1c1d","Type":"ContainerStarted","Data":"154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa"} Jul 14 10:09:41.995208 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:41.995167 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-z9rqr" podStartSLOduration=1.620082805 podStartE2EDuration="5.99515471s" totalImagesPullingTime="4.375071905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:09:41.993470443 +0000 UTC m=+570.090858659" watchObservedRunningTime="2026-07-14 10:09:41.99515471 +0000 UTC m=+570.092542912" Jul 14 10:09:42.011344 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:42.011301 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bsbpq" podStartSLOduration=1.827200658 podStartE2EDuration="6.011287122s" totalImagesPullingTime="4.184086464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:09:42.009758732 +0000 UTC m=+570.107146936" watchObservedRunningTime="2026-07-14 10:09:42.011287122 +0000 UTC m=+570.108675358" Jul 14 10:09:42.035066 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:42.034974 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" podStartSLOduration=1.835484177 podStartE2EDuration="7.034958463s" totalImagesPullingTime="5.199474286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:09:42.033546631 +0000 UTC m=+570.130934835" watchObservedRunningTime="2026-07-14 10:09:42.034958463 +0000 UTC m=+570.132346666" Jul 14 10:09:42.042520 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:42.042494 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9rqr"] Jul 14 10:09:43.990392 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:43.990347 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-z9rqr" podUID="0e9e4301-e87e-4058-9a0c-90208bf6ef43" containerName="authorino" containerID="cri-o://436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6" gracePeriod=30 Jul 14 10:09:44.241429 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:44.241358 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z9rqr" Jul 14 10:09:44.261128 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:44.261101 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkr5f\" (UniqueName: \"kubernetes.io/projected/0e9e4301-e87e-4058-9a0c-90208bf6ef43-kube-api-access-xkr5f\") pod \"0e9e4301-e87e-4058-9a0c-90208bf6ef43\" (UID: \"0e9e4301-e87e-4058-9a0c-90208bf6ef43\") " Jul 14 10:09:44.263728 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:44.263696 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9e4301-e87e-4058-9a0c-90208bf6ef43-kube-api-access-xkr5f" (OuterVolumeSpecName: "kube-api-access-xkr5f") pod "0e9e4301-e87e-4058-9a0c-90208bf6ef43" (UID: "0e9e4301-e87e-4058-9a0c-90208bf6ef43"). InnerVolumeSpecName "kube-api-access-xkr5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:09:44.362263 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:44.362228 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkr5f\" (UniqueName: \"kubernetes.io/projected/0e9e4301-e87e-4058-9a0c-90208bf6ef43-kube-api-access-xkr5f\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:09:44.996622 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:44.996586 2561 generic.go:356] "Generic (PLEG): container finished" podID="0e9e4301-e87e-4058-9a0c-90208bf6ef43" containerID="436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6" exitCode=0 Jul 14 10:09:44.997170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:44.996636 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z9rqr" Jul 14 10:09:44.997170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:44.996681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z9rqr" event={"ID":"0e9e4301-e87e-4058-9a0c-90208bf6ef43","Type":"ContainerDied","Data":"436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6"} Jul 14 10:09:44.997170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:44.996721 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z9rqr" event={"ID":"0e9e4301-e87e-4058-9a0c-90208bf6ef43","Type":"ContainerDied","Data":"0d15004cf57fd31ca4472508cf6d654157f1b9aad183d8c8ab8c6f75ceb40c3c"} Jul 14 10:09:44.997170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:44.996740 2561 scope.go:117] "RemoveContainer" containerID="436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6" Jul 14 10:09:45.005600 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:45.005581 2561 scope.go:117] "RemoveContainer" containerID="436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6" Jul 14 10:09:45.005900 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:09:45.005877 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6\": container with ID starting with 436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6 not found: ID does not exist" containerID="436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6" Jul 14 10:09:45.005949 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:45.005912 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6"} err="failed to get container status \"436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6\": rpc error: code = NotFound desc = could not find container \"436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6\": container with ID starting with 436bb298026fa1876ec0c8a977d06be0c042e2d53edf5ace1a80292cca4178a6 not found: ID does not exist" Jul 14 10:09:45.015850 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:45.015053 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9rqr"] Jul 14 10:09:45.021550 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:45.021521 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9rqr"] Jul 14 10:09:46.449277 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:46.449245 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9e4301-e87e-4058-9a0c-90208bf6ef43" path="/var/lib/kubelet/pods/0e9e4301-e87e-4058-9a0c-90208bf6ef43/volumes" Jul 14 10:09:50.551687 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:50.551636 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccckd"] Jul 14 10:09:50.552354 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:50.551939 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" podUID="36852877-443c-45e4-9168-e01a3103de37" containerName="limitador" containerID="cri-o://e6452b11cdab8be84ff9d87aa5b267e20de2a3a057e37411cf01e7e6458e7ad2" gracePeriod=30 Jul 14 10:09:50.554046 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:50.554021 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:51.026385 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:51.026351 2561 generic.go:356] "Generic (PLEG): container finished" podID="36852877-443c-45e4-9168-e01a3103de37" containerID="e6452b11cdab8be84ff9d87aa5b267e20de2a3a057e37411cf01e7e6458e7ad2" exitCode=0 Jul 14 10:09:51.026564 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:51.026426 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" event={"ID":"36852877-443c-45e4-9168-e01a3103de37","Type":"ContainerDied","Data":"e6452b11cdab8be84ff9d87aa5b267e20de2a3a057e37411cf01e7e6458e7ad2"} Jul 14 10:09:51.508465 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:51.508439 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:51.626103 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:51.625997 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v6d9\" (UniqueName: \"kubernetes.io/projected/36852877-443c-45e4-9168-e01a3103de37-kube-api-access-7v6d9\") pod \"36852877-443c-45e4-9168-e01a3103de37\" (UID: \"36852877-443c-45e4-9168-e01a3103de37\") " Jul 14 10:09:51.626103 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:51.626095 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36852877-443c-45e4-9168-e01a3103de37-config-file\") pod \"36852877-443c-45e4-9168-e01a3103de37\" (UID: \"36852877-443c-45e4-9168-e01a3103de37\") " Jul 14 10:09:51.626632 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:51.626506 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36852877-443c-45e4-9168-e01a3103de37-config-file" (OuterVolumeSpecName: "config-file") pod "36852877-443c-45e4-9168-e01a3103de37" (UID: "36852877-443c-45e4-9168-e01a3103de37"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:09:51.628202 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:51.628171 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36852877-443c-45e4-9168-e01a3103de37-kube-api-access-7v6d9" (OuterVolumeSpecName: "kube-api-access-7v6d9") pod "36852877-443c-45e4-9168-e01a3103de37" (UID: "36852877-443c-45e4-9168-e01a3103de37"). InnerVolumeSpecName "kube-api-access-7v6d9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:09:51.726826 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:51.726772 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36852877-443c-45e4-9168-e01a3103de37-config-file\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:09:51.727003 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:51.726845 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v6d9\" (UniqueName: \"kubernetes.io/projected/36852877-443c-45e4-9168-e01a3103de37-kube-api-access-7v6d9\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:09:52.032697 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:52.032669 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" Jul 14 10:09:52.032917 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:52.032668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ccckd" event={"ID":"36852877-443c-45e4-9168-e01a3103de37","Type":"ContainerDied","Data":"083de7762abe1f835b73b28142350ec1036e8c36df47ff43093abdbf5c33df41"} Jul 14 10:09:52.032917 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:52.032821 2561 scope.go:117] "RemoveContainer" containerID="e6452b11cdab8be84ff9d87aa5b267e20de2a3a057e37411cf01e7e6458e7ad2" Jul 14 10:09:52.053577 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:52.053549 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccckd"] Jul 14 10:09:52.058138 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:52.058115 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ccckd"] Jul 14 10:09:52.453496 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:52.453416 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36852877-443c-45e4-9168-e01a3103de37" path="/var/lib/kubelet/pods/36852877-443c-45e4-9168-e01a3103de37/volumes" Jul 14 10:09:54.364431 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.364398 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-lvqg4"] Jul 14 10:09:54.364829 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.364771 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9e4301-e87e-4058-9a0c-90208bf6ef43" containerName="authorino" Jul 14 10:09:54.364829 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.364783 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9e4301-e87e-4058-9a0c-90208bf6ef43" containerName="authorino" Jul 14 10:09:54.364829 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.364813 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36852877-443c-45e4-9168-e01a3103de37" containerName="limitador" Jul 14 10:09:54.364829 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.364819 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="36852877-443c-45e4-9168-e01a3103de37" containerName="limitador" Jul 14 10:09:54.364991 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.364868 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9e4301-e87e-4058-9a0c-90208bf6ef43" containerName="authorino" Jul 14 10:09:54.364991 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.364880 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="36852877-443c-45e4-9168-e01a3103de37" containerName="limitador" Jul 14 10:09:54.374391 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.374361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:09:54.377318 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.377295 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wmxsq\"" Jul 14 10:09:54.377454 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.377295 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 14 10:09:54.384759 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.384717 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lvqg4"] Jul 14 10:09:54.451288 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.451252 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5cb712b7-1a3d-4076-88dd-38cd32d49471-data\") pod \"postgres-69fb4594cf-lvqg4\" (UID: \"5cb712b7-1a3d-4076-88dd-38cd32d49471\") " pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:09:54.451472 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.451323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4cw7\" (UniqueName: \"kubernetes.io/projected/5cb712b7-1a3d-4076-88dd-38cd32d49471-kube-api-access-x4cw7\") pod \"postgres-69fb4594cf-lvqg4\" (UID: \"5cb712b7-1a3d-4076-88dd-38cd32d49471\") " pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:09:54.552185 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.552149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5cb712b7-1a3d-4076-88dd-38cd32d49471-data\") pod \"postgres-69fb4594cf-lvqg4\" (UID: \"5cb712b7-1a3d-4076-88dd-38cd32d49471\") " pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:09:54.552367 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.552217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4cw7\" (UniqueName: \"kubernetes.io/projected/5cb712b7-1a3d-4076-88dd-38cd32d49471-kube-api-access-x4cw7\") pod \"postgres-69fb4594cf-lvqg4\" (UID: \"5cb712b7-1a3d-4076-88dd-38cd32d49471\") " pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:09:54.552574 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.552553 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5cb712b7-1a3d-4076-88dd-38cd32d49471-data\") pod \"postgres-69fb4594cf-lvqg4\" (UID: \"5cb712b7-1a3d-4076-88dd-38cd32d49471\") " pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:09:54.566477 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.566439 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4cw7\" (UniqueName: \"kubernetes.io/projected/5cb712b7-1a3d-4076-88dd-38cd32d49471-kube-api-access-x4cw7\") pod \"postgres-69fb4594cf-lvqg4\" (UID: \"5cb712b7-1a3d-4076-88dd-38cd32d49471\") " pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:09:54.685977 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.685882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:09:54.825048 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:54.825022 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lvqg4"] Jul 14 10:09:54.827575 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:09:54.827547 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb712b7_1a3d_4076_88dd_38cd32d49471.slice/crio-1becc3d2f65e8eaed3a7e88bff42f77c1af28aaafa1669d84721e0c9aa464a09 WatchSource:0}: Error finding container 1becc3d2f65e8eaed3a7e88bff42f77c1af28aaafa1669d84721e0c9aa464a09: Status 404 returned error can't find the container with id 1becc3d2f65e8eaed3a7e88bff42f77c1af28aaafa1669d84721e0c9aa464a09 Jul 14 10:09:55.049775 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:09:55.049736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lvqg4" event={"ID":"5cb712b7-1a3d-4076-88dd-38cd32d49471","Type":"ContainerStarted","Data":"1becc3d2f65e8eaed3a7e88bff42f77c1af28aaafa1669d84721e0c9aa464a09"} Jul 14 10:10:00.081466 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:00.081432 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lvqg4" event={"ID":"5cb712b7-1a3d-4076-88dd-38cd32d49471","Type":"ContainerStarted","Data":"e6ff1e294613d1fbd9ff173f6361ee23de3ea075e02dd21222b0f616d1d31b15"} Jul 14 10:10:00.081879 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:00.081568 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:10:00.101623 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:00.101557 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-lvqg4" podStartSLOduration=1.3028140719999999 podStartE2EDuration="6.101533062s" totalImagesPullingTime="4.79871899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:10:00.098150839 +0000 UTC m=+588.195539042" watchObservedRunningTime="2026-07-14 10:10:00.101533062 +0000 UTC m=+588.198921266" Jul 14 10:10:06.117523 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.117492 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-lvqg4" Jul 14 10:10:06.679063 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.679028 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t9mm8"] Jul 14 10:10:06.682420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.682394 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" Jul 14 10:10:06.694862 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.694757 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t9mm8"] Jul 14 10:10:06.767366 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.767328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx2pf\" (UniqueName: \"kubernetes.io/projected/12db0b77-6f86-46e4-a88e-85ae8a294f04-kube-api-access-nx2pf\") pod \"authorino-5d4b67c446-t9mm8\" (UID: \"12db0b77-6f86-46e4-a88e-85ae8a294f04\") " pod="kuadrant-system/authorino-5d4b67c446-t9mm8" Jul 14 10:10:06.868525 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.868491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx2pf\" (UniqueName: \"kubernetes.io/projected/12db0b77-6f86-46e4-a88e-85ae8a294f04-kube-api-access-nx2pf\") pod \"authorino-5d4b67c446-t9mm8\" (UID: \"12db0b77-6f86-46e4-a88e-85ae8a294f04\") " pod="kuadrant-system/authorino-5d4b67c446-t9mm8" Jul 14 10:10:06.876976 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.876943 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx2pf\" (UniqueName: \"kubernetes.io/projected/12db0b77-6f86-46e4-a88e-85ae8a294f04-kube-api-access-nx2pf\") pod \"authorino-5d4b67c446-t9mm8\" (UID: \"12db0b77-6f86-46e4-a88e-85ae8a294f04\") " pod="kuadrant-system/authorino-5d4b67c446-t9mm8" Jul 14 10:10:06.915280 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.915248 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t9mm8"] Jul 14 10:10:06.915524 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.915511 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" Jul 14 10:10:06.948009 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.947937 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c66cd878c-647rb"] Jul 14 10:10:06.951438 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.951418 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c66cd878c-647rb" Jul 14 10:10:06.959964 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:06.959425 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c66cd878c-647rb"] Jul 14 10:10:07.041731 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.041691 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c66cd878c-647rb"] Jul 14 10:10:07.042008 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:10:07.041977 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gn8dw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7c66cd878c-647rb" podUID="4e4d3e35-da16-4608-a11b-f204b938fdea" Jul 14 10:10:07.070259 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.070225 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8dw\" (UniqueName: \"kubernetes.io/projected/4e4d3e35-da16-4608-a11b-f204b938fdea-kube-api-access-gn8dw\") pod \"authorino-7c66cd878c-647rb\" (UID: \"4e4d3e35-da16-4608-a11b-f204b938fdea\") " pod="kuadrant-system/authorino-7c66cd878c-647rb" Jul 14 10:10:07.070830 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.070789 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t9mm8"] Jul 14 10:10:07.073982 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:10:07.073955 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12db0b77_6f86_46e4_a88e_85ae8a294f04.slice/crio-1882595dd90d690dca700574879ff8ca831af81acad2f739aad7ffc008603e7e WatchSource:0}: Error finding container 1882595dd90d690dca700574879ff8ca831af81acad2f739aad7ffc008603e7e: Status 404 returned error can't find the container with id 1882595dd90d690dca700574879ff8ca831af81acad2f739aad7ffc008603e7e Jul 14 10:10:07.086973 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.086947 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-678b657679-qsvzh"] Jul 14 10:10:07.090180 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.090159 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:10:07.092841 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.092818 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 10:10:07.100680 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.100654 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-678b657679-qsvzh"] Jul 14 10:10:07.116963 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.116916 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" event={"ID":"12db0b77-6f86-46e4-a88e-85ae8a294f04","Type":"ContainerStarted","Data":"1882595dd90d690dca700574879ff8ca831af81acad2f739aad7ffc008603e7e"} Jul 14 10:10:07.116963 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.116953 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c66cd878c-647rb" Jul 14 10:10:07.123375 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.123350 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c66cd878c-647rb" Jul 14 10:10:07.170756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.170718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8dw\" (UniqueName: \"kubernetes.io/projected/4e4d3e35-da16-4608-a11b-f204b938fdea-kube-api-access-gn8dw\") pod \"authorino-7c66cd878c-647rb\" (UID: \"4e4d3e35-da16-4608-a11b-f204b938fdea\") " pod="kuadrant-system/authorino-7c66cd878c-647rb" Jul 14 10:10:07.170756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.170761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4txk\" (UniqueName: \"kubernetes.io/projected/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-kube-api-access-m4txk\") pod \"authorino-678b657679-qsvzh\" (UID: \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\") " pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:10:07.170987 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.170793 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-tls-cert\") pod \"authorino-678b657679-qsvzh\" (UID: \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\") " pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:10:07.179219 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.179188 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8dw\" (UniqueName: \"kubernetes.io/projected/4e4d3e35-da16-4608-a11b-f204b938fdea-kube-api-access-gn8dw\") pod \"authorino-7c66cd878c-647rb\" (UID: \"4e4d3e35-da16-4608-a11b-f204b938fdea\") " pod="kuadrant-system/authorino-7c66cd878c-647rb" Jul 14 10:10:07.272162 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.272086 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn8dw\" (UniqueName: \"kubernetes.io/projected/4e4d3e35-da16-4608-a11b-f204b938fdea-kube-api-access-gn8dw\") pod \"4e4d3e35-da16-4608-a11b-f204b938fdea\" (UID: \"4e4d3e35-da16-4608-a11b-f204b938fdea\") " Jul 14 10:10:07.272328 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.272202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4txk\" (UniqueName: \"kubernetes.io/projected/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-kube-api-access-m4txk\") pod \"authorino-678b657679-qsvzh\" (UID: \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\") " pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:10:07.272328 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.272253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-tls-cert\") pod \"authorino-678b657679-qsvzh\" (UID: \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\") " pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:10:07.274446 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.274415 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e4d3e35-da16-4608-a11b-f204b938fdea-kube-api-access-gn8dw" (OuterVolumeSpecName: "kube-api-access-gn8dw") pod "4e4d3e35-da16-4608-a11b-f204b938fdea" (UID: "4e4d3e35-da16-4608-a11b-f204b938fdea"). InnerVolumeSpecName "kube-api-access-gn8dw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:10:07.274886 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.274869 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-tls-cert\") pod \"authorino-678b657679-qsvzh\" (UID: \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\") " pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:10:07.280862 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.280837 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4txk\" (UniqueName: \"kubernetes.io/projected/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-kube-api-access-m4txk\") pod \"authorino-678b657679-qsvzh\" (UID: \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\") " pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:10:07.373071 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.373040 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn8dw\" (UniqueName: \"kubernetes.io/projected/4e4d3e35-da16-4608-a11b-f204b938fdea-kube-api-access-gn8dw\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:10:07.399534 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.399506 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:10:07.560501 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:07.560251 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-678b657679-qsvzh"] Jul 14 10:10:07.563226 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:10:07.563194 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67a2f3d2_d0b4_492e_adc4_86e1a05c3240.slice/crio-e605c240c1e21543e7f62d6d6467dec905e84b149ba064923a89d71a9f413300 WatchSource:0}: Error finding container e605c240c1e21543e7f62d6d6467dec905e84b149ba064923a89d71a9f413300: Status 404 returned error can't find the container with id e605c240c1e21543e7f62d6d6467dec905e84b149ba064923a89d71a9f413300 Jul 14 10:10:08.124087 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.124052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-678b657679-qsvzh" event={"ID":"67a2f3d2-d0b4-492e-adc4-86e1a05c3240","Type":"ContainerStarted","Data":"e605c240c1e21543e7f62d6d6467dec905e84b149ba064923a89d71a9f413300"} Jul 14 10:10:08.125521 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.125485 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" event={"ID":"12db0b77-6f86-46e4-a88e-85ae8a294f04","Type":"ContainerStarted","Data":"87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032"} Jul 14 10:10:08.125653 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.125521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c66cd878c-647rb" Jul 14 10:10:08.125653 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.125530 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" podUID="12db0b77-6f86-46e4-a88e-85ae8a294f04" containerName="authorino" containerID="cri-o://87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032" gracePeriod=30 Jul 14 10:10:08.145183 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.145096 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" podStartSLOduration=1.833518057 podStartE2EDuration="2.145079559s" totalImagesPullingTime="311.561502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:10:08.143647379 +0000 UTC m=+596.241035580" watchObservedRunningTime="2026-07-14 10:10:08.145079559 +0000 UTC m=+596.242467760" Jul 14 10:10:08.171864 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.171831 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c66cd878c-647rb"] Jul 14 10:10:08.174580 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.174555 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c66cd878c-647rb"] Jul 14 10:10:08.396019 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.395997 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" Jul 14 10:10:08.450420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.450384 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e4d3e35-da16-4608-a11b-f204b938fdea" path="/var/lib/kubelet/pods/4e4d3e35-da16-4608-a11b-f204b938fdea/volumes" Jul 14 10:10:08.483866 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.483825 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx2pf\" (UniqueName: \"kubernetes.io/projected/12db0b77-6f86-46e4-a88e-85ae8a294f04-kube-api-access-nx2pf\") pod \"12db0b77-6f86-46e4-a88e-85ae8a294f04\" (UID: \"12db0b77-6f86-46e4-a88e-85ae8a294f04\") " Jul 14 10:10:08.486072 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.486045 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12db0b77-6f86-46e4-a88e-85ae8a294f04-kube-api-access-nx2pf" (OuterVolumeSpecName: "kube-api-access-nx2pf") pod "12db0b77-6f86-46e4-a88e-85ae8a294f04" (UID: "12db0b77-6f86-46e4-a88e-85ae8a294f04"). InnerVolumeSpecName "kube-api-access-nx2pf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:10:08.584686 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:08.584644 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx2pf\" (UniqueName: \"kubernetes.io/projected/12db0b77-6f86-46e4-a88e-85ae8a294f04-kube-api-access-nx2pf\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:10:09.133493 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.133399 2561 generic.go:356] "Generic (PLEG): container finished" podID="12db0b77-6f86-46e4-a88e-85ae8a294f04" containerID="87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032" exitCode=0 Jul 14 10:10:09.133493 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.133450 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" Jul 14 10:10:09.134063 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.133493 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" event={"ID":"12db0b77-6f86-46e4-a88e-85ae8a294f04","Type":"ContainerDied","Data":"87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032"} Jul 14 10:10:09.134063 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.133537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-t9mm8" event={"ID":"12db0b77-6f86-46e4-a88e-85ae8a294f04","Type":"ContainerDied","Data":"1882595dd90d690dca700574879ff8ca831af81acad2f739aad7ffc008603e7e"} Jul 14 10:10:09.134063 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.133560 2561 scope.go:117] "RemoveContainer" containerID="87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032" Jul 14 10:10:09.135315 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.135287 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-678b657679-qsvzh" event={"ID":"67a2f3d2-d0b4-492e-adc4-86e1a05c3240","Type":"ContainerStarted","Data":"00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb"} Jul 14 10:10:09.149298 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.149278 2561 scope.go:117] "RemoveContainer" containerID="87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032" Jul 14 10:10:09.149626 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:10:09.149608 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032\": container with ID starting with 87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032 not found: ID does not exist" containerID="87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032" Jul 14 10:10:09.149670 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.149634 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032"} err="failed to get container status \"87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032\": rpc error: code = NotFound desc = could not find container \"87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032\": container with ID starting with 87f0c1be254e161c69256c377591da02f10c6e50dc3ed5b12391521088caf032 not found: ID does not exist" Jul 14 10:10:09.157581 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.157527 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-678b657679-qsvzh" podStartSLOduration=1.435624979 podStartE2EDuration="2.157513046s" totalImagesPullingTime="721.888067ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:10:09.155845778 +0000 UTC m=+597.253233982" watchObservedRunningTime="2026-07-14 10:10:09.157513046 +0000 UTC m=+597.254901256" Jul 14 10:10:09.171977 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.171935 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t9mm8"] Jul 14 10:10:09.177839 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.177790 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t9mm8"] Jul 14 10:10:09.184168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.184139 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bsbpq"] Jul 14 10:10:09.184448 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.184378 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bsbpq" podUID="a3453d77-89e1-44e0-8ed9-29e5782d1c1d" containerName="authorino" containerID="cri-o://154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa" gracePeriod=30 Jul 14 10:10:09.485681 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.485646 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bsbpq" Jul 14 10:10:09.593087 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.593055 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnl92\" (UniqueName: \"kubernetes.io/projected/a3453d77-89e1-44e0-8ed9-29e5782d1c1d-kube-api-access-fnl92\") pod \"a3453d77-89e1-44e0-8ed9-29e5782d1c1d\" (UID: \"a3453d77-89e1-44e0-8ed9-29e5782d1c1d\") " Jul 14 10:10:09.595450 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.595415 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3453d77-89e1-44e0-8ed9-29e5782d1c1d-kube-api-access-fnl92" (OuterVolumeSpecName: "kube-api-access-fnl92") pod "a3453d77-89e1-44e0-8ed9-29e5782d1c1d" (UID: "a3453d77-89e1-44e0-8ed9-29e5782d1c1d"). InnerVolumeSpecName "kube-api-access-fnl92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:10:09.694157 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:09.694070 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnl92\" (UniqueName: \"kubernetes.io/projected/a3453d77-89e1-44e0-8ed9-29e5782d1c1d-kube-api-access-fnl92\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:10:10.142416 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.142380 2561 generic.go:356] "Generic (PLEG): container finished" podID="a3453d77-89e1-44e0-8ed9-29e5782d1c1d" containerID="154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa" exitCode=0 Jul 14 10:10:10.142416 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.142420 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bsbpq" Jul 14 10:10:10.142968 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.142471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bsbpq" event={"ID":"a3453d77-89e1-44e0-8ed9-29e5782d1c1d","Type":"ContainerDied","Data":"154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa"} Jul 14 10:10:10.142968 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.142515 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bsbpq" event={"ID":"a3453d77-89e1-44e0-8ed9-29e5782d1c1d","Type":"ContainerDied","Data":"345b06eac482d0b6701b8849dbed98390abe7bf1b8414b79161b896ef8672809"} Jul 14 10:10:10.142968 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.142540 2561 scope.go:117] "RemoveContainer" containerID="154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa" Jul 14 10:10:10.151474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.151461 2561 scope.go:117] "RemoveContainer" containerID="154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa" Jul 14 10:10:10.151717 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:10:10.151699 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa\": container with ID starting with 154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa not found: ID does not exist" containerID="154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa" Jul 14 10:10:10.151766 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.151727 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa"} err="failed to get container status \"154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa\": rpc error: code = NotFound desc = could not find container \"154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa\": container with ID starting with 154a811ef7f03095a8ef341c637e27d588bda52b76adc7f0c1e1f9b81eebc8aa not found: ID does not exist" Jul 14 10:10:10.168683 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.168657 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bsbpq"] Jul 14 10:10:10.170657 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.170633 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bsbpq"] Jul 14 10:10:10.448301 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.448226 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12db0b77-6f86-46e4-a88e-85ae8a294f04" path="/var/lib/kubelet/pods/12db0b77-6f86-46e4-a88e-85ae8a294f04/volumes" Jul 14 10:10:10.448536 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:10.448522 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3453d77-89e1-44e0-8ed9-29e5782d1c1d" path="/var/lib/kubelet/pods/a3453d77-89e1-44e0-8ed9-29e5782d1c1d/volumes" Jul 14 10:10:12.383286 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:12.383249 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:10:12.383866 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:12.383652 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:10:12.388092 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:12.388065 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:10:12.388761 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:12.388736 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:10:49.709242 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.709162 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7b86d949f5-xxtsh"] Jul 14 10:10:49.709726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.709509 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12db0b77-6f86-46e4-a88e-85ae8a294f04" containerName="authorino" Jul 14 10:10:49.709726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.709520 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="12db0b77-6f86-46e4-a88e-85ae8a294f04" containerName="authorino" Jul 14 10:10:49.709726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.709541 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3453d77-89e1-44e0-8ed9-29e5782d1c1d" containerName="authorino" Jul 14 10:10:49.709726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.709546 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3453d77-89e1-44e0-8ed9-29e5782d1c1d" containerName="authorino" Jul 14 10:10:49.709726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.709602 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="12db0b77-6f86-46e4-a88e-85ae8a294f04" containerName="authorino" Jul 14 10:10:49.709726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.709609 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3453d77-89e1-44e0-8ed9-29e5782d1c1d" containerName="authorino" Jul 14 10:10:49.711727 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.711710 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:49.714483 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.714457 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 14 10:10:49.714582 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.714489 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8pvgw\"" Jul 14 10:10:49.724553 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.724525 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b86d949f5-xxtsh"] Jul 14 10:10:49.860705 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.860666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rv6l\" (UniqueName: \"kubernetes.io/projected/799383aa-d7dc-4677-b889-e457eb85ddec-kube-api-access-4rv6l\") pod \"maas-api-7b86d949f5-xxtsh\" (UID: \"799383aa-d7dc-4677-b889-e457eb85ddec\") " pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:49.860705 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.860711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/799383aa-d7dc-4677-b889-e457eb85ddec-openshift-service-ca\") pod \"maas-api-7b86d949f5-xxtsh\" (UID: \"799383aa-d7dc-4677-b889-e457eb85ddec\") " pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:49.860980 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.860738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/799383aa-d7dc-4677-b889-e457eb85ddec-maas-api-tls\") pod \"maas-api-7b86d949f5-xxtsh\" (UID: \"799383aa-d7dc-4677-b889-e457eb85ddec\") " pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:49.961902 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.961786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/799383aa-d7dc-4677-b889-e457eb85ddec-openshift-service-ca\") pod \"maas-api-7b86d949f5-xxtsh\" (UID: \"799383aa-d7dc-4677-b889-e457eb85ddec\") " pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:49.961902 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.961866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/799383aa-d7dc-4677-b889-e457eb85ddec-maas-api-tls\") pod \"maas-api-7b86d949f5-xxtsh\" (UID: \"799383aa-d7dc-4677-b889-e457eb85ddec\") " pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:49.962098 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.961947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rv6l\" (UniqueName: \"kubernetes.io/projected/799383aa-d7dc-4677-b889-e457eb85ddec-kube-api-access-4rv6l\") pod \"maas-api-7b86d949f5-xxtsh\" (UID: \"799383aa-d7dc-4677-b889-e457eb85ddec\") " pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:49.962485 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.962461 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/799383aa-d7dc-4677-b889-e457eb85ddec-openshift-service-ca\") pod \"maas-api-7b86d949f5-xxtsh\" (UID: \"799383aa-d7dc-4677-b889-e457eb85ddec\") " pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:49.964479 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.964457 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/799383aa-d7dc-4677-b889-e457eb85ddec-maas-api-tls\") pod \"maas-api-7b86d949f5-xxtsh\" (UID: \"799383aa-d7dc-4677-b889-e457eb85ddec\") " pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:49.971551 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:49.971520 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rv6l\" (UniqueName: \"kubernetes.io/projected/799383aa-d7dc-4677-b889-e457eb85ddec-kube-api-access-4rv6l\") pod \"maas-api-7b86d949f5-xxtsh\" (UID: \"799383aa-d7dc-4677-b889-e457eb85ddec\") " pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:50.022383 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.022345 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:50.173068 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.173043 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b86d949f5-xxtsh"] Jul 14 10:10:50.175433 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:10:50.175395 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799383aa_d7dc_4677_b889_e457eb85ddec.slice/crio-4737f4fba75ea6d32472f03ce3a961a49e5615af748023d9ea34402f5a3bf0be WatchSource:0}: Error finding container 4737f4fba75ea6d32472f03ce3a961a49e5615af748023d9ea34402f5a3bf0be: Status 404 returned error can't find the container with id 4737f4fba75ea6d32472f03ce3a961a49e5615af748023d9ea34402f5a3bf0be Jul 14 10:10:50.177346 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.177327 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zctmt"] Jul 14 10:10:50.180865 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.180844 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:10:50.187275 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.187251 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 10:10:50.187421 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.187253 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9m8fd\"" Jul 14 10:10:50.195041 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.195013 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zctmt"] Jul 14 10:10:50.203598 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.203561 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-c6htm"] Jul 14 10:10:50.207191 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.207157 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:10:50.217410 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.217383 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-c6htm"] Jul 14 10:10:50.265202 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.265166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhlw4\" (UniqueName: \"kubernetes.io/projected/ddf45e71-8c92-4559-b345-21893599e1dc-kube-api-access-lhlw4\") pod \"payload-pre-processing-7964457696-zctmt\" (UID: \"ddf45e71-8c92-4559-b345-21893599e1dc\") " pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:10:50.265395 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.265224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddf45e71-8c92-4559-b345-21893599e1dc-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zctmt\" (UID: \"ddf45e71-8c92-4559-b345-21893599e1dc\") " pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:10:50.334824 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.334755 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b86d949f5-xxtsh" event={"ID":"799383aa-d7dc-4677-b889-e457eb85ddec","Type":"ContainerStarted","Data":"4737f4fba75ea6d32472f03ce3a961a49e5615af748023d9ea34402f5a3bf0be"} Jul 14 10:10:50.365886 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.365847 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ch2d\" (UniqueName: \"kubernetes.io/projected/62883907-cebc-40c6-bb12-0ddb8f4c1f16-kube-api-access-5ch2d\") pod \"payload-processing-58f86c7798-c6htm\" (UID: \"62883907-cebc-40c6-bb12-0ddb8f4c1f16\") " pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:10:50.366056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.365917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhlw4\" (UniqueName: \"kubernetes.io/projected/ddf45e71-8c92-4559-b345-21893599e1dc-kube-api-access-lhlw4\") pod \"payload-pre-processing-7964457696-zctmt\" (UID: \"ddf45e71-8c92-4559-b345-21893599e1dc\") " pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:10:50.366056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.365960 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62883907-cebc-40c6-bb12-0ddb8f4c1f16-plugins-config-volume\") pod \"payload-processing-58f86c7798-c6htm\" (UID: \"62883907-cebc-40c6-bb12-0ddb8f4c1f16\") " pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:10:50.366056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.365983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddf45e71-8c92-4559-b345-21893599e1dc-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zctmt\" (UID: \"ddf45e71-8c92-4559-b345-21893599e1dc\") " pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:10:50.366643 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.366625 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ddf45e71-8c92-4559-b345-21893599e1dc-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zctmt\" (UID: \"ddf45e71-8c92-4559-b345-21893599e1dc\") " pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:10:50.375999 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.375972 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhlw4\" (UniqueName: \"kubernetes.io/projected/ddf45e71-8c92-4559-b345-21893599e1dc-kube-api-access-lhlw4\") pod \"payload-pre-processing-7964457696-zctmt\" (UID: \"ddf45e71-8c92-4559-b345-21893599e1dc\") " pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:10:50.467110 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.467010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62883907-cebc-40c6-bb12-0ddb8f4c1f16-plugins-config-volume\") pod \"payload-processing-58f86c7798-c6htm\" (UID: \"62883907-cebc-40c6-bb12-0ddb8f4c1f16\") " pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:10:50.467110 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.467077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ch2d\" (UniqueName: \"kubernetes.io/projected/62883907-cebc-40c6-bb12-0ddb8f4c1f16-kube-api-access-5ch2d\") pod \"payload-processing-58f86c7798-c6htm\" (UID: \"62883907-cebc-40c6-bb12-0ddb8f4c1f16\") " pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:10:50.467725 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.467694 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62883907-cebc-40c6-bb12-0ddb8f4c1f16-plugins-config-volume\") pod \"payload-processing-58f86c7798-c6htm\" (UID: \"62883907-cebc-40c6-bb12-0ddb8f4c1f16\") " pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:10:50.475898 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.475866 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ch2d\" (UniqueName: \"kubernetes.io/projected/62883907-cebc-40c6-bb12-0ddb8f4c1f16-kube-api-access-5ch2d\") pod \"payload-processing-58f86c7798-c6htm\" (UID: \"62883907-cebc-40c6-bb12-0ddb8f4c1f16\") " pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:10:50.493750 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.493717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:10:50.520175 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.520139 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:10:50.650514 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.650478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zctmt"] Jul 14 10:10:50.651432 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:10:50.651401 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf45e71_8c92_4559_b345_21893599e1dc.slice/crio-960bc7bcaee2f2e2d7e0900303163338aff78faa801ecba83f1b399f94a0a508 WatchSource:0}: Error finding container 960bc7bcaee2f2e2d7e0900303163338aff78faa801ecba83f1b399f94a0a508: Status 404 returned error can't find the container with id 960bc7bcaee2f2e2d7e0900303163338aff78faa801ecba83f1b399f94a0a508 Jul 14 10:10:50.679335 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:50.679309 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-c6htm"] Jul 14 10:10:50.681472 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:10:50.681445 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62883907_cebc_40c6_bb12_0ddb8f4c1f16.slice/crio-1cca553925e0ac09d554963a1ff24795024a9c6cdaa9afe1eea4666847233805 WatchSource:0}: Error finding container 1cca553925e0ac09d554963a1ff24795024a9c6cdaa9afe1eea4666847233805: Status 404 returned error can't find the container with id 1cca553925e0ac09d554963a1ff24795024a9c6cdaa9afe1eea4666847233805 Jul 14 10:10:51.345631 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:51.345559 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-c6htm" event={"ID":"62883907-cebc-40c6-bb12-0ddb8f4c1f16","Type":"ContainerStarted","Data":"1cca553925e0ac09d554963a1ff24795024a9c6cdaa9afe1eea4666847233805"} Jul 14 10:10:51.347517 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:51.347482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" event={"ID":"ddf45e71-8c92-4559-b345-21893599e1dc","Type":"ContainerStarted","Data":"960bc7bcaee2f2e2d7e0900303163338aff78faa801ecba83f1b399f94a0a508"} Jul 14 10:10:53.361045 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:53.361006 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-c6htm" event={"ID":"62883907-cebc-40c6-bb12-0ddb8f4c1f16","Type":"ContainerStarted","Data":"bc872d34dab4685a5d32e7a19edd503b0edaa6495f7c64016dd19558d1236eb9"} Jul 14 10:10:53.361697 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:53.361675 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:10:53.363647 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:53.363612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b86d949f5-xxtsh" event={"ID":"799383aa-d7dc-4677-b889-e457eb85ddec","Type":"ContainerStarted","Data":"0152ea244bb737a5d99e743f0b81857e7719b027ed3cd31e057d24c4ae8bdc66"} Jul 14 10:10:53.363787 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:53.363688 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:10:53.366059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:53.365539 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" event={"ID":"ddf45e71-8c92-4559-b345-21893599e1dc","Type":"ContainerStarted","Data":"5945f8b299d429b638ac777dc8f2bbcde9ca2cc1544ec9376e0c002f91ae3535"} Jul 14 10:10:53.366059 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:53.365677 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:10:53.381318 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:53.381253 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-c6htm" podStartSLOduration=0.884764318 podStartE2EDuration="3.381222574s" totalImagesPullingTime="2.496458256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:10:53.377788861 +0000 UTC m=+641.475177065" watchObservedRunningTime="2026-07-14 10:10:53.381222574 +0000 UTC m=+641.478610771" Jul 14 10:10:53.394149 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:53.394099 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" podStartSLOduration=0.870265882 podStartE2EDuration="3.39408288s" totalImagesPullingTime="2.523816998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:10:53.393279648 +0000 UTC m=+641.490667852" watchObservedRunningTime="2026-07-14 10:10:53.39408288 +0000 UTC m=+641.491471082" Jul 14 10:10:53.410809 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:53.410754 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7b86d949f5-xxtsh" podStartSLOduration=1.409705156 podStartE2EDuration="4.410738357s" totalImagesPullingTime="3.001033201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:10:53.409251102 +0000 UTC m=+641.506639304" watchObservedRunningTime="2026-07-14 10:10:53.410738357 +0000 UTC m=+641.508126604" Jul 14 10:10:59.376418 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:10:59.376384 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7b86d949f5-xxtsh" Jul 14 10:11:04.372784 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:04.372754 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-zctmt" Jul 14 10:11:05.377089 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:05.377055 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-c6htm" Jul 14 10:11:09.286880 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.286847 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh"] Jul 14 10:11:09.290337 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.290320 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.293402 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.293373 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 10:11:09.296398 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.296370 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 14 10:11:09.296594 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.296580 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j6fwv\"" Jul 14 10:11:09.296918 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.296894 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 10:11:09.311856 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.311819 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh"] Jul 14 10:11:09.335359 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.335318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.335359 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.335358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.335566 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.335474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6rts\" (UniqueName: \"kubernetes.io/projected/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-kube-api-access-w6rts\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.335566 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.335510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.335652 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.335536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.335652 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.335596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.436626 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.436588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.436626 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.436636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.436918 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.436662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.436918 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.436679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.436918 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.436740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6rts\" (UniqueName: \"kubernetes.io/projected/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-kube-api-access-w6rts\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.436918 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.436763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.437186 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.437163 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.437186 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.437177 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.437289 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.437242 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.439149 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.439126 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.439494 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.439474 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.448523 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.448497 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6rts\" (UniqueName: \"kubernetes.io/projected/6729ab0d-571a-4f8b-ac17-b3870c83e7b2-kube-api-access-w6rts\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh\" (UID: \"6729ab0d-571a-4f8b-ac17-b3870c83e7b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.601015 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.600910 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:09.748330 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:09.748252 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh"] Jul 14 10:11:09.750583 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:11:09.750555 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6729ab0d_571a_4f8b_ac17_b3870c83e7b2.slice/crio-9fd6f7c2054604a436256eec9736852dc5b7346ff88704440ac7287556588ff7 WatchSource:0}: Error finding container 9fd6f7c2054604a436256eec9736852dc5b7346ff88704440ac7287556588ff7: Status 404 returned error can't find the container with id 9fd6f7c2054604a436256eec9736852dc5b7346ff88704440ac7287556588ff7 Jul 14 10:11:10.452165 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:10.452118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" event={"ID":"6729ab0d-571a-4f8b-ac17-b3870c83e7b2","Type":"ContainerStarted","Data":"9fd6f7c2054604a436256eec9736852dc5b7346ff88704440ac7287556588ff7"} Jul 14 10:11:11.458823 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:11.458709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" event={"ID":"6729ab0d-571a-4f8b-ac17-b3870c83e7b2","Type":"ContainerStarted","Data":"fdf1fe41828dff4e08db3d744e6153c39d438d4bb2b74d1fc6bff2aaa398df92"} Jul 14 10:11:11.478883 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:11.478829 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" podStartSLOduration=1.146321104 podStartE2EDuration="2.478781117s" totalImagesPullingTime="1.332460013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:11:11.477272557 +0000 UTC m=+659.574660770" watchObservedRunningTime="2026-07-14 10:11:11.478781117 +0000 UTC m=+659.576169318" Jul 14 10:11:19.601450 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:19.601408 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:19.601865 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:19.601490 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:19.613918 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:19.613892 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:20.513541 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:20.513512 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh" Jul 14 10:11:59.151151 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.151119 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns"] Jul 14 10:11:59.154213 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.154190 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.157165 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.157144 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 14 10:11:59.165222 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.165199 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns"] Jul 14 10:11:59.192912 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.192883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.193073 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.192923 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.193073 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.192947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.193191 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.193072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.193191 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.193110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.193191 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.193156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxt6z\" (UniqueName: \"kubernetes.io/projected/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-kube-api-access-gxt6z\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.294468 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.294410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.294468 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.294466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.294733 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.294513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.294733 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.294539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.294733 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.294575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxt6z\" (UniqueName: \"kubernetes.io/projected/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-kube-api-access-gxt6z\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.294733 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.294654 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.294985 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.294864 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.294985 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.294944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.295080 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.294987 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.297168 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.297138 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.297307 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.297258 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.303483 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.303455 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxt6z\" (UniqueName: \"kubernetes.io/projected/7f2b31c9-7e18-41b1-9d52-7c14bd1462d0-kube-api-access-gxt6z\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns\" (UID: \"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.465003 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.464922 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:11:59.611972 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.611928 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns"] Jul 14 10:11:59.613186 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:11:59.613158 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f2b31c9_7e18_41b1_9d52_7c14bd1462d0.slice/crio-4e85318ab75716c4436e52eff26a7a3748de7bc02f854882e0d2cfc6240dae02 WatchSource:0}: Error finding container 4e85318ab75716c4436e52eff26a7a3748de7bc02f854882e0d2cfc6240dae02: Status 404 returned error can't find the container with id 4e85318ab75716c4436e52eff26a7a3748de7bc02f854882e0d2cfc6240dae02 Jul 14 10:11:59.615206 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.615185 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 10:11:59.695382 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:11:59.695347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" event={"ID":"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0","Type":"ContainerStarted","Data":"4e85318ab75716c4436e52eff26a7a3748de7bc02f854882e0d2cfc6240dae02"} Jul 14 10:12:00.701460 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:00.701424 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" event={"ID":"7f2b31c9-7e18-41b1-9d52-7c14bd1462d0","Type":"ContainerStarted","Data":"19491acbd506972e1b66b9796e88acd13ac857d6a2cee8f51d8f9a7103f3dad7"} Jul 14 10:12:00.722064 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:00.722014 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" podStartSLOduration=1.489131978 podStartE2EDuration="1.721997841s" totalImagesPullingTime="232.865863ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:12:00.72073109 +0000 UTC m=+708.818119292" watchObservedRunningTime="2026-07-14 10:12:00.721997841 +0000 UTC m=+708.819386086" Jul 14 10:12:09.465300 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:09.465188 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:12:09.465300 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:09.465248 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:12:09.478348 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:09.478314 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:12:09.758330 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:09.758247 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns" Jul 14 10:12:58.169467 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.169426 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6db6887458-mwj7b"] Jul 14 10:12:58.173287 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.173260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6db6887458-mwj7b" Jul 14 10:12:58.185028 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.184998 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6db6887458-mwj7b"] Jul 14 10:12:58.238478 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.238438 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkvd8\" (UniqueName: \"kubernetes.io/projected/75b3f8bb-7c5d-4493-bfed-81c3fb433325-kube-api-access-pkvd8\") pod \"authorino-6db6887458-mwj7b\" (UID: \"75b3f8bb-7c5d-4493-bfed-81c3fb433325\") " pod="kuadrant-system/authorino-6db6887458-mwj7b" Jul 14 10:12:58.238478 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.238495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75b3f8bb-7c5d-4493-bfed-81c3fb433325-tls-cert\") pod \"authorino-6db6887458-mwj7b\" (UID: \"75b3f8bb-7c5d-4493-bfed-81c3fb433325\") " pod="kuadrant-system/authorino-6db6887458-mwj7b" Jul 14 10:12:58.339753 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.339714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkvd8\" (UniqueName: \"kubernetes.io/projected/75b3f8bb-7c5d-4493-bfed-81c3fb433325-kube-api-access-pkvd8\") pod \"authorino-6db6887458-mwj7b\" (UID: \"75b3f8bb-7c5d-4493-bfed-81c3fb433325\") " pod="kuadrant-system/authorino-6db6887458-mwj7b" Jul 14 10:12:58.339977 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.339763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75b3f8bb-7c5d-4493-bfed-81c3fb433325-tls-cert\") pod \"authorino-6db6887458-mwj7b\" (UID: \"75b3f8bb-7c5d-4493-bfed-81c3fb433325\") " pod="kuadrant-system/authorino-6db6887458-mwj7b" Jul 14 10:12:58.342444 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.342413 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75b3f8bb-7c5d-4493-bfed-81c3fb433325-tls-cert\") pod \"authorino-6db6887458-mwj7b\" (UID: \"75b3f8bb-7c5d-4493-bfed-81c3fb433325\") " pod="kuadrant-system/authorino-6db6887458-mwj7b" Jul 14 10:12:58.348760 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.348721 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkvd8\" (UniqueName: \"kubernetes.io/projected/75b3f8bb-7c5d-4493-bfed-81c3fb433325-kube-api-access-pkvd8\") pod \"authorino-6db6887458-mwj7b\" (UID: \"75b3f8bb-7c5d-4493-bfed-81c3fb433325\") " pod="kuadrant-system/authorino-6db6887458-mwj7b" Jul 14 10:12:58.482121 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.482025 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6db6887458-mwj7b" Jul 14 10:12:58.627262 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.627235 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6db6887458-mwj7b"] Jul 14 10:12:58.629976 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:12:58.629943 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75b3f8bb_7c5d_4493_bfed_81c3fb433325.slice/crio-8039c04233f5d6eeee95763819c3151a7422969ff1da24752a84fe6dc48d5a22 WatchSource:0}: Error finding container 8039c04233f5d6eeee95763819c3151a7422969ff1da24752a84fe6dc48d5a22: Status 404 returned error can't find the container with id 8039c04233f5d6eeee95763819c3151a7422969ff1da24752a84fe6dc48d5a22 Jul 14 10:12:58.991076 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:58.991044 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6db6887458-mwj7b" event={"ID":"75b3f8bb-7c5d-4493-bfed-81c3fb433325","Type":"ContainerStarted","Data":"8039c04233f5d6eeee95763819c3151a7422969ff1da24752a84fe6dc48d5a22"} Jul 14 10:12:59.999822 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:12:59.999763 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6db6887458-mwj7b" event={"ID":"75b3f8bb-7c5d-4493-bfed-81c3fb433325","Type":"ContainerStarted","Data":"abe670d0621ca06fa094e7cbbbb0a96ec8dfea6d9e74a160058fa39cfe9c04af"} Jul 14 10:13:00.033522 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.033454 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6db6887458-mwj7b" podStartSLOduration=1.6727604440000001 podStartE2EDuration="2.033430616s" totalImagesPullingTime="360.670172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:13:00.029489954 +0000 UTC m=+768.126878156" watchObservedRunningTime="2026-07-14 10:13:00.033430616 +0000 UTC m=+768.130818819" Jul 14 10:13:00.117430 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.117388 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-678b657679-qsvzh"] Jul 14 10:13:00.117616 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.117594 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-678b657679-qsvzh" podUID="67a2f3d2-d0b4-492e-adc4-86e1a05c3240" containerName="authorino" containerID="cri-o://00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb" gracePeriod=30 Jul 14 10:13:00.384086 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.384055 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:13:00.463456 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.463414 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-tls-cert\") pod \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\" (UID: \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\") " Jul 14 10:13:00.463934 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.463907 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4txk\" (UniqueName: \"kubernetes.io/projected/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-kube-api-access-m4txk\") pod \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\" (UID: \"67a2f3d2-d0b4-492e-adc4-86e1a05c3240\") " Jul 14 10:13:00.466245 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.466210 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-kube-api-access-m4txk" (OuterVolumeSpecName: "kube-api-access-m4txk") pod "67a2f3d2-d0b4-492e-adc4-86e1a05c3240" (UID: "67a2f3d2-d0b4-492e-adc4-86e1a05c3240"). InnerVolumeSpecName "kube-api-access-m4txk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:13:00.475650 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.475618 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "67a2f3d2-d0b4-492e-adc4-86e1a05c3240" (UID: "67a2f3d2-d0b4-492e-adc4-86e1a05c3240"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:13:00.565239 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.565127 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-tls-cert\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:13:00.565239 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:00.565174 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4txk\" (UniqueName: \"kubernetes.io/projected/67a2f3d2-d0b4-492e-adc4-86e1a05c3240-kube-api-access-m4txk\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:13:01.007532 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:01.007441 2561 generic.go:356] "Generic (PLEG): container finished" podID="67a2f3d2-d0b4-492e-adc4-86e1a05c3240" containerID="00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb" exitCode=0 Jul 14 10:13:01.007532 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:01.007500 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-678b657679-qsvzh" Jul 14 10:13:01.008115 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:01.007533 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-678b657679-qsvzh" event={"ID":"67a2f3d2-d0b4-492e-adc4-86e1a05c3240","Type":"ContainerDied","Data":"00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb"} Jul 14 10:13:01.008115 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:01.007582 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-678b657679-qsvzh" event={"ID":"67a2f3d2-d0b4-492e-adc4-86e1a05c3240","Type":"ContainerDied","Data":"e605c240c1e21543e7f62d6d6467dec905e84b149ba064923a89d71a9f413300"} Jul 14 10:13:01.008115 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:01.007606 2561 scope.go:117] "RemoveContainer" containerID="00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb" Jul 14 10:13:01.017745 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:01.017721 2561 scope.go:117] "RemoveContainer" containerID="00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb" Jul 14 10:13:01.018137 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:13:01.018112 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb\": container with ID starting with 00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb not found: ID does not exist" containerID="00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb" Jul 14 10:13:01.018222 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:01.018152 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb"} err="failed to get container status \"00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb\": rpc error: code = NotFound desc = could not find container \"00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb\": container with ID starting with 00fba53bff236cd2818568b8ae24fbba389c724c19ccc60b24790024649f06fb not found: ID does not exist" Jul 14 10:13:01.035937 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:01.035903 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-678b657679-qsvzh"] Jul 14 10:13:01.042251 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:01.042214 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-678b657679-qsvzh"] Jul 14 10:13:02.455231 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:13:02.455197 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67a2f3d2-d0b4-492e-adc4-86e1a05c3240" path="/var/lib/kubelet/pods/67a2f3d2-d0b4-492e-adc4-86e1a05c3240/volumes" Jul 14 10:15:12.414866 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:15:12.414833 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:15:12.418043 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:15:12.418016 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:15:12.421030 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:15:12.421009 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:15:12.423506 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:15:12.423488 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:19:16.449011 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:16.448983 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn"] Jul 14 10:19:16.449465 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:16.449153 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" podUID="68d948b4-4d68-497a-9a6b-a140b1b71425" containerName="manager" containerID="cri-o://3ae46eb28df41606cb8bb9228ce98b01e997a71661720abbfb2aca81913b1b39" gracePeriod=10 Jul 14 10:19:18.918982 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:18.918946 2561 generic.go:356] "Generic (PLEG): container finished" podID="68d948b4-4d68-497a-9a6b-a140b1b71425" containerID="3ae46eb28df41606cb8bb9228ce98b01e997a71661720abbfb2aca81913b1b39" exitCode=0 Jul 14 10:19:18.919353 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:18.919027 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" event={"ID":"68d948b4-4d68-497a-9a6b-a140b1b71425","Type":"ContainerDied","Data":"3ae46eb28df41606cb8bb9228ce98b01e997a71661720abbfb2aca81913b1b39"} Jul 14 10:19:19.514742 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.514715 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:19:19.670268 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.670159 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlt28\" (UniqueName: \"kubernetes.io/projected/68d948b4-4d68-497a-9a6b-a140b1b71425-kube-api-access-vlt28\") pod \"68d948b4-4d68-497a-9a6b-a140b1b71425\" (UID: \"68d948b4-4d68-497a-9a6b-a140b1b71425\") " Jul 14 10:19:19.670268 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.670196 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d948b4-4d68-497a-9a6b-a140b1b71425-extensions-socket-volume\") pod \"68d948b4-4d68-497a-9a6b-a140b1b71425\" (UID: \"68d948b4-4d68-497a-9a6b-a140b1b71425\") " Jul 14 10:19:19.670598 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.670574 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68d948b4-4d68-497a-9a6b-a140b1b71425-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "68d948b4-4d68-497a-9a6b-a140b1b71425" (UID: "68d948b4-4d68-497a-9a6b-a140b1b71425"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:19:19.672479 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.672453 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68d948b4-4d68-497a-9a6b-a140b1b71425-kube-api-access-vlt28" (OuterVolumeSpecName: "kube-api-access-vlt28") pod "68d948b4-4d68-497a-9a6b-a140b1b71425" (UID: "68d948b4-4d68-497a-9a6b-a140b1b71425"). InnerVolumeSpecName "kube-api-access-vlt28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:19:19.771603 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.771558 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlt28\" (UniqueName: \"kubernetes.io/projected/68d948b4-4d68-497a-9a6b-a140b1b71425-kube-api-access-vlt28\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:19:19.771603 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.771593 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d948b4-4d68-497a-9a6b-a140b1b71425-extensions-socket-volume\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:19:19.925409 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.925323 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" Jul 14 10:19:19.925409 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.925358 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn" event={"ID":"68d948b4-4d68-497a-9a6b-a140b1b71425","Type":"ContainerDied","Data":"ec56f624df90466ec3585b07b74e94410daa585b4f08bb33e48f1cdeead092c5"} Jul 14 10:19:19.926064 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.925417 2561 scope.go:117] "RemoveContainer" containerID="3ae46eb28df41606cb8bb9228ce98b01e997a71661720abbfb2aca81913b1b39" Jul 14 10:19:19.948133 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.948093 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn"] Jul 14 10:19:19.954905 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:19.954880 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gcbn"] Jul 14 10:19:20.449218 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:19:20.449186 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68d948b4-4d68-497a-9a6b-a140b1b71425" path="/var/lib/kubelet/pods/68d948b4-4d68-497a-9a6b-a140b1b71425/volumes" Jul 14 10:20:12.452210 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:12.452180 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:20:12.455384 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:12.455360 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:20:12.456918 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:12.456895 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:20:12.459948 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:12.459927 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:20:17.644384 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.644349 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg"] Jul 14 10:20:17.644954 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.644934 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68d948b4-4d68-497a-9a6b-a140b1b71425" containerName="manager" Jul 14 10:20:17.645042 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.644957 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d948b4-4d68-497a-9a6b-a140b1b71425" containerName="manager" Jul 14 10:20:17.645042 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.644991 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67a2f3d2-d0b4-492e-adc4-86e1a05c3240" containerName="authorino" Jul 14 10:20:17.645042 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.644999 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="67a2f3d2-d0b4-492e-adc4-86e1a05c3240" containerName="authorino" Jul 14 10:20:17.645182 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.645103 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="67a2f3d2-d0b4-492e-adc4-86e1a05c3240" containerName="authorino" Jul 14 10:20:17.645182 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.645119 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="68d948b4-4d68-497a-9a6b-a140b1b71425" containerName="manager" Jul 14 10:20:17.649126 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.649103 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:20:17.652813 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.652783 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h9tp9\"" Jul 14 10:20:17.670055 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.670026 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg"] Jul 14 10:20:17.794169 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.794117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28740ca1-490e-484b-a1bf-695c8cdd12c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xd8rg\" (UID: \"28740ca1-490e-484b-a1bf-695c8cdd12c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:20:17.794366 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.794231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d42l\" (UniqueName: \"kubernetes.io/projected/28740ca1-490e-484b-a1bf-695c8cdd12c0-kube-api-access-7d42l\") pod \"kuadrant-operator-controller-manager-86878c769f-xd8rg\" (UID: \"28740ca1-490e-484b-a1bf-695c8cdd12c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:20:17.895179 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.895078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d42l\" (UniqueName: \"kubernetes.io/projected/28740ca1-490e-484b-a1bf-695c8cdd12c0-kube-api-access-7d42l\") pod \"kuadrant-operator-controller-manager-86878c769f-xd8rg\" (UID: \"28740ca1-490e-484b-a1bf-695c8cdd12c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:20:17.895179 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.895157 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28740ca1-490e-484b-a1bf-695c8cdd12c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xd8rg\" (UID: \"28740ca1-490e-484b-a1bf-695c8cdd12c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:20:17.895502 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.895484 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28740ca1-490e-484b-a1bf-695c8cdd12c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xd8rg\" (UID: \"28740ca1-490e-484b-a1bf-695c8cdd12c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:20:17.904844 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.904791 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d42l\" (UniqueName: \"kubernetes.io/projected/28740ca1-490e-484b-a1bf-695c8cdd12c0-kube-api-access-7d42l\") pod \"kuadrant-operator-controller-manager-86878c769f-xd8rg\" (UID: \"28740ca1-490e-484b-a1bf-695c8cdd12c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:20:17.959265 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:17.959228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:20:18.108247 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:18.108214 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg"] Jul 14 10:20:18.110988 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:20:18.110957 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28740ca1_490e_484b_a1bf_695c8cdd12c0.slice/crio-1c888934847da3a40dd0965bbdc6703d64d092bd28b3d9631167360b7c51e025 WatchSource:0}: Error finding container 1c888934847da3a40dd0965bbdc6703d64d092bd28b3d9631167360b7c51e025: Status 404 returned error can't find the container with id 1c888934847da3a40dd0965bbdc6703d64d092bd28b3d9631167360b7c51e025 Jul 14 10:20:18.220156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:18.220118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" event={"ID":"28740ca1-490e-484b-a1bf-695c8cdd12c0","Type":"ContainerStarted","Data":"399a4d7ff3dc6d42f13d428630f1bc9a1a6c33e1b8534096a38e5d2cc1ffa188"} Jul 14 10:20:18.220365 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:18.220188 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" event={"ID":"28740ca1-490e-484b-a1bf-695c8cdd12c0","Type":"ContainerStarted","Data":"1c888934847da3a40dd0965bbdc6703d64d092bd28b3d9631167360b7c51e025"} Jul 14 10:20:18.220365 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:18.220217 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:20:18.244444 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:18.244393 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" podStartSLOduration=1.244375544 podStartE2EDuration="1.244375544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:20:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:20:18.242494405 +0000 UTC m=+1206.339882609" watchObservedRunningTime="2026-07-14 10:20:18.244375544 +0000 UTC m=+1206.341763817" Jul 14 10:20:29.229256 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:20:29.229223 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xd8rg" Jul 14 10:25:12.492409 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:25:12.492367 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:25:12.518228 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:25:12.518203 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:25:12.518860 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:25:12.518835 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:25:12.523813 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:25:12.523783 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:26:18.665454 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.665418 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8"] Jul 14 10:26:18.669219 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.669200 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:18.671894 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.671875 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-62d45e95-serving-cert\"" Jul 14 10:26:18.679614 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.679588 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8"] Jul 14 10:26:18.826452 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.826410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c66fc-f78f-4f03-8092-97116dc7d649-openshift-service-ca\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:18.826452 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.826460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nm4h\" (UniqueName: \"kubernetes.io/projected/064c66fc-f78f-4f03-8092-97116dc7d649-kube-api-access-6nm4h\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:18.826675 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.826481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/064c66fc-f78f-4f03-8092-97116dc7d649-maas-api-tls\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:18.927676 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.927566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c66fc-f78f-4f03-8092-97116dc7d649-openshift-service-ca\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:18.927676 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.927619 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nm4h\" (UniqueName: \"kubernetes.io/projected/064c66fc-f78f-4f03-8092-97116dc7d649-kube-api-access-6nm4h\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:18.927676 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.927641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/064c66fc-f78f-4f03-8092-97116dc7d649-maas-api-tls\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:18.927983 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:26:18.927751 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-62d45e95-serving-cert: secret "maas-api-e2e-ait-62d45e95-serving-cert" not found Jul 14 10:26:18.927983 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:26:18.927843 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064c66fc-f78f-4f03-8092-97116dc7d649-maas-api-tls podName:064c66fc-f78f-4f03-8092-97116dc7d649 nodeName:}" failed. No retries permitted until 2026-07-14 10:26:19.42781812 +0000 UTC m=+1567.525206300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/064c66fc-f78f-4f03-8092-97116dc7d649-maas-api-tls") pod "maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" (UID: "064c66fc-f78f-4f03-8092-97116dc7d649") : secret "maas-api-e2e-ait-62d45e95-serving-cert" not found Jul 14 10:26:18.928307 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.928287 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c66fc-f78f-4f03-8092-97116dc7d649-openshift-service-ca\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:18.937403 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:18.937368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nm4h\" (UniqueName: \"kubernetes.io/projected/064c66fc-f78f-4f03-8092-97116dc7d649-kube-api-access-6nm4h\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:19.431770 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:19.431719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/064c66fc-f78f-4f03-8092-97116dc7d649-maas-api-tls\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:19.434376 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:19.434348 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/064c66fc-f78f-4f03-8092-97116dc7d649-maas-api-tls\") pod \"maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:19.580525 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:19.580474 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:19.734559 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:19.734466 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8"] Jul 14 10:26:19.738147 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:26:19.738116 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064c66fc_f78f_4f03_8092_97116dc7d649.slice/crio-1e61e5b89a09a9a1f5af8b1c1a9d356f49b1cf0095ef81dcfba9bdd00cd1b9c6 WatchSource:0}: Error finding container 1e61e5b89a09a9a1f5af8b1c1a9d356f49b1cf0095ef81dcfba9bdd00cd1b9c6: Status 404 returned error can't find the container with id 1e61e5b89a09a9a1f5af8b1c1a9d356f49b1cf0095ef81dcfba9bdd00cd1b9c6 Jul 14 10:26:19.739456 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:19.739439 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 10:26:20.109160 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:20.109122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" event={"ID":"064c66fc-f78f-4f03-8092-97116dc7d649","Type":"ContainerStarted","Data":"1e61e5b89a09a9a1f5af8b1c1a9d356f49b1cf0095ef81dcfba9bdd00cd1b9c6"} Jul 14 10:26:21.116317 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:21.116278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" event={"ID":"064c66fc-f78f-4f03-8092-97116dc7d649","Type":"ContainerStarted","Data":"026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0"} Jul 14 10:26:21.116840 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:21.116452 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:21.137664 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:21.137593 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" podStartSLOduration=2.654967105 podStartE2EDuration="3.137572621s" totalImagesPullingTime="482.605516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:26:21.137176233 +0000 UTC m=+1569.234564436" watchObservedRunningTime="2026-07-14 10:26:21.137572621 +0000 UTC m=+1569.234960824" Jul 14 10:26:24.066651 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.066619 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8"] Jul 14 10:26:24.067215 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.066834 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" podUID="064c66fc-f78f-4f03-8092-97116dc7d649" containerName="maas-api" containerID="cri-o://026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0" gracePeriod=30 Jul 14 10:26:24.310496 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.310467 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:24.479153 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.479067 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/064c66fc-f78f-4f03-8092-97116dc7d649-maas-api-tls\") pod \"064c66fc-f78f-4f03-8092-97116dc7d649\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " Jul 14 10:26:24.479153 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.479131 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c66fc-f78f-4f03-8092-97116dc7d649-openshift-service-ca\") pod \"064c66fc-f78f-4f03-8092-97116dc7d649\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " Jul 14 10:26:24.479360 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.479166 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nm4h\" (UniqueName: \"kubernetes.io/projected/064c66fc-f78f-4f03-8092-97116dc7d649-kube-api-access-6nm4h\") pod \"064c66fc-f78f-4f03-8092-97116dc7d649\" (UID: \"064c66fc-f78f-4f03-8092-97116dc7d649\") " Jul 14 10:26:24.479537 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.479516 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064c66fc-f78f-4f03-8092-97116dc7d649-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "064c66fc-f78f-4f03-8092-97116dc7d649" (UID: "064c66fc-f78f-4f03-8092-97116dc7d649"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:26:24.481530 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.481506 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064c66fc-f78f-4f03-8092-97116dc7d649-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "064c66fc-f78f-4f03-8092-97116dc7d649" (UID: "064c66fc-f78f-4f03-8092-97116dc7d649"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:26:24.481645 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.481502 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064c66fc-f78f-4f03-8092-97116dc7d649-kube-api-access-6nm4h" (OuterVolumeSpecName: "kube-api-access-6nm4h") pod "064c66fc-f78f-4f03-8092-97116dc7d649" (UID: "064c66fc-f78f-4f03-8092-97116dc7d649"). InnerVolumeSpecName "kube-api-access-6nm4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:26:24.580129 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.580088 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c66fc-f78f-4f03-8092-97116dc7d649-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:26:24.580129 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.580118 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nm4h\" (UniqueName: \"kubernetes.io/projected/064c66fc-f78f-4f03-8092-97116dc7d649-kube-api-access-6nm4h\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:26:24.580129 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:24.580127 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/064c66fc-f78f-4f03-8092-97116dc7d649-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:26:25.137993 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:25.137955 2561 generic.go:356] "Generic (PLEG): container finished" podID="064c66fc-f78f-4f03-8092-97116dc7d649" containerID="026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0" exitCode=0 Jul 14 10:26:25.137993 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:25.137997 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" Jul 14 10:26:25.138476 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:25.138045 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" event={"ID":"064c66fc-f78f-4f03-8092-97116dc7d649","Type":"ContainerDied","Data":"026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0"} Jul 14 10:26:25.138476 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:25.138098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8" event={"ID":"064c66fc-f78f-4f03-8092-97116dc7d649","Type":"ContainerDied","Data":"1e61e5b89a09a9a1f5af8b1c1a9d356f49b1cf0095ef81dcfba9bdd00cd1b9c6"} Jul 14 10:26:25.138476 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:25.138129 2561 scope.go:117] "RemoveContainer" containerID="026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0" Jul 14 10:26:25.148747 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:25.148728 2561 scope.go:117] "RemoveContainer" containerID="026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0" Jul 14 10:26:25.149064 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:26:25.149045 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0\": container with ID starting with 026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0 not found: ID does not exist" containerID="026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0" Jul 14 10:26:25.149128 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:25.149075 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0"} err="failed to get container status \"026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0\": rpc error: code = NotFound desc = could not find container \"026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0\": container with ID starting with 026f873b68cd1f84a68b6917456467d2ebd6081498f8bc29be790beddc4511b0 not found: ID does not exist" Jul 14 10:26:25.163670 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:25.163626 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8"] Jul 14 10:26:25.170014 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:25.169987 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-62d45e95-7b7f6684b6-mjxh8"] Jul 14 10:26:26.448934 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:26.448899 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="064c66fc-f78f-4f03-8092-97116dc7d649" path="/var/lib/kubelet/pods/064c66fc-f78f-4f03-8092-97116dc7d649/volumes" Jul 14 10:26:32.246498 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.246465 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4"] Jul 14 10:26:32.246983 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.246966 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064c66fc-f78f-4f03-8092-97116dc7d649" containerName="maas-api" Jul 14 10:26:32.247039 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.246985 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="064c66fc-f78f-4f03-8092-97116dc7d649" containerName="maas-api" Jul 14 10:26:32.247076 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.247064 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="064c66fc-f78f-4f03-8092-97116dc7d649" containerName="maas-api" Jul 14 10:26:32.259499 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.259470 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.265466 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.265434 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4"] Jul 14 10:26:32.265667 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.265435 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-f5f99a2e-serving-cert\"" Jul 14 10:26:32.351048 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.351014 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18a68608-300c-4c65-baf8-c48dbf1dfe7d-openshift-service-ca\") pod \"maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.351246 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.351071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18a68608-300c-4c65-baf8-c48dbf1dfe7d-maas-api-tls\") pod \"maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.351246 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.351130 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwj8\" (UniqueName: \"kubernetes.io/projected/18a68608-300c-4c65-baf8-c48dbf1dfe7d-kube-api-access-7dwj8\") pod \"maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.451781 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.451750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18a68608-300c-4c65-baf8-c48dbf1dfe7d-maas-api-tls\") pod \"maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.451781 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.451784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwj8\" (UniqueName: \"kubernetes.io/projected/18a68608-300c-4c65-baf8-c48dbf1dfe7d-kube-api-access-7dwj8\") pod \"maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.452017 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.451878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18a68608-300c-4c65-baf8-c48dbf1dfe7d-openshift-service-ca\") pod \"maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.452534 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.452513 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18a68608-300c-4c65-baf8-c48dbf1dfe7d-openshift-service-ca\") pod \"maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.454357 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.454336 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18a68608-300c-4c65-baf8-c48dbf1dfe7d-maas-api-tls\") pod \"maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.461148 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.461118 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwj8\" (UniqueName: \"kubernetes.io/projected/18a68608-300c-4c65-baf8-c48dbf1dfe7d-kube-api-access-7dwj8\") pod \"maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.573927 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.573895 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:32.720880 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:32.720841 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4"] Jul 14 10:26:32.722987 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:26:32.722959 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a68608_300c_4c65_baf8_c48dbf1dfe7d.slice/crio-fb0d386e49fa2e6ea3e4432885dd7941cc4ee3c8d35b7943e53cdee829e4a46a WatchSource:0}: Error finding container fb0d386e49fa2e6ea3e4432885dd7941cc4ee3c8d35b7943e53cdee829e4a46a: Status 404 returned error can't find the container with id fb0d386e49fa2e6ea3e4432885dd7941cc4ee3c8d35b7943e53cdee829e4a46a Jul 14 10:26:33.184704 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:33.184661 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" event={"ID":"18a68608-300c-4c65-baf8-c48dbf1dfe7d","Type":"ContainerStarted","Data":"beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37"} Jul 14 10:26:33.184892 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:33.184754 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" event={"ID":"18a68608-300c-4c65-baf8-c48dbf1dfe7d","Type":"ContainerStarted","Data":"fb0d386e49fa2e6ea3e4432885dd7941cc4ee3c8d35b7943e53cdee829e4a46a"} Jul 14 10:26:33.184892 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:33.184858 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:33.204356 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:33.204301 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" podStartSLOduration=0.806223315 podStartE2EDuration="1.204282889s" totalImagesPullingTime="398.059574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:26:33.20268338 +0000 UTC m=+1581.300071585" watchObservedRunningTime="2026-07-14 10:26:33.204282889 +0000 UTC m=+1581.301671139" Jul 14 10:26:37.482249 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.482212 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4"] Jul 14 10:26:37.482730 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.482489 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" podUID="18a68608-300c-4c65-baf8-c48dbf1dfe7d" containerName="maas-api" containerID="cri-o://beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37" gracePeriod=30 Jul 14 10:26:37.736594 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.736524 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:37.802282 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.802245 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18a68608-300c-4c65-baf8-c48dbf1dfe7d-openshift-service-ca\") pod \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " Jul 14 10:26:37.802282 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.802286 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18a68608-300c-4c65-baf8-c48dbf1dfe7d-maas-api-tls\") pod \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " Jul 14 10:26:37.802553 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.802425 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dwj8\" (UniqueName: \"kubernetes.io/projected/18a68608-300c-4c65-baf8-c48dbf1dfe7d-kube-api-access-7dwj8\") pod \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\" (UID: \"18a68608-300c-4c65-baf8-c48dbf1dfe7d\") " Jul 14 10:26:37.802673 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.802643 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a68608-300c-4c65-baf8-c48dbf1dfe7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18a68608-300c-4c65-baf8-c48dbf1dfe7d" (UID: "18a68608-300c-4c65-baf8-c48dbf1dfe7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:26:37.802770 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.802753 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18a68608-300c-4c65-baf8-c48dbf1dfe7d-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:26:37.804562 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.804539 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a68608-300c-4c65-baf8-c48dbf1dfe7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18a68608-300c-4c65-baf8-c48dbf1dfe7d" (UID: "18a68608-300c-4c65-baf8-c48dbf1dfe7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:26:37.804647 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.804588 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a68608-300c-4c65-baf8-c48dbf1dfe7d-kube-api-access-7dwj8" (OuterVolumeSpecName: "kube-api-access-7dwj8") pod "18a68608-300c-4c65-baf8-c48dbf1dfe7d" (UID: "18a68608-300c-4c65-baf8-c48dbf1dfe7d"). InnerVolumeSpecName "kube-api-access-7dwj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:26:37.903290 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.903249 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18a68608-300c-4c65-baf8-c48dbf1dfe7d-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:26:37.903290 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:37.903281 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dwj8\" (UniqueName: \"kubernetes.io/projected/18a68608-300c-4c65-baf8-c48dbf1dfe7d-kube-api-access-7dwj8\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:26:38.211703 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.211664 2561 generic.go:356] "Generic (PLEG): container finished" podID="18a68608-300c-4c65-baf8-c48dbf1dfe7d" containerID="beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37" exitCode=0 Jul 14 10:26:38.211956 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.211710 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" Jul 14 10:26:38.211956 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.211717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" event={"ID":"18a68608-300c-4c65-baf8-c48dbf1dfe7d","Type":"ContainerDied","Data":"beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37"} Jul 14 10:26:38.211956 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.211771 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4" event={"ID":"18a68608-300c-4c65-baf8-c48dbf1dfe7d","Type":"ContainerDied","Data":"fb0d386e49fa2e6ea3e4432885dd7941cc4ee3c8d35b7943e53cdee829e4a46a"} Jul 14 10:26:38.211956 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.211834 2561 scope.go:117] "RemoveContainer" containerID="beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37" Jul 14 10:26:38.222618 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.222598 2561 scope.go:117] "RemoveContainer" containerID="beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37" Jul 14 10:26:38.223014 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:26:38.222989 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37\": container with ID starting with beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37 not found: ID does not exist" containerID="beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37" Jul 14 10:26:38.223128 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.223021 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37"} err="failed to get container status \"beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37\": rpc error: code = NotFound desc = could not find container \"beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37\": container with ID starting with beae5188be03229dc953955a72364d4d452a50968d9cb14c3476fa6063fe3e37 not found: ID does not exist" Jul 14 10:26:38.238274 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.238234 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4"] Jul 14 10:26:38.242144 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.242118 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-f5f99a2e-77965fdfff-dwgl4"] Jul 14 10:26:38.449452 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:38.449408 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a68608-300c-4c65-baf8-c48dbf1dfe7d" path="/var/lib/kubelet/pods/18a68608-300c-4c65-baf8-c48dbf1dfe7d/volumes" Jul 14 10:26:51.841325 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.841285 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc"] Jul 14 10:26:51.841789 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.841661 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a68608-300c-4c65-baf8-c48dbf1dfe7d" containerName="maas-api" Jul 14 10:26:51.841789 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.841673 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a68608-300c-4c65-baf8-c48dbf1dfe7d" containerName="maas-api" Jul 14 10:26:51.841789 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.841750 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a68608-300c-4c65-baf8-c48dbf1dfe7d" containerName="maas-api" Jul 14 10:26:51.844933 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.844912 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:51.849058 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.849036 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-1060a842-serving-cert\"" Jul 14 10:26:51.865077 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.865044 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc"] Jul 14 10:26:51.926220 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.926186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2120df1a-8c55-460f-b4fc-d0714e78ee7d-maas-api-tls\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:51.926220 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.926223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2120df1a-8c55-460f-b4fc-d0714e78ee7d-openshift-service-ca\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:51.926455 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:51.926360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtlnk\" (UniqueName: \"kubernetes.io/projected/2120df1a-8c55-460f-b4fc-d0714e78ee7d-kube-api-access-rtlnk\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:52.027408 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:52.027375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtlnk\" (UniqueName: \"kubernetes.io/projected/2120df1a-8c55-460f-b4fc-d0714e78ee7d-kube-api-access-rtlnk\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:52.027609 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:52.027428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2120df1a-8c55-460f-b4fc-d0714e78ee7d-maas-api-tls\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:52.027609 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:26:52.027518 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-1060a842-serving-cert: secret "maas-api-e2e-derive-1060a842-serving-cert" not found Jul 14 10:26:52.027609 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:52.027583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2120df1a-8c55-460f-b4fc-d0714e78ee7d-openshift-service-ca\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:52.027778 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:26:52.027711 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2120df1a-8c55-460f-b4fc-d0714e78ee7d-maas-api-tls podName:2120df1a-8c55-460f-b4fc-d0714e78ee7d nodeName:}" failed. No retries permitted until 2026-07-14 10:26:52.527655373 +0000 UTC m=+1600.625043554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2120df1a-8c55-460f-b4fc-d0714e78ee7d-maas-api-tls") pod "maas-api-e2e-derive-1060a842-948fc85c-7hqxc" (UID: "2120df1a-8c55-460f-b4fc-d0714e78ee7d") : secret "maas-api-e2e-derive-1060a842-serving-cert" not found Jul 14 10:26:52.028188 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:52.028169 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2120df1a-8c55-460f-b4fc-d0714e78ee7d-openshift-service-ca\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:52.043971 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:52.043945 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtlnk\" (UniqueName: \"kubernetes.io/projected/2120df1a-8c55-460f-b4fc-d0714e78ee7d-kube-api-access-rtlnk\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:52.532558 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:52.532514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2120df1a-8c55-460f-b4fc-d0714e78ee7d-maas-api-tls\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:52.535107 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:52.535084 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2120df1a-8c55-460f-b4fc-d0714e78ee7d-maas-api-tls\") pod \"maas-api-e2e-derive-1060a842-948fc85c-7hqxc\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:52.755745 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:52.755712 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:52.917376 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:52.917345 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc"] Jul 14 10:26:52.919556 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:26:52.919529 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2120df1a_8c55_460f_b4fc_d0714e78ee7d.slice/crio-adbaace152ce7da3ca950837eb3f4a3f479c07654963bb19d981533370437e75 WatchSource:0}: Error finding container adbaace152ce7da3ca950837eb3f4a3f479c07654963bb19d981533370437e75: Status 404 returned error can't find the container with id adbaace152ce7da3ca950837eb3f4a3f479c07654963bb19d981533370437e75 Jul 14 10:26:53.290139 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:53.290106 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" event={"ID":"2120df1a-8c55-460f-b4fc-d0714e78ee7d","Type":"ContainerStarted","Data":"adbaace152ce7da3ca950837eb3f4a3f479c07654963bb19d981533370437e75"} Jul 14 10:26:54.297169 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:54.297127 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" event={"ID":"2120df1a-8c55-460f-b4fc-d0714e78ee7d","Type":"ContainerStarted","Data":"73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b"} Jul 14 10:26:54.297723 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:54.297264 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:56.652669 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.652606 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" podStartSLOduration=5.287396514 podStartE2EDuration="5.652586038s" totalImagesPullingTime="365.189524ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:26:54.324628615 +0000 UTC m=+1602.422016828" watchObservedRunningTime="2026-07-14 10:26:56.652586038 +0000 UTC m=+1604.749974240" Jul 14 10:26:56.653146 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.653129 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc"] Jul 14 10:26:56.653340 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.653302 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" podUID="2120df1a-8c55-460f-b4fc-d0714e78ee7d" containerName="maas-api" containerID="cri-o://73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b" gracePeriod=30 Jul 14 10:26:56.918300 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.918272 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:56.977511 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.977467 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2120df1a-8c55-460f-b4fc-d0714e78ee7d-openshift-service-ca\") pod \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " Jul 14 10:26:56.977699 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.977518 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2120df1a-8c55-460f-b4fc-d0714e78ee7d-maas-api-tls\") pod \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " Jul 14 10:26:56.977699 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.977549 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtlnk\" (UniqueName: \"kubernetes.io/projected/2120df1a-8c55-460f-b4fc-d0714e78ee7d-kube-api-access-rtlnk\") pod \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\" (UID: \"2120df1a-8c55-460f-b4fc-d0714e78ee7d\") " Jul 14 10:26:56.977896 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.977875 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2120df1a-8c55-460f-b4fc-d0714e78ee7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2120df1a-8c55-460f-b4fc-d0714e78ee7d" (UID: "2120df1a-8c55-460f-b4fc-d0714e78ee7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:26:56.979891 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.979851 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2120df1a-8c55-460f-b4fc-d0714e78ee7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2120df1a-8c55-460f-b4fc-d0714e78ee7d" (UID: "2120df1a-8c55-460f-b4fc-d0714e78ee7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:26:56.980009 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:56.979911 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2120df1a-8c55-460f-b4fc-d0714e78ee7d-kube-api-access-rtlnk" (OuterVolumeSpecName: "kube-api-access-rtlnk") pod "2120df1a-8c55-460f-b4fc-d0714e78ee7d" (UID: "2120df1a-8c55-460f-b4fc-d0714e78ee7d"). InnerVolumeSpecName "kube-api-access-rtlnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:26:57.078403 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.078363 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2120df1a-8c55-460f-b4fc-d0714e78ee7d-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:26:57.078403 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.078400 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2120df1a-8c55-460f-b4fc-d0714e78ee7d-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:26:57.078611 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.078415 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtlnk\" (UniqueName: \"kubernetes.io/projected/2120df1a-8c55-460f-b4fc-d0714e78ee7d-kube-api-access-rtlnk\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:26:57.313593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.313554 2561 generic.go:356] "Generic (PLEG): container finished" podID="2120df1a-8c55-460f-b4fc-d0714e78ee7d" containerID="73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b" exitCode=0 Jul 14 10:26:57.313593 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.313596 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" Jul 14 10:26:57.313860 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.313641 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" event={"ID":"2120df1a-8c55-460f-b4fc-d0714e78ee7d","Type":"ContainerDied","Data":"73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b"} Jul 14 10:26:57.313860 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.313688 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc" event={"ID":"2120df1a-8c55-460f-b4fc-d0714e78ee7d","Type":"ContainerDied","Data":"adbaace152ce7da3ca950837eb3f4a3f479c07654963bb19d981533370437e75"} Jul 14 10:26:57.313860 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.313710 2561 scope.go:117] "RemoveContainer" containerID="73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b" Jul 14 10:26:57.323237 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.323215 2561 scope.go:117] "RemoveContainer" containerID="73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b" Jul 14 10:26:57.323512 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:26:57.323492 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b\": container with ID starting with 73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b not found: ID does not exist" containerID="73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b" Jul 14 10:26:57.323563 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.323522 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b"} err="failed to get container status \"73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b\": rpc error: code = NotFound desc = could not find container \"73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b\": container with ID starting with 73f062f9a3df881c871dfaefcaa9fe459a63f1fbc163c20bd8eaa6fa2072545b not found: ID does not exist" Jul 14 10:26:57.340723 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.340695 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc"] Jul 14 10:26:57.344714 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:57.344688 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-1060a842-948fc85c-7hqxc"] Jul 14 10:26:58.449000 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:26:58.448960 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2120df1a-8c55-460f-b4fc-d0714e78ee7d" path="/var/lib/kubelet/pods/2120df1a-8c55-460f-b4fc-d0714e78ee7d/volumes" Jul 14 10:28:47.995863 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:47.995774 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n"] Jul 14 10:28:47.996349 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:47.996234 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2120df1a-8c55-460f-b4fc-d0714e78ee7d" containerName="maas-api" Jul 14 10:28:47.996349 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:47.996247 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2120df1a-8c55-460f-b4fc-d0714e78ee7d" containerName="maas-api" Jul 14 10:28:47.996349 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:47.996322 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2120df1a-8c55-460f-b4fc-d0714e78ee7d" containerName="maas-api" Jul 14 10:28:47.999407 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:47.999388 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.002727 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.002703 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-288cd506-serving-cert\"" Jul 14 10:28:48.010611 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.010585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101465c-062e-4af1-ac27-d5b785658b38-openshift-service-ca\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.010732 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.010616 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1101465c-062e-4af1-ac27-d5b785658b38-maas-api-tls\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.010732 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.010687 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8ldp\" (UniqueName: \"kubernetes.io/projected/1101465c-062e-4af1-ac27-d5b785658b38-kube-api-access-m8ldp\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.019158 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.019127 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n"] Jul 14 10:28:48.111773 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.111733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8ldp\" (UniqueName: \"kubernetes.io/projected/1101465c-062e-4af1-ac27-d5b785658b38-kube-api-access-m8ldp\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.112014 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.111827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101465c-062e-4af1-ac27-d5b785658b38-openshift-service-ca\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.112014 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.111852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1101465c-062e-4af1-ac27-d5b785658b38-maas-api-tls\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.112014 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:28:48.111999 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-288cd506-serving-cert: secret "maas-api-e2e-mt-288cd506-serving-cert" not found Jul 14 10:28:48.112206 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:28:48.112047 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1101465c-062e-4af1-ac27-d5b785658b38-maas-api-tls podName:1101465c-062e-4af1-ac27-d5b785658b38 nodeName:}" failed. No retries permitted until 2026-07-14 10:28:48.612031847 +0000 UTC m=+1716.709420026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1101465c-062e-4af1-ac27-d5b785658b38-maas-api-tls") pod "maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" (UID: "1101465c-062e-4af1-ac27-d5b785658b38") : secret "maas-api-e2e-mt-288cd506-serving-cert" not found Jul 14 10:28:48.112557 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.112537 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101465c-062e-4af1-ac27-d5b785658b38-openshift-service-ca\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.129165 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.129130 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8ldp\" (UniqueName: \"kubernetes.io/projected/1101465c-062e-4af1-ac27-d5b785658b38-kube-api-access-m8ldp\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.615178 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.615132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1101465c-062e-4af1-ac27-d5b785658b38-maas-api-tls\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.617623 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.617593 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1101465c-062e-4af1-ac27-d5b785658b38-maas-api-tls\") pod \"maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:48.909953 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:48.909852 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:49.060143 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:49.060106 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n"] Jul 14 10:28:49.062547 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:28:49.062519 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1101465c_062e_4af1_ac27_d5b785658b38.slice/crio-0ba5c59ce2e326c0f04b620aed15677d37adf823001f3f976274c76fa7a5332f WatchSource:0}: Error finding container 0ba5c59ce2e326c0f04b620aed15677d37adf823001f3f976274c76fa7a5332f: Status 404 returned error can't find the container with id 0ba5c59ce2e326c0f04b620aed15677d37adf823001f3f976274c76fa7a5332f Jul 14 10:28:49.873000 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:49.872966 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" event={"ID":"1101465c-062e-4af1-ac27-d5b785658b38","Type":"ContainerStarted","Data":"0ba5c59ce2e326c0f04b620aed15677d37adf823001f3f976274c76fa7a5332f"} Jul 14 10:28:50.879932 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:50.879898 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" event={"ID":"1101465c-062e-4af1-ac27-d5b785658b38","Type":"ContainerStarted","Data":"f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e"} Jul 14 10:28:50.880431 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:50.880036 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:28:50.900938 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:50.900875 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" podStartSLOduration=3.146267409 podStartE2EDuration="3.900858058s" totalImagesPullingTime="754.590649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:28:50.900135567 +0000 UTC m=+1718.997523748" watchObservedRunningTime="2026-07-14 10:28:50.900858058 +0000 UTC m=+1718.998246262" Jul 14 10:28:56.890287 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:28:56.890254 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:29:02.132791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.132755 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n"] Jul 14 10:29:02.133226 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.133003 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" podUID="1101465c-062e-4af1-ac27-d5b785658b38" containerName="maas-api" containerID="cri-o://f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e" gracePeriod=30 Jul 14 10:29:02.393567 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.393500 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:29:02.452692 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.452663 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101465c-062e-4af1-ac27-d5b785658b38-openshift-service-ca\") pod \"1101465c-062e-4af1-ac27-d5b785658b38\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " Jul 14 10:29:02.452902 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.452701 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1101465c-062e-4af1-ac27-d5b785658b38-maas-api-tls\") pod \"1101465c-062e-4af1-ac27-d5b785658b38\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " Jul 14 10:29:02.452902 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.452754 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8ldp\" (UniqueName: \"kubernetes.io/projected/1101465c-062e-4af1-ac27-d5b785658b38-kube-api-access-m8ldp\") pod \"1101465c-062e-4af1-ac27-d5b785658b38\" (UID: \"1101465c-062e-4af1-ac27-d5b785658b38\") " Jul 14 10:29:02.453152 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.453114 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1101465c-062e-4af1-ac27-d5b785658b38-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1101465c-062e-4af1-ac27-d5b785658b38" (UID: "1101465c-062e-4af1-ac27-d5b785658b38"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:29:02.455132 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.455099 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1101465c-062e-4af1-ac27-d5b785658b38-kube-api-access-m8ldp" (OuterVolumeSpecName: "kube-api-access-m8ldp") pod "1101465c-062e-4af1-ac27-d5b785658b38" (UID: "1101465c-062e-4af1-ac27-d5b785658b38"). InnerVolumeSpecName "kube-api-access-m8ldp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:29:02.455242 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.455216 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1101465c-062e-4af1-ac27-d5b785658b38-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1101465c-062e-4af1-ac27-d5b785658b38" (UID: "1101465c-062e-4af1-ac27-d5b785658b38"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:29:02.553839 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.553791 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101465c-062e-4af1-ac27-d5b785658b38-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:29:02.553839 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.553834 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1101465c-062e-4af1-ac27-d5b785658b38-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:29:02.553839 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.553843 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8ldp\" (UniqueName: \"kubernetes.io/projected/1101465c-062e-4af1-ac27-d5b785658b38-kube-api-access-m8ldp\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:29:02.940294 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.940259 2561 generic.go:356] "Generic (PLEG): container finished" podID="1101465c-062e-4af1-ac27-d5b785658b38" containerID="f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e" exitCode=0 Jul 14 10:29:02.940485 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.940302 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" Jul 14 10:29:02.940485 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.940342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" event={"ID":"1101465c-062e-4af1-ac27-d5b785658b38","Type":"ContainerDied","Data":"f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e"} Jul 14 10:29:02.940485 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.940402 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n" event={"ID":"1101465c-062e-4af1-ac27-d5b785658b38","Type":"ContainerDied","Data":"0ba5c59ce2e326c0f04b620aed15677d37adf823001f3f976274c76fa7a5332f"} Jul 14 10:29:02.940485 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.940439 2561 scope.go:117] "RemoveContainer" containerID="f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e" Jul 14 10:29:02.950573 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.950555 2561 scope.go:117] "RemoveContainer" containerID="f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e" Jul 14 10:29:02.950869 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:29:02.950849 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e\": container with ID starting with f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e not found: ID does not exist" containerID="f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e" Jul 14 10:29:02.950945 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.950883 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e"} err="failed to get container status \"f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e\": rpc error: code = NotFound desc = could not find container \"f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e\": container with ID starting with f5ad8d5f5fb79da7e9a3dbb20deded2ffd543c469e7492ca5d480b3eb475b34e not found: ID does not exist" Jul 14 10:29:02.992080 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:02.992040 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n"] Jul 14 10:29:03.013014 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:03.012980 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-288cd506-6cbc9d8d4f-q8k5n"] Jul 14 10:29:04.449389 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:04.449358 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1101465c-062e-4af1-ac27-d5b785658b38" path="/var/lib/kubelet/pods/1101465c-062e-4af1-ac27-d5b785658b38/volumes" Jul 14 10:29:34.078775 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.078745 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r"] Jul 14 10:29:34.079245 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.079175 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1101465c-062e-4af1-ac27-d5b785658b38" containerName="maas-api" Jul 14 10:29:34.079245 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.079186 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1101465c-062e-4af1-ac27-d5b785658b38" containerName="maas-api" Jul 14 10:29:34.079323 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.079255 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1101465c-062e-4af1-ac27-d5b785658b38" containerName="maas-api" Jul 14 10:29:34.083888 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.083866 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.086712 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.086693 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-b18fcbaa-serving-cert\"" Jul 14 10:29:34.093622 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.093599 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r"] Jul 14 10:29:34.135606 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.135567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ae1f37-3a11-4bc8-a789-787ec3979243-openshift-service-ca\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.135787 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.135620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ae1f37-3a11-4bc8-a789-787ec3979243-maas-api-tls\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.135787 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.135638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgnm8\" (UniqueName: \"kubernetes.io/projected/c8ae1f37-3a11-4bc8-a789-787ec3979243-kube-api-access-tgnm8\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.236842 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.236777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ae1f37-3a11-4bc8-a789-787ec3979243-maas-api-tls\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.236842 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.236841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgnm8\" (UniqueName: \"kubernetes.io/projected/c8ae1f37-3a11-4bc8-a789-787ec3979243-kube-api-access-tgnm8\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.237121 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.236945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ae1f37-3a11-4bc8-a789-787ec3979243-openshift-service-ca\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.237121 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:29:34.236945 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-b18fcbaa-serving-cert: secret "maas-api-e2e-mt-b18fcbaa-serving-cert" not found Jul 14 10:29:34.237121 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:29:34.237122 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8ae1f37-3a11-4bc8-a789-787ec3979243-maas-api-tls podName:c8ae1f37-3a11-4bc8-a789-787ec3979243 nodeName:}" failed. No retries permitted until 2026-07-14 10:29:34.737098867 +0000 UTC m=+1762.834487062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8ae1f37-3a11-4bc8-a789-787ec3979243-maas-api-tls") pod "maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" (UID: "c8ae1f37-3a11-4bc8-a789-787ec3979243") : secret "maas-api-e2e-mt-b18fcbaa-serving-cert" not found Jul 14 10:29:34.237486 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.237463 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ae1f37-3a11-4bc8-a789-787ec3979243-openshift-service-ca\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.246897 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.246868 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgnm8\" (UniqueName: \"kubernetes.io/projected/c8ae1f37-3a11-4bc8-a789-787ec3979243-kube-api-access-tgnm8\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.742101 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.742055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ae1f37-3a11-4bc8-a789-787ec3979243-maas-api-tls\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.744899 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.744869 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ae1f37-3a11-4bc8-a789-787ec3979243-maas-api-tls\") pod \"maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:34.995351 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:34.995260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:35.163774 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:35.163739 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r"] Jul 14 10:29:35.164340 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:29:35.164315 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ae1f37_3a11_4bc8_a789_787ec3979243.slice/crio-e6e11cc2c931b4e5dab4198737db8c07809cc7dcabb0dad2707ceb9c1f2bc4d4 WatchSource:0}: Error finding container e6e11cc2c931b4e5dab4198737db8c07809cc7dcabb0dad2707ceb9c1f2bc4d4: Status 404 returned error can't find the container with id e6e11cc2c931b4e5dab4198737db8c07809cc7dcabb0dad2707ceb9c1f2bc4d4 Jul 14 10:29:36.120350 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:36.120296 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" event={"ID":"c8ae1f37-3a11-4bc8-a789-787ec3979243","Type":"ContainerStarted","Data":"78fdb24ac93acf3855d10ca4a5935c0711f3520873ac2ab58fc35fb408ea99b2"} Jul 14 10:29:36.120555 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:36.120366 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" event={"ID":"c8ae1f37-3a11-4bc8-a789-787ec3979243","Type":"ContainerStarted","Data":"e6e11cc2c931b4e5dab4198737db8c07809cc7dcabb0dad2707ceb9c1f2bc4d4"} Jul 14 10:29:36.120555 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:36.120395 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:29:36.141101 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:36.141051 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" podStartSLOduration=1.767995525 podStartE2EDuration="2.141033366s" totalImagesPullingTime="373.037841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:29:36.138274126 +0000 UTC m=+1764.235662330" watchObservedRunningTime="2026-07-14 10:29:36.141033366 +0000 UTC m=+1764.238421568" Jul 14 10:29:42.131597 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:29:42.131565 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:30:00.136142 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:00.136087 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc"] Jul 14 10:30:00.140193 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:00.140169 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" Jul 14 10:30:00.149209 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:00.149174 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc"] Jul 14 10:30:00.273672 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:00.273628 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw82p\" (UniqueName: \"kubernetes.io/projected/70ee55c2-0f40-4702-a839-79d9ab7c9e74-kube-api-access-cw82p\") pod \"maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc\" (UID: \"70ee55c2-0f40-4702-a839-79d9ab7c9e74\") " pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" Jul 14 10:30:00.374813 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:00.374768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw82p\" (UniqueName: \"kubernetes.io/projected/70ee55c2-0f40-4702-a839-79d9ab7c9e74-kube-api-access-cw82p\") pod \"maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc\" (UID: \"70ee55c2-0f40-4702-a839-79d9ab7c9e74\") " pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" Jul 14 10:30:00.384837 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:00.384781 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw82p\" (UniqueName: \"kubernetes.io/projected/70ee55c2-0f40-4702-a839-79d9ab7c9e74-kube-api-access-cw82p\") pod \"maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc\" (UID: \"70ee55c2-0f40-4702-a839-79d9ab7c9e74\") " pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" Jul 14 10:30:00.451907 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:00.451824 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" Jul 14 10:30:00.608180 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:00.608149 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc"] Jul 14 10:30:00.612723 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:30:00.612692 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ee55c2_0f40_4702_a839_79d9ab7c9e74.slice/crio-ab6d6134392b869e0058d5358b38ffd41b252fb9019a031ad3417ddb7231c99a WatchSource:0}: Error finding container ab6d6134392b869e0058d5358b38ffd41b252fb9019a031ad3417ddb7231c99a: Status 404 returned error can't find the container with id ab6d6134392b869e0058d5358b38ffd41b252fb9019a031ad3417ddb7231c99a Jul 14 10:30:01.247336 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:01.247289 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" event={"ID":"70ee55c2-0f40-4702-a839-79d9ab7c9e74","Type":"ContainerStarted","Data":"ab6d6134392b869e0058d5358b38ffd41b252fb9019a031ad3417ddb7231c99a"} Jul 14 10:30:05.273899 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:05.273855 2561 generic.go:356] "Generic (PLEG): container finished" podID="70ee55c2-0f40-4702-a839-79d9ab7c9e74" containerID="1fb9c15a585e448827f3b89883ed68c0a5319720ead548e8a4bd9983e1163473" exitCode=0 Jul 14 10:30:05.274322 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:05.273914 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" event={"ID":"70ee55c2-0f40-4702-a839-79d9ab7c9e74","Type":"ContainerDied","Data":"1fb9c15a585e448827f3b89883ed68c0a5319720ead548e8a4bd9983e1163473"} Jul 14 10:30:06.085658 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.085622 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r"] Jul 14 10:30:06.085943 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.085910 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" podUID="c8ae1f37-3a11-4bc8-a789-787ec3979243" containerName="maas-api" containerID="cri-o://78fdb24ac93acf3855d10ca4a5935c0711f3520873ac2ab58fc35fb408ea99b2" gracePeriod=30 Jul 14 10:30:06.125728 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.125691 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc"] Jul 14 10:30:06.281548 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.281509 2561 generic.go:356] "Generic (PLEG): container finished" podID="c8ae1f37-3a11-4bc8-a789-787ec3979243" containerID="78fdb24ac93acf3855d10ca4a5935c0711f3520873ac2ab58fc35fb408ea99b2" exitCode=0 Jul 14 10:30:06.281988 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.281573 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" event={"ID":"c8ae1f37-3a11-4bc8-a789-787ec3979243","Type":"ContainerDied","Data":"78fdb24ac93acf3855d10ca4a5935c0711f3520873ac2ab58fc35fb408ea99b2"} Jul 14 10:30:06.348770 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.348743 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:30:06.426635 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.426600 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgnm8\" (UniqueName: \"kubernetes.io/projected/c8ae1f37-3a11-4bc8-a789-787ec3979243-kube-api-access-tgnm8\") pod \"c8ae1f37-3a11-4bc8-a789-787ec3979243\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " Jul 14 10:30:06.426828 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.426692 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ae1f37-3a11-4bc8-a789-787ec3979243-openshift-service-ca\") pod \"c8ae1f37-3a11-4bc8-a789-787ec3979243\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " Jul 14 10:30:06.426828 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.426727 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ae1f37-3a11-4bc8-a789-787ec3979243-maas-api-tls\") pod \"c8ae1f37-3a11-4bc8-a789-787ec3979243\" (UID: \"c8ae1f37-3a11-4bc8-a789-787ec3979243\") " Jul 14 10:30:06.427151 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.427125 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ae1f37-3a11-4bc8-a789-787ec3979243-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8ae1f37-3a11-4bc8-a789-787ec3979243" (UID: "c8ae1f37-3a11-4bc8-a789-787ec3979243"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:30:06.429055 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.429031 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ae1f37-3a11-4bc8-a789-787ec3979243-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8ae1f37-3a11-4bc8-a789-787ec3979243" (UID: "c8ae1f37-3a11-4bc8-a789-787ec3979243"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:30:06.429055 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.429052 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ae1f37-3a11-4bc8-a789-787ec3979243-kube-api-access-tgnm8" (OuterVolumeSpecName: "kube-api-access-tgnm8") pod "c8ae1f37-3a11-4bc8-a789-787ec3979243" (UID: "c8ae1f37-3a11-4bc8-a789-787ec3979243"). InnerVolumeSpecName "kube-api-access-tgnm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:30:06.430460 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.430444 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" Jul 14 10:30:06.527643 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.527609 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw82p\" (UniqueName: \"kubernetes.io/projected/70ee55c2-0f40-4702-a839-79d9ab7c9e74-kube-api-access-cw82p\") pod \"70ee55c2-0f40-4702-a839-79d9ab7c9e74\" (UID: \"70ee55c2-0f40-4702-a839-79d9ab7c9e74\") " Jul 14 10:30:06.527886 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.527871 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ae1f37-3a11-4bc8-a789-787ec3979243-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:30:06.527942 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.527887 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgnm8\" (UniqueName: \"kubernetes.io/projected/c8ae1f37-3a11-4bc8-a789-787ec3979243-kube-api-access-tgnm8\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:30:06.527942 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.527897 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ae1f37-3a11-4bc8-a789-787ec3979243-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:30:06.529929 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.529905 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70ee55c2-0f40-4702-a839-79d9ab7c9e74-kube-api-access-cw82p" (OuterVolumeSpecName: "kube-api-access-cw82p") pod "70ee55c2-0f40-4702-a839-79d9ab7c9e74" (UID: "70ee55c2-0f40-4702-a839-79d9ab7c9e74"). InnerVolumeSpecName "kube-api-access-cw82p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:30:06.628622 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:06.628529 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw82p\" (UniqueName: \"kubernetes.io/projected/70ee55c2-0f40-4702-a839-79d9ab7c9e74-kube-api-access-cw82p\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:30:07.288512 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.288479 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" Jul 14 10:30:07.288512 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.288491 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r" event={"ID":"c8ae1f37-3a11-4bc8-a789-787ec3979243","Type":"ContainerDied","Data":"e6e11cc2c931b4e5dab4198737db8c07809cc7dcabb0dad2707ceb9c1f2bc4d4"} Jul 14 10:30:07.289043 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.288559 2561 scope.go:117] "RemoveContainer" containerID="78fdb24ac93acf3855d10ca4a5935c0711f3520873ac2ab58fc35fb408ea99b2" Jul 14 10:30:07.290052 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.289938 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" Jul 14 10:30:07.290052 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.289983 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc" event={"ID":"70ee55c2-0f40-4702-a839-79d9ab7c9e74","Type":"ContainerDied","Data":"ab6d6134392b869e0058d5358b38ffd41b252fb9019a031ad3417ddb7231c99a"} Jul 14 10:30:07.290052 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.290026 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab6d6134392b869e0058d5358b38ffd41b252fb9019a031ad3417ddb7231c99a" Jul 14 10:30:07.324488 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.324450 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r"] Jul 14 10:30:07.330783 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.330750 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-b18fcbaa-674c6855c9-54g8r"] Jul 14 10:30:07.342759 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.342726 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc"] Jul 14 10:30:07.346431 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:07.346392 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-b18fcbaa-29733750-bmngc"] Jul 14 10:30:08.448818 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:08.448759 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70ee55c2-0f40-4702-a839-79d9ab7c9e74" path="/var/lib/kubelet/pods/70ee55c2-0f40-4702-a839-79d9ab7c9e74/volumes" Jul 14 10:30:08.449329 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:08.449295 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ae1f37-3a11-4bc8-a789-787ec3979243" path="/var/lib/kubelet/pods/c8ae1f37-3a11-4bc8-a789-787ec3979243/volumes" Jul 14 10:30:12.549666 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:12.549634 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:30:12.554498 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:12.554469 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:30:12.554715 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:12.554556 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:30:12.559533 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:30:12.559506 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:31:59.977353 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.977313 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv"] Jul 14 10:31:59.977887 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.977826 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70ee55c2-0f40-4702-a839-79d9ab7c9e74" containerName="cleanup" Jul 14 10:31:59.977887 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.977844 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70ee55c2-0f40-4702-a839-79d9ab7c9e74" containerName="cleanup" Jul 14 10:31:59.977887 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.977858 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ae1f37-3a11-4bc8-a789-787ec3979243" containerName="maas-api" Jul 14 10:31:59.977887 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.977863 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ae1f37-3a11-4bc8-a789-787ec3979243" containerName="maas-api" Jul 14 10:31:59.978030 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.977937 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ae1f37-3a11-4bc8-a789-787ec3979243" containerName="maas-api" Jul 14 10:31:59.978030 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.977947 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="70ee55c2-0f40-4702-a839-79d9ab7c9e74" containerName="cleanup" Jul 14 10:31:59.981088 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.981068 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:31:59.984028 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.984004 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-37ad9d-serving-cert\"" Jul 14 10:31:59.992455 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:31:59.992430 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv"] Jul 14 10:32:00.163578 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.163539 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-maas-api-tls\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.163791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.163613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.163791 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.163698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmbcf\" (UniqueName: \"kubernetes.io/projected/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-kube-api-access-hmbcf\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.265024 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.264933 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.265024 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.264996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmbcf\" (UniqueName: \"kubernetes.io/projected/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-kube-api-access-hmbcf\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.265213 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.265034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-maas-api-tls\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.265213 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:32:00.265159 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-37ad9d-serving-cert: secret "maas-api-e2e-inf-a-37ad9d-serving-cert" not found Jul 14 10:32:00.265283 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:32:00.265219 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-maas-api-tls podName:9c2ace7b-edb8-4124-98b7-d52d38ca4ba0 nodeName:}" failed. No retries permitted until 2026-07-14 10:32:00.765204114 +0000 UTC m=+1908.862592294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-maas-api-tls") pod "maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" (UID: "9c2ace7b-edb8-4124-98b7-d52d38ca4ba0") : secret "maas-api-e2e-inf-a-37ad9d-serving-cert" not found Jul 14 10:32:00.265594 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.265574 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.276322 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.276290 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmbcf\" (UniqueName: \"kubernetes.io/projected/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-kube-api-access-hmbcf\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.770842 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.770776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-maas-api-tls\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.773472 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.773438 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-maas-api-tls\") pod \"maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:00.893383 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:00.893342 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:01.045938 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:01.045909 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv"] Jul 14 10:32:01.048170 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:32:01.048143 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2ace7b_edb8_4124_98b7_d52d38ca4ba0.slice/crio-4f6e50d4c07e4113454b9481bf78eb35f8d8b0730826c129b2d3ea8aac181d31 WatchSource:0}: Error finding container 4f6e50d4c07e4113454b9481bf78eb35f8d8b0730826c129b2d3ea8aac181d31: Status 404 returned error can't find the container with id 4f6e50d4c07e4113454b9481bf78eb35f8d8b0730826c129b2d3ea8aac181d31 Jul 14 10:32:01.049588 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:01.049567 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 10:32:01.904259 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:01.904151 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" event={"ID":"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0","Type":"ContainerStarted","Data":"1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce"} Jul 14 10:32:01.904259 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:01.904209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" event={"ID":"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0","Type":"ContainerStarted","Data":"4f6e50d4c07e4113454b9481bf78eb35f8d8b0730826c129b2d3ea8aac181d31"} Jul 14 10:32:01.904259 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:01.904247 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:07.905256 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:07.905184 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" podStartSLOduration=8.420731204 podStartE2EDuration="8.905160376s" totalImagesPullingTime="484.429172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:32:01.945525827 +0000 UTC m=+1910.042914029" watchObservedRunningTime="2026-07-14 10:32:07.905160376 +0000 UTC m=+1916.002548580" Jul 14 10:32:07.907929 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:07.907904 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q"] Jul 14 10:32:07.912394 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:07.912363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:07.914942 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:07.914922 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:07.915446 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:07.915423 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-1242c6-serving-cert\"" Jul 14 10:32:07.927410 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:07.927377 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q"] Jul 14 10:32:07.931434 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:07.931402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c64a53-adb9-4693-bef0-b86aabc56a9f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:07.931591 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:07.931500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4c4l\" (UniqueName: \"kubernetes.io/projected/98c64a53-adb9-4693-bef0-b86aabc56a9f-kube-api-access-l4c4l\") pod \"maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:07.931591 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:07.931582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98c64a53-adb9-4693-bef0-b86aabc56a9f-maas-api-tls\") pod \"maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:08.032209 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:08.032172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c64a53-adb9-4693-bef0-b86aabc56a9f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:08.032369 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:08.032253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4c4l\" (UniqueName: \"kubernetes.io/projected/98c64a53-adb9-4693-bef0-b86aabc56a9f-kube-api-access-l4c4l\") pod \"maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:08.032369 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:08.032297 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98c64a53-adb9-4693-bef0-b86aabc56a9f-maas-api-tls\") pod \"maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:08.032951 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:08.032930 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c64a53-adb9-4693-bef0-b86aabc56a9f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:08.034867 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:08.034850 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98c64a53-adb9-4693-bef0-b86aabc56a9f-maas-api-tls\") pod \"maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:08.041241 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:08.041215 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4c4l\" (UniqueName: \"kubernetes.io/projected/98c64a53-adb9-4693-bef0-b86aabc56a9f-kube-api-access-l4c4l\") pod \"maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:08.223201 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:08.223112 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:08.375602 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:08.375579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q"] Jul 14 10:32:08.378299 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:32:08.378257 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c64a53_adb9_4693_bef0_b86aabc56a9f.slice/crio-5678f8bdba35328adbb7175005e71d2bbc29ed61617bb5f03fdac0f3ea68b5b8 WatchSource:0}: Error finding container 5678f8bdba35328adbb7175005e71d2bbc29ed61617bb5f03fdac0f3ea68b5b8: Status 404 returned error can't find the container with id 5678f8bdba35328adbb7175005e71d2bbc29ed61617bb5f03fdac0f3ea68b5b8 Jul 14 10:32:08.938896 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:08.938859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" event={"ID":"98c64a53-adb9-4693-bef0-b86aabc56a9f","Type":"ContainerStarted","Data":"5678f8bdba35328adbb7175005e71d2bbc29ed61617bb5f03fdac0f3ea68b5b8"} Jul 14 10:32:09.946434 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:09.946398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" event={"ID":"98c64a53-adb9-4693-bef0-b86aabc56a9f","Type":"ContainerStarted","Data":"704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013"} Jul 14 10:32:09.946872 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:09.946528 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:09.965345 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:09.965296 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" podStartSLOduration=2.337893019 podStartE2EDuration="2.965277091s" totalImagesPullingTime="627.384072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:32:09.96432716 +0000 UTC m=+1918.061715388" watchObservedRunningTime="2026-07-14 10:32:09.965277091 +0000 UTC m=+1918.062665293" Jul 14 10:32:15.957111 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:15.957080 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:32:57.136407 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.136368 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv"] Jul 14 10:32:57.136899 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.136642 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" podUID="9c2ace7b-edb8-4124-98b7-d52d38ca4ba0" containerName="maas-api" containerID="cri-o://1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce" gracePeriod=30 Jul 14 10:32:57.401566 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.401490 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:57.578204 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.578161 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-openshift-service-ca\") pod \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " Jul 14 10:32:57.578394 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.578250 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmbcf\" (UniqueName: \"kubernetes.io/projected/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-kube-api-access-hmbcf\") pod \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " Jul 14 10:32:57.578394 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.578311 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-maas-api-tls\") pod \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\" (UID: \"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0\") " Jul 14 10:32:57.578608 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.578579 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c2ace7b-edb8-4124-98b7-d52d38ca4ba0" (UID: "9c2ace7b-edb8-4124-98b7-d52d38ca4ba0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:32:57.580714 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.580681 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c2ace7b-edb8-4124-98b7-d52d38ca4ba0" (UID: "9c2ace7b-edb8-4124-98b7-d52d38ca4ba0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:32:57.580714 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.580687 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-kube-api-access-hmbcf" (OuterVolumeSpecName: "kube-api-access-hmbcf") pod "9c2ace7b-edb8-4124-98b7-d52d38ca4ba0" (UID: "9c2ace7b-edb8-4124-98b7-d52d38ca4ba0"). InnerVolumeSpecName "kube-api-access-hmbcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:32:57.679738 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.679633 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmbcf\" (UniqueName: \"kubernetes.io/projected/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-kube-api-access-hmbcf\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:32:57.679738 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.679669 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:32:57.679738 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:57.679683 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:32:58.208481 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.208440 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c2ace7b-edb8-4124-98b7-d52d38ca4ba0" containerID="1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce" exitCode=0 Jul 14 10:32:58.209007 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.208492 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" Jul 14 10:32:58.209007 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.208527 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" event={"ID":"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0","Type":"ContainerDied","Data":"1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce"} Jul 14 10:32:58.209007 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.208596 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv" event={"ID":"9c2ace7b-edb8-4124-98b7-d52d38ca4ba0","Type":"ContainerDied","Data":"4f6e50d4c07e4113454b9481bf78eb35f8d8b0730826c129b2d3ea8aac181d31"} Jul 14 10:32:58.209007 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.208630 2561 scope.go:117] "RemoveContainer" containerID="1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce" Jul 14 10:32:58.218481 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.218457 2561 scope.go:117] "RemoveContainer" containerID="1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce" Jul 14 10:32:58.218770 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:32:58.218749 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce\": container with ID starting with 1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce not found: ID does not exist" containerID="1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce" Jul 14 10:32:58.218903 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.218780 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce"} err="failed to get container status \"1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce\": rpc error: code = NotFound desc = could not find container \"1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce\": container with ID starting with 1a808a06dc255c8921cea8600aee377e9363eef5b943471140b579de36178fce not found: ID does not exist" Jul 14 10:32:58.233518 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.233482 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv"] Jul 14 10:32:58.241595 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.241563 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-37ad9d-57c89859b7-ppqgv"] Jul 14 10:32:58.448998 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:32:58.448964 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c2ace7b-edb8-4124-98b7-d52d38ca4ba0" path="/var/lib/kubelet/pods/9c2ace7b-edb8-4124-98b7-d52d38ca4ba0/volumes" Jul 14 10:33:40.675724 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:40.675687 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q"] Jul 14 10:33:40.676360 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:40.676000 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" podUID="98c64a53-adb9-4693-bef0-b86aabc56a9f" containerName="maas-api" containerID="cri-o://704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013" gracePeriod=30 Jul 14 10:33:40.932580 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:40.932516 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:33:41.070470 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.070434 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98c64a53-adb9-4693-bef0-b86aabc56a9f-maas-api-tls\") pod \"98c64a53-adb9-4693-bef0-b86aabc56a9f\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " Jul 14 10:33:41.070650 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.070510 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c64a53-adb9-4693-bef0-b86aabc56a9f-openshift-service-ca\") pod \"98c64a53-adb9-4693-bef0-b86aabc56a9f\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " Jul 14 10:33:41.070650 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.070536 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4c4l\" (UniqueName: \"kubernetes.io/projected/98c64a53-adb9-4693-bef0-b86aabc56a9f-kube-api-access-l4c4l\") pod \"98c64a53-adb9-4693-bef0-b86aabc56a9f\" (UID: \"98c64a53-adb9-4693-bef0-b86aabc56a9f\") " Jul 14 10:33:41.070929 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.070905 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98c64a53-adb9-4693-bef0-b86aabc56a9f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "98c64a53-adb9-4693-bef0-b86aabc56a9f" (UID: "98c64a53-adb9-4693-bef0-b86aabc56a9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:33:41.072958 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.072929 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98c64a53-adb9-4693-bef0-b86aabc56a9f-kube-api-access-l4c4l" (OuterVolumeSpecName: "kube-api-access-l4c4l") pod "98c64a53-adb9-4693-bef0-b86aabc56a9f" (UID: "98c64a53-adb9-4693-bef0-b86aabc56a9f"). InnerVolumeSpecName "kube-api-access-l4c4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:33:41.073166 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.073149 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98c64a53-adb9-4693-bef0-b86aabc56a9f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "98c64a53-adb9-4693-bef0-b86aabc56a9f" (UID: "98c64a53-adb9-4693-bef0-b86aabc56a9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:33:41.171966 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.171930 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98c64a53-adb9-4693-bef0-b86aabc56a9f-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:33:41.171966 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.171959 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98c64a53-adb9-4693-bef0-b86aabc56a9f-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:33:41.171966 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.171970 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4c4l\" (UniqueName: \"kubernetes.io/projected/98c64a53-adb9-4693-bef0-b86aabc56a9f-kube-api-access-l4c4l\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:33:41.427039 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.426997 2561 generic.go:356] "Generic (PLEG): container finished" podID="98c64a53-adb9-4693-bef0-b86aabc56a9f" containerID="704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013" exitCode=0 Jul 14 10:33:41.427270 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.427059 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" Jul 14 10:33:41.427270 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.427083 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" event={"ID":"98c64a53-adb9-4693-bef0-b86aabc56a9f","Type":"ContainerDied","Data":"704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013"} Jul 14 10:33:41.427270 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.427146 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q" event={"ID":"98c64a53-adb9-4693-bef0-b86aabc56a9f","Type":"ContainerDied","Data":"5678f8bdba35328adbb7175005e71d2bbc29ed61617bb5f03fdac0f3ea68b5b8"} Jul 14 10:33:41.427270 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.427175 2561 scope.go:117] "RemoveContainer" containerID="704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013" Jul 14 10:33:41.436980 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.436961 2561 scope.go:117] "RemoveContainer" containerID="704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013" Jul 14 10:33:41.437299 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:33:41.437280 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013\": container with ID starting with 704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013 not found: ID does not exist" containerID="704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013" Jul 14 10:33:41.437353 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.437307 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013"} err="failed to get container status \"704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013\": rpc error: code = NotFound desc = could not find container \"704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013\": container with ID starting with 704ad61ede8ea59222231d5b5010d37344293690f85c3ec3c1115668199e9013 not found: ID does not exist" Jul 14 10:33:41.448253 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.448225 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q"] Jul 14 10:33:41.452215 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:41.452186 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1242c6-58d9bb9956-mjs5q"] Jul 14 10:33:42.449200 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:42.449162 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98c64a53-adb9-4693-bef0-b86aabc56a9f" path="/var/lib/kubelet/pods/98c64a53-adb9-4693-bef0-b86aabc56a9f/volumes" Jul 14 10:33:50.556090 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.556051 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87"] Jul 14 10:33:50.556656 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.556640 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98c64a53-adb9-4693-bef0-b86aabc56a9f" containerName="maas-api" Jul 14 10:33:50.556704 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.556660 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="98c64a53-adb9-4693-bef0-b86aabc56a9f" containerName="maas-api" Jul 14 10:33:50.556704 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.556676 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c2ace7b-edb8-4124-98b7-d52d38ca4ba0" containerName="maas-api" Jul 14 10:33:50.556704 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.556685 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2ace7b-edb8-4124-98b7-d52d38ca4ba0" containerName="maas-api" Jul 14 10:33:50.556822 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.556785 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c2ace7b-edb8-4124-98b7-d52d38ca4ba0" containerName="maas-api" Jul 14 10:33:50.556822 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.556814 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="98c64a53-adb9-4693-bef0-b86aabc56a9f" containerName="maas-api" Jul 14 10:33:50.560274 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.560253 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.563043 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.563020 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-2fed84-serving-cert\"" Jul 14 10:33:50.569348 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.569323 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87"] Jul 14 10:33:50.661652 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.661612 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12cb782a-277a-4ad5-92d2-58057ee6ec7a-maas-api-tls\") pod \"maas-api-e2e-api-a-2fed84-8db54b7cc-66w87\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.661879 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.661724 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-977tx\" (UniqueName: \"kubernetes.io/projected/12cb782a-277a-4ad5-92d2-58057ee6ec7a-kube-api-access-977tx\") pod \"maas-api-e2e-api-a-2fed84-8db54b7cc-66w87\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.661879 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.661759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12cb782a-277a-4ad5-92d2-58057ee6ec7a-openshift-service-ca\") pod \"maas-api-e2e-api-a-2fed84-8db54b7cc-66w87\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.762827 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.762762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12cb782a-277a-4ad5-92d2-58057ee6ec7a-maas-api-tls\") pod \"maas-api-e2e-api-a-2fed84-8db54b7cc-66w87\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.763016 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.762879 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-977tx\" (UniqueName: \"kubernetes.io/projected/12cb782a-277a-4ad5-92d2-58057ee6ec7a-kube-api-access-977tx\") pod \"maas-api-e2e-api-a-2fed84-8db54b7cc-66w87\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.763016 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.762916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12cb782a-277a-4ad5-92d2-58057ee6ec7a-openshift-service-ca\") pod \"maas-api-e2e-api-a-2fed84-8db54b7cc-66w87\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.763629 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.763563 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12cb782a-277a-4ad5-92d2-58057ee6ec7a-openshift-service-ca\") pod \"maas-api-e2e-api-a-2fed84-8db54b7cc-66w87\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.765485 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.765462 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12cb782a-277a-4ad5-92d2-58057ee6ec7a-maas-api-tls\") pod \"maas-api-e2e-api-a-2fed84-8db54b7cc-66w87\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.791630 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.791596 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-977tx\" (UniqueName: \"kubernetes.io/projected/12cb782a-277a-4ad5-92d2-58057ee6ec7a-kube-api-access-977tx\") pod \"maas-api-e2e-api-a-2fed84-8db54b7cc-66w87\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:50.871958 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:50.871863 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:51.020390 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:51.020363 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87"] Jul 14 10:33:51.023132 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:33:51.023104 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cb782a_277a_4ad5_92d2_58057ee6ec7a.slice/crio-ea405f2b777d83417c075faa9c6e45b87a0d3a796848046588efed3ea15e3ce0 WatchSource:0}: Error finding container ea405f2b777d83417c075faa9c6e45b87a0d3a796848046588efed3ea15e3ce0: Status 404 returned error can't find the container with id ea405f2b777d83417c075faa9c6e45b87a0d3a796848046588efed3ea15e3ce0 Jul 14 10:33:51.484690 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:51.484643 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" event={"ID":"12cb782a-277a-4ad5-92d2-58057ee6ec7a","Type":"ContainerStarted","Data":"d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6"} Jul 14 10:33:51.484904 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:51.484740 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" event={"ID":"12cb782a-277a-4ad5-92d2-58057ee6ec7a","Type":"ContainerStarted","Data":"ea405f2b777d83417c075faa9c6e45b87a0d3a796848046588efed3ea15e3ce0"} Jul 14 10:33:51.484904 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:51.484765 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:51.505834 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:51.505758 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" podStartSLOduration=1.136755885 podStartE2EDuration="1.505736511s" totalImagesPullingTime="368.980626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:33:51.505179984 +0000 UTC m=+2019.602568186" watchObservedRunningTime="2026-07-14 10:33:51.505736511 +0000 UTC m=+2019.603124714" Jul 14 10:33:57.494490 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:57.494462 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:33:58.542682 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.542639 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx"] Jul 14 10:33:58.547835 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.547792 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:58.550647 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.550622 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-56044a-serving-cert\"" Jul 14 10:33:58.559853 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.559823 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx"] Jul 14 10:33:58.632051 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.632019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/247a07b2-05db-4220-b968-761b948a011e-maas-api-tls\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:58.632260 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.632154 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7fqw\" (UniqueName: \"kubernetes.io/projected/247a07b2-05db-4220-b968-761b948a011e-kube-api-access-d7fqw\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:58.632260 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.632238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/247a07b2-05db-4220-b968-761b948a011e-openshift-service-ca\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:58.733013 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.732974 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7fqw\" (UniqueName: \"kubernetes.io/projected/247a07b2-05db-4220-b968-761b948a011e-kube-api-access-d7fqw\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:58.733230 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.733038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/247a07b2-05db-4220-b968-761b948a011e-openshift-service-ca\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:58.733230 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.733063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/247a07b2-05db-4220-b968-761b948a011e-maas-api-tls\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:58.733230 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:33:58.733196 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-56044a-serving-cert: secret "maas-api-e2e-api-b-56044a-serving-cert" not found Jul 14 10:33:58.733431 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:33:58.733249 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247a07b2-05db-4220-b968-761b948a011e-maas-api-tls podName:247a07b2-05db-4220-b968-761b948a011e nodeName:}" failed. No retries permitted until 2026-07-14 10:33:59.233232343 +0000 UTC m=+2027.330620523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/247a07b2-05db-4220-b968-761b948a011e-maas-api-tls") pod "maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" (UID: "247a07b2-05db-4220-b968-761b948a011e") : secret "maas-api-e2e-api-b-56044a-serving-cert" not found Jul 14 10:33:58.733747 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.733726 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/247a07b2-05db-4220-b968-761b948a011e-openshift-service-ca\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:58.744587 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:58.744564 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7fqw\" (UniqueName: \"kubernetes.io/projected/247a07b2-05db-4220-b968-761b948a011e-kube-api-access-d7fqw\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:59.238109 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:59.238068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/247a07b2-05db-4220-b968-761b948a011e-maas-api-tls\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:59.240719 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:59.240694 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/247a07b2-05db-4220-b968-761b948a011e-maas-api-tls\") pod \"maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:59.460931 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:59.460892 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:33:59.607474 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:33:59.607450 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx"] Jul 14 10:33:59.609695 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:33:59.609654 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247a07b2_05db_4220_b968_761b948a011e.slice/crio-e41ef708de1c1bad03153495a25d5853831af1336f19eb4e84a48bd8429f4234 WatchSource:0}: Error finding container e41ef708de1c1bad03153495a25d5853831af1336f19eb4e84a48bd8429f4234: Status 404 returned error can't find the container with id e41ef708de1c1bad03153495a25d5853831af1336f19eb4e84a48bd8429f4234 Jul 14 10:34:00.531280 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:00.531244 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" event={"ID":"247a07b2-05db-4220-b968-761b948a011e","Type":"ContainerStarted","Data":"178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a"} Jul 14 10:34:00.531476 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:00.531297 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" event={"ID":"247a07b2-05db-4220-b968-761b948a011e","Type":"ContainerStarted","Data":"e41ef708de1c1bad03153495a25d5853831af1336f19eb4e84a48bd8429f4234"} Jul 14 10:34:00.531476 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:00.531359 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:34:00.550377 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:00.550323 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" podStartSLOduration=2.207731999 podStartE2EDuration="2.550304897s" totalImagesPullingTime="342.572898ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:34:00.549678266 +0000 UTC m=+2028.647066470" watchObservedRunningTime="2026-07-14 10:34:00.550304897 +0000 UTC m=+2028.647693098" Jul 14 10:34:06.541291 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:06.541260 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:34:11.797718 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:11.797673 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87"] Jul 14 10:34:11.798368 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:11.797942 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" podUID="12cb782a-277a-4ad5-92d2-58057ee6ec7a" containerName="maas-api" containerID="cri-o://d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6" gracePeriod=30 Jul 14 10:34:12.053418 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.053333 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:34:12.153636 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.153596 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12cb782a-277a-4ad5-92d2-58057ee6ec7a-openshift-service-ca\") pod \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " Jul 14 10:34:12.153877 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.153684 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-977tx\" (UniqueName: \"kubernetes.io/projected/12cb782a-277a-4ad5-92d2-58057ee6ec7a-kube-api-access-977tx\") pod \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " Jul 14 10:34:12.153877 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.153778 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12cb782a-277a-4ad5-92d2-58057ee6ec7a-maas-api-tls\") pod \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\" (UID: \"12cb782a-277a-4ad5-92d2-58057ee6ec7a\") " Jul 14 10:34:12.154099 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.154071 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12cb782a-277a-4ad5-92d2-58057ee6ec7a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12cb782a-277a-4ad5-92d2-58057ee6ec7a" (UID: "12cb782a-277a-4ad5-92d2-58057ee6ec7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:34:12.156125 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.156090 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12cb782a-277a-4ad5-92d2-58057ee6ec7a-kube-api-access-977tx" (OuterVolumeSpecName: "kube-api-access-977tx") pod "12cb782a-277a-4ad5-92d2-58057ee6ec7a" (UID: "12cb782a-277a-4ad5-92d2-58057ee6ec7a"). InnerVolumeSpecName "kube-api-access-977tx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:34:12.156246 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.156156 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12cb782a-277a-4ad5-92d2-58057ee6ec7a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12cb782a-277a-4ad5-92d2-58057ee6ec7a" (UID: "12cb782a-277a-4ad5-92d2-58057ee6ec7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:34:12.254976 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.254930 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12cb782a-277a-4ad5-92d2-58057ee6ec7a-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:34:12.254976 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.254967 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-977tx\" (UniqueName: \"kubernetes.io/projected/12cb782a-277a-4ad5-92d2-58057ee6ec7a-kube-api-access-977tx\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:34:12.254976 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.254980 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12cb782a-277a-4ad5-92d2-58057ee6ec7a-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:34:12.594562 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.594525 2561 generic.go:356] "Generic (PLEG): container finished" podID="12cb782a-277a-4ad5-92d2-58057ee6ec7a" containerID="d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6" exitCode=0 Jul 14 10:34:12.594562 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.594563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" event={"ID":"12cb782a-277a-4ad5-92d2-58057ee6ec7a","Type":"ContainerDied","Data":"d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6"} Jul 14 10:34:12.594845 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.594601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" event={"ID":"12cb782a-277a-4ad5-92d2-58057ee6ec7a","Type":"ContainerDied","Data":"ea405f2b777d83417c075faa9c6e45b87a0d3a796848046588efed3ea15e3ce0"} Jul 14 10:34:12.594845 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.594622 2561 scope.go:117] "RemoveContainer" containerID="d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6" Jul 14 10:34:12.594845 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.594565 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87" Jul 14 10:34:12.604155 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.604126 2561 scope.go:117] "RemoveContainer" containerID="d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6" Jul 14 10:34:12.604490 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:34:12.604473 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6\": container with ID starting with d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6 not found: ID does not exist" containerID="d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6" Jul 14 10:34:12.604547 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.604499 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6"} err="failed to get container status \"d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6\": rpc error: code = NotFound desc = could not find container \"d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6\": container with ID starting with d89db9b3f568b787c33241cde323345eec35b894d757720ec27ab842d3cc47a6 not found: ID does not exist" Jul 14 10:34:12.615581 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.615549 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87"] Jul 14 10:34:12.620133 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:12.620103 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-2fed84-8db54b7cc-66w87"] Jul 14 10:34:14.448707 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:14.448674 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12cb782a-277a-4ad5-92d2-58057ee6ec7a" path="/var/lib/kubelet/pods/12cb782a-277a-4ad5-92d2-58057ee6ec7a/volumes" Jul 14 10:34:19.363947 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.363915 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx"] Jul 14 10:34:19.364420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.364133 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" podUID="247a07b2-05db-4220-b968-761b948a011e" containerName="maas-api" containerID="cri-o://178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a" gracePeriod=30 Jul 14 10:34:19.627453 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.627384 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:34:19.633302 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.633274 2561 generic.go:356] "Generic (PLEG): container finished" podID="247a07b2-05db-4220-b968-761b948a011e" containerID="178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a" exitCode=0 Jul 14 10:34:19.633463 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.633320 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" Jul 14 10:34:19.633463 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.633353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" event={"ID":"247a07b2-05db-4220-b968-761b948a011e","Type":"ContainerDied","Data":"178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a"} Jul 14 10:34:19.633463 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.633439 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx" event={"ID":"247a07b2-05db-4220-b968-761b948a011e","Type":"ContainerDied","Data":"e41ef708de1c1bad03153495a25d5853831af1336f19eb4e84a48bd8429f4234"} Jul 14 10:34:19.633581 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.633466 2561 scope.go:117] "RemoveContainer" containerID="178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a" Jul 14 10:34:19.642362 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.642345 2561 scope.go:117] "RemoveContainer" containerID="178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a" Jul 14 10:34:19.642620 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:34:19.642603 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a\": container with ID starting with 178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a not found: ID does not exist" containerID="178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a" Jul 14 10:34:19.642672 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.642630 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a"} err="failed to get container status \"178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a\": rpc error: code = NotFound desc = could not find container \"178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a\": container with ID starting with 178029c32bdc6e50a96a35b33c3652a32002686fe17c7dab6fa97eaedde25f7a not found: ID does not exist" Jul 14 10:34:19.720609 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.720574 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/247a07b2-05db-4220-b968-761b948a011e-maas-api-tls\") pod \"247a07b2-05db-4220-b968-761b948a011e\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " Jul 14 10:34:19.720839 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.720628 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/247a07b2-05db-4220-b968-761b948a011e-openshift-service-ca\") pod \"247a07b2-05db-4220-b968-761b948a011e\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " Jul 14 10:34:19.720839 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.720666 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7fqw\" (UniqueName: \"kubernetes.io/projected/247a07b2-05db-4220-b968-761b948a011e-kube-api-access-d7fqw\") pod \"247a07b2-05db-4220-b968-761b948a011e\" (UID: \"247a07b2-05db-4220-b968-761b948a011e\") " Jul 14 10:34:19.721007 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.720983 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/247a07b2-05db-4220-b968-761b948a011e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "247a07b2-05db-4220-b968-761b948a011e" (UID: "247a07b2-05db-4220-b968-761b948a011e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:34:19.723094 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.723060 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/247a07b2-05db-4220-b968-761b948a011e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "247a07b2-05db-4220-b968-761b948a011e" (UID: "247a07b2-05db-4220-b968-761b948a011e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:34:19.723094 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.723062 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/247a07b2-05db-4220-b968-761b948a011e-kube-api-access-d7fqw" (OuterVolumeSpecName: "kube-api-access-d7fqw") pod "247a07b2-05db-4220-b968-761b948a011e" (UID: "247a07b2-05db-4220-b968-761b948a011e"). InnerVolumeSpecName "kube-api-access-d7fqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:34:19.822130 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.822100 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/247a07b2-05db-4220-b968-761b948a011e-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:34:19.822130 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.822125 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/247a07b2-05db-4220-b968-761b948a011e-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:34:19.822130 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.822135 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7fqw\" (UniqueName: \"kubernetes.io/projected/247a07b2-05db-4220-b968-761b948a011e-kube-api-access-d7fqw\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:34:19.956734 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.956703 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx"] Jul 14 10:34:19.964223 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:19.964196 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-56044a-5c9dfbb479-9mvlx"] Jul 14 10:34:20.448942 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:20.448905 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="247a07b2-05db-4220-b968-761b948a011e" path="/var/lib/kubelet/pods/247a07b2-05db-4220-b968-761b948a011e/volumes" Jul 14 10:34:29.769633 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.769601 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd"] Jul 14 10:34:29.770170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.770013 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="247a07b2-05db-4220-b968-761b948a011e" containerName="maas-api" Jul 14 10:34:29.770170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.770025 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="247a07b2-05db-4220-b968-761b948a011e" containerName="maas-api" Jul 14 10:34:29.770170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.770034 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12cb782a-277a-4ad5-92d2-58057ee6ec7a" containerName="maas-api" Jul 14 10:34:29.770170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.770039 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="12cb782a-277a-4ad5-92d2-58057ee6ec7a" containerName="maas-api" Jul 14 10:34:29.770170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.770106 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="12cb782a-277a-4ad5-92d2-58057ee6ec7a" containerName="maas-api" Jul 14 10:34:29.770170 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.770114 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="247a07b2-05db-4220-b968-761b948a011e" containerName="maas-api" Jul 14 10:34:29.774788 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.774770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:29.778138 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.778115 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-817aae-serving-cert\"" Jul 14 10:34:29.785575 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.785542 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd"] Jul 14 10:34:29.913983 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.913946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-817aae-677f57497d-hxvsd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:29.913983 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.913983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-maas-api-tls\") pod \"maas-api-e2e-shared-a-817aae-677f57497d-hxvsd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:29.914206 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:29.914012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnhdc\" (UniqueName: \"kubernetes.io/projected/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-kube-api-access-vnhdc\") pod \"maas-api-e2e-shared-a-817aae-677f57497d-hxvsd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:30.014705 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:30.014667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-817aae-677f57497d-hxvsd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:30.014705 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:30.014707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-maas-api-tls\") pod \"maas-api-e2e-shared-a-817aae-677f57497d-hxvsd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:30.014967 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:30.014732 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnhdc\" (UniqueName: \"kubernetes.io/projected/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-kube-api-access-vnhdc\") pod \"maas-api-e2e-shared-a-817aae-677f57497d-hxvsd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:30.015428 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:30.015408 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-817aae-677f57497d-hxvsd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:30.017343 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:30.017322 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-maas-api-tls\") pod \"maas-api-e2e-shared-a-817aae-677f57497d-hxvsd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:30.024169 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:30.024094 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnhdc\" (UniqueName: \"kubernetes.io/projected/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-kube-api-access-vnhdc\") pod \"maas-api-e2e-shared-a-817aae-677f57497d-hxvsd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:30.087477 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:30.087444 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:30.229403 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:30.229373 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd"] Jul 14 10:34:30.231208 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:34:30.231174 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479dc495_b7eb_4e95_bb7b_d7fe2f00c3fd.slice/crio-4bc525f967685848960c567abdcaab442f467d2a31bd1cf6c4e86bdeda246b07 WatchSource:0}: Error finding container 4bc525f967685848960c567abdcaab442f467d2a31bd1cf6c4e86bdeda246b07: Status 404 returned error can't find the container with id 4bc525f967685848960c567abdcaab442f467d2a31bd1cf6c4e86bdeda246b07 Jul 14 10:34:30.688344 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:30.688307 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" event={"ID":"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd","Type":"ContainerStarted","Data":"4bc525f967685848960c567abdcaab442f467d2a31bd1cf6c4e86bdeda246b07"} Jul 14 10:34:31.695628 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:31.695589 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" event={"ID":"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd","Type":"ContainerStarted","Data":"f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507"} Jul 14 10:34:31.696102 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:31.695784 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:31.716258 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:31.716206 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" podStartSLOduration=1.935328129 podStartE2EDuration="2.716190357s" totalImagesPullingTime="780.862228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:34:31.714173483 +0000 UTC m=+2059.811561686" watchObservedRunningTime="2026-07-14 10:34:31.716190357 +0000 UTC m=+2059.813578558" Jul 14 10:34:37.706350 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:37.706272 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:34:37.821438 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:37.821403 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj"] Jul 14 10:34:37.825896 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:37.825875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:37.828591 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:37.828567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-684339-serving-cert\"" Jul 14 10:34:37.837941 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:37.837915 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj"] Jul 14 10:34:37.990505 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:37.990408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhzv\" (UniqueName: \"kubernetes.io/projected/acfccf1f-d49f-4ea7-9382-64b850f15bbd-kube-api-access-9qhzv\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:37.990686 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:37.990541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfccf1f-d49f-4ea7-9382-64b850f15bbd-maas-api-tls\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:37.990686 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:37.990575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfccf1f-d49f-4ea7-9382-64b850f15bbd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:38.091644 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:38.091604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfccf1f-d49f-4ea7-9382-64b850f15bbd-maas-api-tls\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:38.091644 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:38.091649 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfccf1f-d49f-4ea7-9382-64b850f15bbd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:38.091896 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:38.091718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhzv\" (UniqueName: \"kubernetes.io/projected/acfccf1f-d49f-4ea7-9382-64b850f15bbd-kube-api-access-9qhzv\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:38.091896 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:34:38.091770 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-684339-serving-cert: secret "maas-api-e2e-shared-b-684339-serving-cert" not found Jul 14 10:34:38.091896 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:34:38.091870 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfccf1f-d49f-4ea7-9382-64b850f15bbd-maas-api-tls podName:acfccf1f-d49f-4ea7-9382-64b850f15bbd nodeName:}" failed. No retries permitted until 2026-07-14 10:34:38.591853339 +0000 UTC m=+2066.689241518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/acfccf1f-d49f-4ea7-9382-64b850f15bbd-maas-api-tls") pod "maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" (UID: "acfccf1f-d49f-4ea7-9382-64b850f15bbd") : secret "maas-api-e2e-shared-b-684339-serving-cert" not found Jul 14 10:34:38.092420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:38.092400 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfccf1f-d49f-4ea7-9382-64b850f15bbd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:38.108618 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:38.108587 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhzv\" (UniqueName: \"kubernetes.io/projected/acfccf1f-d49f-4ea7-9382-64b850f15bbd-kube-api-access-9qhzv\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:38.596847 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:38.596783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfccf1f-d49f-4ea7-9382-64b850f15bbd-maas-api-tls\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:38.599357 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:38.599336 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfccf1f-d49f-4ea7-9382-64b850f15bbd-maas-api-tls\") pod \"maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:38.738237 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:38.738207 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:38.886535 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:38.886506 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj"] Jul 14 10:34:38.888693 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:34:38.888662 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfccf1f_d49f_4ea7_9382_64b850f15bbd.slice/crio-f2e9c9e87d5bc954c63857544c41fbf5b4a07cc1bfc163839bccacf0465e5be5 WatchSource:0}: Error finding container f2e9c9e87d5bc954c63857544c41fbf5b4a07cc1bfc163839bccacf0465e5be5: Status 404 returned error can't find the container with id f2e9c9e87d5bc954c63857544c41fbf5b4a07cc1bfc163839bccacf0465e5be5 Jul 14 10:34:39.741284 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:39.741249 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" event={"ID":"acfccf1f-d49f-4ea7-9382-64b850f15bbd","Type":"ContainerStarted","Data":"11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6"} Jul 14 10:34:39.741726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:39.741341 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:34:39.741726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:39.741359 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" event={"ID":"acfccf1f-d49f-4ea7-9382-64b850f15bbd","Type":"ContainerStarted","Data":"f2e9c9e87d5bc954c63857544c41fbf5b4a07cc1bfc163839bccacf0465e5be5"} Jul 14 10:34:39.760250 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:39.760195 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" podStartSLOduration=2.377949483 podStartE2EDuration="2.760179056s" totalImagesPullingTime="382.229573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:34:39.759697373 +0000 UTC m=+2067.857085576" watchObservedRunningTime="2026-07-14 10:34:39.760179056 +0000 UTC m=+2067.857567258" Jul 14 10:34:45.751568 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:34:45.751538 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:35:12.582825 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:35:12.582776 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:35:12.587680 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:35:12.587654 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:35:12.589777 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:35:12.589753 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:35:12.594130 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:35:12.594108 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:36:12.685396 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:36:12.685319 2561 scope.go:117] "RemoveContainer" containerID="1fb9c15a585e448827f3b89883ed68c0a5319720ead548e8a4bd9983e1163473" Jul 14 10:37:40.664706 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.664621 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt"] Jul 14 10:37:40.668667 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.668649 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.672756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.672727 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"kube-root-ca.crt\"" Jul 14 10:37:40.672913 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.672758 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"openshift-service-ca.crt\"" Jul 14 10:37:40.672913 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.672768 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"sub-test-model-817aae-kserve-self-signed-certs\"" Jul 14 10:37:40.672913 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.672760 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-817aae\"/\"default-dockercfg-8f4dw\"" Jul 14 10:37:40.676314 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.676287 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt"] Jul 14 10:37:40.745604 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.745562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tmp-dir\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.745604 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.745612 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-home\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.745879 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.745653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvt99\" (UniqueName: \"kubernetes.io/projected/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-kube-api-access-kvt99\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.745879 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.745700 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-dshm\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.745879 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.745715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tls-certs\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.745879 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.745742 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-model-cache\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.847058 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.847015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-model-cache\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.847277 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.847071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tmp-dir\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.847277 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.847188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-home\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.847277 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.847242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvt99\" (UniqueName: \"kubernetes.io/projected/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-kube-api-access-kvt99\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.847456 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.847290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-dshm\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.847456 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.847309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tls-certs\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.847584 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.847462 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tmp-dir\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.847584 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.847528 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-model-cache\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.847584 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.847546 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-home\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.849708 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.849685 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-dshm\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.850002 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.849983 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tls-certs\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.855972 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.855945 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvt99\" (UniqueName: \"kubernetes.io/projected/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-kube-api-access-kvt99\") pod \"sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:40.978672 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:40.978576 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:41.138741 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:41.138703 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt"] Jul 14 10:37:41.142214 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:37:41.142169 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1bfb7c3_4ea5_4f9b_8641_e381adc28f0d.slice/crio-af0dfd06ef20fde6e54805e57ae250a6e20136da1d7aa4ab52ad5db0f90c13f5 WatchSource:0}: Error finding container af0dfd06ef20fde6e54805e57ae250a6e20136da1d7aa4ab52ad5db0f90c13f5: Status 404 returned error can't find the container with id af0dfd06ef20fde6e54805e57ae250a6e20136da1d7aa4ab52ad5db0f90c13f5 Jul 14 10:37:41.694527 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:41.694485 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" event={"ID":"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d","Type":"ContainerStarted","Data":"82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c"} Jul 14 10:37:41.694952 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:41.694537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" event={"ID":"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d","Type":"ContainerStarted","Data":"af0dfd06ef20fde6e54805e57ae250a6e20136da1d7aa4ab52ad5db0f90c13f5"} Jul 14 10:37:41.713215 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:41.713160 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" podStartSLOduration=1.713140297 podStartE2EDuration="1.713140297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 10:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:37:41.712575928 +0000 UTC m=+2249.809964131" watchObservedRunningTime="2026-07-14 10:37:41.713140297 +0000 UTC m=+2249.810528500" Jul 14 10:37:50.979080 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:50.979042 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:50.979490 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:50.979096 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:50.991848 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:50.991819 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:37:51.765562 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:37:51.765531 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:39:06.232595 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:06.232515 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt"] Jul 14 10:39:21.253645 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.253580 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" podUID="a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" containerName="main" containerID="cri-o://82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c" gracePeriod=45 Jul 14 10:39:21.510780 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.510713 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:39:21.595873 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.595839 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tls-certs\") pod \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " Jul 14 10:39:21.596056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.595885 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-home\") pod \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " Jul 14 10:39:21.596056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.595903 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-model-cache\") pod \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " Jul 14 10:39:21.596056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.595938 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tmp-dir\") pod \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " Jul 14 10:39:21.596056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.595967 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvt99\" (UniqueName: \"kubernetes.io/projected/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-kube-api-access-kvt99\") pod \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " Jul 14 10:39:21.596056 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.595983 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-dshm\") pod \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\" (UID: \"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d\") " Jul 14 10:39:21.596333 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.596197 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-home" (OuterVolumeSpecName: "home") pod "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" (UID: "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:39:21.596333 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.596239 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" (UID: "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:39:21.596443 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.596262 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-model-cache" (OuterVolumeSpecName: "model-cache") pod "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" (UID: "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:39:21.598460 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.598435 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-dshm" (OuterVolumeSpecName: "dshm") pod "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" (UID: "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 10:39:21.598617 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.598601 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-kube-api-access-kvt99" (OuterVolumeSpecName: "kube-api-access-kvt99") pod "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" (UID: "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d"). InnerVolumeSpecName "kube-api-access-kvt99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:39:21.598674 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.598608 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" (UID: "a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:39:21.697200 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.697163 2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tls-certs\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:39:21.697200 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.697195 2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-home\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:39:21.697200 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.697208 2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-model-cache\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:39:21.697450 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.697215 2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-tmp-dir\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:39:21.697450 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.697223 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvt99\" (UniqueName: \"kubernetes.io/projected/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-kube-api-access-kvt99\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:39:21.697450 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:21.697231 2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d-dshm\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:39:22.219710 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.219669 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" containerID="82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c" exitCode=0 Jul 14 10:39:22.219932 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.219718 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" Jul 14 10:39:22.219932 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.219750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" event={"ID":"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d","Type":"ContainerDied","Data":"82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c"} Jul 14 10:39:22.219932 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.219808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt" event={"ID":"a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d","Type":"ContainerDied","Data":"af0dfd06ef20fde6e54805e57ae250a6e20136da1d7aa4ab52ad5db0f90c13f5"} Jul 14 10:39:22.219932 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.219829 2561 scope.go:117] "RemoveContainer" containerID="82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c" Jul 14 10:39:22.229487 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.229465 2561 scope.go:117] "RemoveContainer" containerID="82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c" Jul 14 10:39:22.229765 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:39:22.229741 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c\": container with ID starting with 82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c not found: ID does not exist" containerID="82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c" Jul 14 10:39:22.229835 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.229775 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c"} err="failed to get container status \"82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c\": rpc error: code = NotFound desc = could not find container \"82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c\": container with ID starting with 82a8dcb95b9631a2e0f38747a614c68907f553f2960fa2364a6919da80b27c1c not found: ID does not exist" Jul 14 10:39:22.242420 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.242380 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt"] Jul 14 10:39:22.249150 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.249124 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-817aae/sub-test-model-817aae-kserve-6cd6ffcc77-cm7dt"] Jul 14 10:39:22.451819 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:39:22.451764 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" path="/var/lib/kubelet/pods/a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d/volumes" Jul 14 10:40:12.613079 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:12.613049 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:40:12.617873 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:12.617848 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:40:12.621004 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:12.620981 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:40:12.625376 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:12.625352 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6v5bh_e83875eb-181b-474d-9c06-2a04e0db1ebb/ovn-acl-logging/0.log" Jul 14 10:40:39.079967 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.079876 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd"] Jul 14 10:40:39.080508 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.080189 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" podUID="479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd" containerName="maas-api" containerID="cri-o://f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507" gracePeriod=30 Jul 14 10:40:39.350928 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.350900 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:40:39.404698 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.404664 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-maas-api-tls\") pod \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " Jul 14 10:40:39.404902 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.404725 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-openshift-service-ca\") pod \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " Jul 14 10:40:39.404902 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.404751 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnhdc\" (UniqueName: \"kubernetes.io/projected/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-kube-api-access-vnhdc\") pod \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\" (UID: \"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd\") " Jul 14 10:40:39.405159 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.405132 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd" (UID: "479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:40:39.407151 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.407120 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd" (UID: "479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:40:39.407269 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.407145 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-kube-api-access-vnhdc" (OuterVolumeSpecName: "kube-api-access-vnhdc") pod "479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd" (UID: "479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd"). InnerVolumeSpecName "kube-api-access-vnhdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:40:39.506206 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.506168 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:40:39.506206 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.506199 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnhdc\" (UniqueName: \"kubernetes.io/projected/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-kube-api-access-vnhdc\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:40:39.506429 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.506214 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:40:39.618488 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.618398 2561 generic.go:356] "Generic (PLEG): container finished" podID="479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd" containerID="f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507" exitCode=0 Jul 14 10:40:39.618488 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.618444 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" Jul 14 10:40:39.618701 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.618484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" event={"ID":"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd","Type":"ContainerDied","Data":"f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507"} Jul 14 10:40:39.618701 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.618537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd" event={"ID":"479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd","Type":"ContainerDied","Data":"4bc525f967685848960c567abdcaab442f467d2a31bd1cf6c4e86bdeda246b07"} Jul 14 10:40:39.618701 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.618565 2561 scope.go:117] "RemoveContainer" containerID="f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507" Jul 14 10:40:39.627909 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.627891 2561 scope.go:117] "RemoveContainer" containerID="f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507" Jul 14 10:40:39.628183 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:40:39.628151 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507\": container with ID starting with f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507 not found: ID does not exist" containerID="f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507" Jul 14 10:40:39.628258 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.628196 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507"} err="failed to get container status \"f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507\": rpc error: code = NotFound desc = could not find container \"f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507\": container with ID starting with f750842d8d3f971810b5d575baad60811325ffbffb7cf3916494ae246d2a8507 not found: ID does not exist" Jul 14 10:40:39.646270 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.646232 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd"] Jul 14 10:40:39.650467 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:39.650436 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-817aae-677f57497d-hxvsd"] Jul 14 10:40:40.449235 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:40:40.449199 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd" path="/var/lib/kubelet/pods/479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd/volumes" Jul 14 10:41:22.577053 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.577012 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj"] Jul 14 10:41:22.577580 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.577272 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" podUID="acfccf1f-d49f-4ea7-9382-64b850f15bbd" containerName="maas-api" containerID="cri-o://11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6" gracePeriod=30 Jul 14 10:41:22.835003 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.834936 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:41:22.851468 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.851432 2561 generic.go:356] "Generic (PLEG): container finished" podID="acfccf1f-d49f-4ea7-9382-64b850f15bbd" containerID="11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6" exitCode=0 Jul 14 10:41:22.851669 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.851486 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" Jul 14 10:41:22.851669 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.851513 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" event={"ID":"acfccf1f-d49f-4ea7-9382-64b850f15bbd","Type":"ContainerDied","Data":"11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6"} Jul 14 10:41:22.851669 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.851597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj" event={"ID":"acfccf1f-d49f-4ea7-9382-64b850f15bbd","Type":"ContainerDied","Data":"f2e9c9e87d5bc954c63857544c41fbf5b4a07cc1bfc163839bccacf0465e5be5"} Jul 14 10:41:22.851669 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.851634 2561 scope.go:117] "RemoveContainer" containerID="11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6" Jul 14 10:41:22.864772 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.864633 2561 scope.go:117] "RemoveContainer" containerID="11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6" Jul 14 10:41:22.865295 ip-10-0-139-82 kubenswrapper[2561]: E0714 10:41:22.865207 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6\": container with ID starting with 11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6 not found: ID does not exist" containerID="11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6" Jul 14 10:41:22.865295 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.865254 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6"} err="failed to get container status \"11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6\": rpc error: code = NotFound desc = could not find container \"11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6\": container with ID starting with 11803953959f1d47f5c95f565a87ca36979a8fec2db2379a1dce6803332328a6 not found: ID does not exist" Jul 14 10:41:22.905475 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.905442 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qhzv\" (UniqueName: \"kubernetes.io/projected/acfccf1f-d49f-4ea7-9382-64b850f15bbd-kube-api-access-9qhzv\") pod \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " Jul 14 10:41:22.905475 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.905482 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfccf1f-d49f-4ea7-9382-64b850f15bbd-maas-api-tls\") pod \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " Jul 14 10:41:22.905736 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.905524 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfccf1f-d49f-4ea7-9382-64b850f15bbd-openshift-service-ca\") pod \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\" (UID: \"acfccf1f-d49f-4ea7-9382-64b850f15bbd\") " Jul 14 10:41:22.905967 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.905943 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acfccf1f-d49f-4ea7-9382-64b850f15bbd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "acfccf1f-d49f-4ea7-9382-64b850f15bbd" (UID: "acfccf1f-d49f-4ea7-9382-64b850f15bbd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 10:41:22.907940 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.907917 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acfccf1f-d49f-4ea7-9382-64b850f15bbd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "acfccf1f-d49f-4ea7-9382-64b850f15bbd" (UID: "acfccf1f-d49f-4ea7-9382-64b850f15bbd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 10:41:22.908021 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:22.907988 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfccf1f-d49f-4ea7-9382-64b850f15bbd-kube-api-access-9qhzv" (OuterVolumeSpecName: "kube-api-access-9qhzv") pod "acfccf1f-d49f-4ea7-9382-64b850f15bbd" (UID: "acfccf1f-d49f-4ea7-9382-64b850f15bbd"). InnerVolumeSpecName "kube-api-access-9qhzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 10:41:23.006652 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:23.006615 2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acfccf1f-d49f-4ea7-9382-64b850f15bbd-openshift-service-ca\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:41:23.006652 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:23.006648 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qhzv\" (UniqueName: \"kubernetes.io/projected/acfccf1f-d49f-4ea7-9382-64b850f15bbd-kube-api-access-9qhzv\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:41:23.006652 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:23.006661 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acfccf1f-d49f-4ea7-9382-64b850f15bbd-maas-api-tls\") on node \"ip-10-0-139-82.ec2.internal\" DevicePath \"\"" Jul 14 10:41:23.173632 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:23.173589 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj"] Jul 14 10:41:23.179353 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:23.179318 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-684339-758d7d8df7-8vlzj"] Jul 14 10:41:24.448762 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:24.448715 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acfccf1f-d49f-4ea7-9382-64b850f15bbd" path="/var/lib/kubelet/pods/acfccf1f-d49f-4ea7-9382-64b850f15bbd/volumes" Jul 14 10:41:29.879921 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:29.879880 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6db6887458-mwj7b_75b3f8bb-7c5d-4493-bfed-81c3fb433325/authorino/0.log" Jul 14 10:41:34.470988 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:34.470948 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7wbvd_1b71d1e2-c4d2-49f8-8ac2-2011988960f9/manager/0.log" Jul 14 10:41:34.726256 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:34.726165 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b86d949f5-xxtsh_799383aa-d7dc-4677-b889-e457eb85ddec/maas-api/0.log" Jul 14 10:41:35.200584 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:35.200552 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vd9x9_0a81b349-8442-4865-873f-90371db2d6d8/server/0.log" Jul 14 10:41:35.331447 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:35.331411 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hvdpk_58109363-0ac2-4352-85c2-c2489c2e3e64/manager/0.log" Jul 14 10:41:35.700942 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:35.700915 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj_0ffa8a37-d116-47e6-ae71-36831a3cedcb/copy-manifests/0.log" Jul 14 10:41:35.707897 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:35.707863 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj_0ffa8a37-d116-47e6-ae71-36831a3cedcb/manager/0.log" Jul 14 10:41:35.821156 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:35.821126 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lvqg4_5cb712b7-1a3d-4076-88dd-38cd32d49471/postgres/0.log" Jul 14 10:41:37.114227 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:37.114187 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6db6887458-mwj7b_75b3f8bb-7c5d-4493-bfed-81c3fb433325/authorino/0.log" Jul 14 10:41:37.234785 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:37.234753 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dp28k_8b5ee7eb-3c58-44fc-be37-d0d9027e1785/manager/0.log" Jul 14 10:41:37.354899 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:37.354864 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wf7tx_d2982406-ba9a-4a2d-9286-f4c54346b2c5/manager/0.log" Jul 14 10:41:37.613232 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:37.613191 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-b7tzw_605243f9-ae2f-445a-a752-e9467c9c24e3/registry-server/0.log" Jul 14 10:41:37.745850 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:37.745817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xd8rg_28740ca1-490e-484b-a1bf-695c8cdd12c0/manager/0.log" Jul 14 10:41:37.998130 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:37.998044 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bdvq9_3b3fe38f-d9c5-48a8-9eb8-334038d6db2b/manager/0.log" Jul 14 10:41:38.707563 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:38.707528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66cfd9dd7c-zn2lq_5e65fc22-e005-4dbd-97ac-cf0d6e394117/kube-auth-proxy/0.log" Jul 14 10:41:38.957092 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:38.957062 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zctmt_ddf45e71-8c92-4559-b345-21893599e1dc/payload-pre-processing/0.log" Jul 14 10:41:39.088295 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:39.088263 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-c6htm_62883907-cebc-40c6-bb12-0ddb8f4c1f16/payload-processing/0.log" Jul 14 10:41:39.219107 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:39.219070 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75456cbc5d-9j95j_d76890f3-a4e2-42ac-a7ed-2a8de69b57c2/router/0.log" Jul 14 10:41:39.562186 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:39.562143 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kqgsh_6729ab0d-571a-4f8b-ac17-b3870c83e7b2/main/0.log" Jul 14 10:41:40.187760 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:40.187723 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-86fns_7f2b31c9-7e18-41b1-9d52-7c14bd1462d0/main/0.log" Jul 14 10:41:46.968202 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:46.968159 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t64dj_3f0db0c6-2d78-43f0-a36e-f7ceb3b7e0ea/global-pull-secret-syncer/0.log" Jul 14 10:41:47.123466 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:47.123430 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m67dp_50f67e5c-fcc3-4a0b-ae24-73ead64751b0/konnectivity-agent/0.log" Jul 14 10:41:47.229462 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:47.229365 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-82.ec2.internal_48011e991b26b97b5ae0c1a3157566a6/haproxy/0.log" Jul 14 10:41:52.100528 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:52.100494 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6db6887458-mwj7b_75b3f8bb-7c5d-4493-bfed-81c3fb433325/authorino/0.log" Jul 14 10:41:52.134263 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:52.134215 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dp28k_8b5ee7eb-3c58-44fc-be37-d0d9027e1785/manager/0.log" Jul 14 10:41:52.159996 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:52.159964 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wf7tx_d2982406-ba9a-4a2d-9286-f4c54346b2c5/manager/0.log" Jul 14 10:41:52.260864 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:52.260829 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-b7tzw_605243f9-ae2f-445a-a752-e9467c9c24e3/registry-server/0.log" Jul 14 10:41:52.430592 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:52.430502 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xd8rg_28740ca1-490e-484b-a1bf-695c8cdd12c0/manager/0.log" Jul 14 10:41:52.568923 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:52.568885 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bdvq9_3b3fe38f-d9c5-48a8-9eb8-334038d6db2b/manager/0.log" Jul 14 10:41:54.444905 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:54.444875 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wj822_186f56af-a4b6-4c9c-a441-b07966fff28f/cluster-monitoring-operator/0.log" Jul 14 10:41:54.642567 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:54.642474 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2l55t_e8580db5-0553-4857-8ded-b68128848b01/node-exporter/0.log" Jul 14 10:41:54.668374 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:54.668341 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2l55t_e8580db5-0553-4857-8ded-b68128848b01/kube-rbac-proxy/0.log" Jul 14 10:41:54.690488 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:54.690461 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2l55t_e8580db5-0553-4857-8ded-b68128848b01/init-textfile/0.log" Jul 14 10:41:56.915736 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.915696 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x"] Jul 14 10:41:56.916164 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.916108 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" containerName="main" Jul 14 10:41:56.916164 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.916120 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" containerName="main" Jul 14 10:41:56.916164 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.916146 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd" containerName="maas-api" Jul 14 10:41:56.916164 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.916152 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd" containerName="maas-api" Jul 14 10:41:56.916164 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.916159 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfccf1f-d49f-4ea7-9382-64b850f15bbd" containerName="maas-api" Jul 14 10:41:56.916164 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.916164 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfccf1f-d49f-4ea7-9382-64b850f15bbd" containerName="maas-api" Jul 14 10:41:56.916369 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.916254 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1bfb7c3-4ea5-4f9b-8641-e381adc28f0d" containerName="main" Jul 14 10:41:56.916369 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.916261 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="479dc495-b7eb-4e95-bb7b-d7fe2f00c3fd" containerName="maas-api" Jul 14 10:41:56.916369 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.916269 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfccf1f-d49f-4ea7-9382-64b850f15bbd" containerName="maas-api" Jul 14 10:41:56.919370 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.919348 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:56.921896 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.921874 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5rfhj\"/\"kube-root-ca.crt\"" Jul 14 10:41:56.922044 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.921927 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5rfhj\"/\"openshift-service-ca.crt\"" Jul 14 10:41:56.922945 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.922927 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5rfhj\"/\"default-dockercfg-f5pxx\"" Jul 14 10:41:56.925274 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.925254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-proc\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:56.925404 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.925294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-podres\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:56.925404 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.925315 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-lib-modules\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:56.925404 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.925379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzggh\" (UniqueName: \"kubernetes.io/projected/6942b0b7-f174-4906-9c34-6818eccb6695-kube-api-access-nzggh\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:56.925575 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.925449 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-sys\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:56.928611 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:56.928590 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x"] Jul 14 10:41:57.026726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.026687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-podres\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.026726 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.026731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-lib-modules\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.026994 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.026782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzggh\" (UniqueName: \"kubernetes.io/projected/6942b0b7-f174-4906-9c34-6818eccb6695-kube-api-access-nzggh\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.026994 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.026904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-sys\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.026994 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.026931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-proc\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.026994 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.026938 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-lib-modules\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.026994 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.026903 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-podres\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.026994 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.026964 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-sys\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.027227 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.027006 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6942b0b7-f174-4906-9c34-6818eccb6695-proc\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.035486 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.035459 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzggh\" (UniqueName: \"kubernetes.io/projected/6942b0b7-f174-4906-9c34-6818eccb6695-kube-api-access-nzggh\") pod \"perf-node-gather-daemonset-bvv9x\" (UID: \"6942b0b7-f174-4906-9c34-6818eccb6695\") " pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.230619 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.230521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:57.288729 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.288695 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/1.log" Jul 14 10:41:57.310627 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.310600 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4p7x6_8ef7c917-86a5-4f72-b6b5-8758e39ba40e/console-operator/2.log" Jul 14 10:41:57.376530 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:57.376508 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x"] Jul 14 10:41:57.378910 ip-10-0-139-82 kubenswrapper[2561]: W0714 10:41:57.378880 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6942b0b7_f174_4906_9c34_6818eccb6695.slice/crio-bc77c11d354218977236cd3c59683b4779cba3aab28f9f7d27b93d0174a5fefc WatchSource:0}: Error finding container bc77c11d354218977236cd3c59683b4779cba3aab28f9f7d27b93d0174a5fefc: Status 404 returned error can't find the container with id bc77c11d354218977236cd3c59683b4779cba3aab28f9f7d27b93d0174a5fefc Jul 14 10:41:58.038914 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:58.038877 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" event={"ID":"6942b0b7-f174-4906-9c34-6818eccb6695","Type":"ContainerStarted","Data":"990c33fc3ad3ea200118cf220332c63c309c297006814b06e192ed9dc47f5fd9"} Jul 14 10:41:58.039311 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:58.038930 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" event={"ID":"6942b0b7-f174-4906-9c34-6818eccb6695","Type":"ContainerStarted","Data":"bc77c11d354218977236cd3c59683b4779cba3aab28f9f7d27b93d0174a5fefc"} Jul 14 10:41:58.039311 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:58.038995 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:41:58.061149 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:58.061097 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" podStartSLOduration=2.061079943 podStartE2EDuration="2.061079943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 10:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 10:41:58.059274458 +0000 UTC m=+2506.156662659" watchObservedRunningTime="2026-07-14 10:41:58.061079943 +0000 UTC m=+2506.158468189" Jul 14 10:41:58.556450 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:58.556396 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-ktsxs_0cd01ca3-c784-4443-986a-007007226b0c/volume-data-source-validator/0.log" Jul 14 10:41:59.684895 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:59.684861 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zhsc_904345be-f78b-4503-8bab-1c27c45f57c1/dns/0.log" Jul 14 10:41:59.706951 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:59.706917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zhsc_904345be-f78b-4503-8bab-1c27c45f57c1/kube-rbac-proxy/0.log" Jul 14 10:41:59.855187 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:41:59.855150 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rfwhk_d7d7750a-ed94-4fce-8684-53b69c2befba/dns-node-resolver/0.log" Jul 14 10:42:00.512160 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:00.512102 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2qd4v_b11e3dfb-042f-45a5-b118-3e59564ea508/node-ca/0.log" Jul 14 10:42:01.656886 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:01.656835 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66cfd9dd7c-zn2lq_5e65fc22-e005-4dbd-97ac-cf0d6e394117/kube-auth-proxy/0.log" Jul 14 10:42:01.753577 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:01.753540 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zctmt_ddf45e71-8c92-4559-b345-21893599e1dc/payload-pre-processing/0.log" Jul 14 10:42:01.827756 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:01.827717 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-c6htm_62883907-cebc-40c6-bb12-0ddb8f4c1f16/payload-processing/0.log" Jul 14 10:42:01.854635 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:01.854598 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75456cbc5d-9j95j_d76890f3-a4e2-42ac-a7ed-2a8de69b57c2/router/0.log" Jul 14 10:42:02.585004 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:02.584970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x8bct_d0931415-10d0-4e57-b02f-f5200ec5ac8a/serve-healthcheck-canary/0.log" Jul 14 10:42:03.159502 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:03.159394 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-57rc5_2108d827-de3f-4d7d-ac89-c5a6b8895e5e/insights-operator/0.log" Jul 14 10:42:03.162176 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:03.162152 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-57rc5_2108d827-de3f-4d7d-ac89-c5a6b8895e5e/insights-operator/1.log" Jul 14 10:42:03.334396 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:03.334365 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fcqjf_9155d2e1-cddd-47df-8b37-7f461a19f8c8/kube-rbac-proxy/0.log" Jul 14 10:42:03.359165 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:03.359132 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fcqjf_9155d2e1-cddd-47df-8b37-7f461a19f8c8/exporter/0.log" Jul 14 10:42:03.382814 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:03.382775 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fcqjf_9155d2e1-cddd-47df-8b37-7f461a19f8c8/extractor/0.log" Jul 14 10:42:04.054771 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:04.054742 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5rfhj/perf-node-gather-daemonset-bvv9x" Jul 14 10:42:05.605499 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:05.605466 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7wbvd_1b71d1e2-c4d2-49f8-8ac2-2011988960f9/manager/0.log" Jul 14 10:42:05.867706 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:05.867675 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b86d949f5-xxtsh_799383aa-d7dc-4677-b889-e457eb85ddec/maas-api/0.log" Jul 14 10:42:06.038239 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:06.038212 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vd9x9_0a81b349-8442-4865-873f-90371db2d6d8/server/0.log" Jul 14 10:42:06.160622 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:06.160537 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hvdpk_58109363-0ac2-4352-85c2-c2489c2e3e64/manager/0.log" Jul 14 10:42:06.386578 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:06.386543 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj_0ffa8a37-d116-47e6-ae71-36831a3cedcb/manager/0.log" Jul 14 10:42:06.408130 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:06.408098 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b96c8bfcf-zjmhj_0ffa8a37-d116-47e6-ae71-36831a3cedcb/copy-manifests/0.log" Jul 14 10:42:06.434586 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:06.434490 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lvqg4_5cb712b7-1a3d-4076-88dd-38cd32d49471/postgres/0.log" Jul 14 10:42:07.430857 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:07.430826 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66cfd9dd7c-zn2lq_5e65fc22-e005-4dbd-97ac-cf0d6e394117/kube-auth-proxy/0.log" Jul 14 10:42:07.502648 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:07.502615 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zctmt_ddf45e71-8c92-4559-b345-21893599e1dc/payload-pre-processing/0.log" Jul 14 10:42:07.570358 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:07.570324 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-c6htm_62883907-cebc-40c6-bb12-0ddb8f4c1f16/payload-processing/0.log" Jul 14 10:42:07.586202 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:07.586166 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75456cbc5d-9j95j_d76890f3-a4e2-42ac-a7ed-2a8de69b57c2/router/0.log" Jul 14 10:42:08.939962 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:08.939928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66cfd9dd7c-zn2lq_5e65fc22-e005-4dbd-97ac-cf0d6e394117/kube-auth-proxy/0.log" Jul 14 10:42:09.016583 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:09.016551 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zctmt_ddf45e71-8c92-4559-b345-21893599e1dc/payload-pre-processing/0.log" Jul 14 10:42:09.082194 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:09.082161 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-c6htm_62883907-cebc-40c6-bb12-0ddb8f4c1f16/payload-processing/0.log" Jul 14 10:42:09.098048 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:09.098020 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75456cbc5d-9j95j_d76890f3-a4e2-42ac-a7ed-2a8de69b57c2/router/0.log" Jul 14 10:42:13.206981 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:13.206944 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-r8cqf_bedfb6fe-a253-4191-960b-325181dc222f/kube-storage-version-migrator-operator/1.log" Jul 14 10:42:13.208596 ip-10-0-139-82 kubenswrapper[2561]: I0714 10:42:13.208572 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-r8cqf_bedfb6fe-a253-4191-960b-325181dc222f/kube-storage-version-migrator-operator/0.log"