Jul 29 19:12:50.020170 ip-10-0-132-216 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 19:12:50.020182 ip-10-0-132-216 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 19:12:50.020189 ip-10-0-132-216 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 19:12:50.020435 ip-10-0-132-216 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 19:13:00.037827 ip-10-0-132-216 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 19:13:00.037856 ip-10-0-132-216 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5b1a803cfca14c438b59a2bdee1842ff -- Jul 29 19:14:41.498187 ip-10-0-132-216 systemd[1]: Starting Kubernetes Kubelet... Jul 29 19:14:41.935713 ip-10-0-132-216 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 19:14:41.935713 ip-10-0-132-216 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 19:14:41.935713 ip-10-0-132-216 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 19:14:41.935713 ip-10-0-132-216 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 19:14:41.935713 ip-10-0-132-216 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 19:14:41.938446 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.938355 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 19:14:41.944311 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944290 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:14:41.944311 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944310 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944314 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944317 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944320 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944326 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944330 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944333 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944336 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944340 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944343 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944346 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944349 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944351 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944359 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944363 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944365 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944369 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944373 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944376 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:14:41.944391 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944378 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944381 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944383 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944386 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944388 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944391 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944394 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944397 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944400 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944402 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944405 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944408 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944410 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944413 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944416 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944419 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944422 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944425 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944427 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944430 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:14:41.944852 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944432 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944435 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944437 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944440 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944442 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944444 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944447 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944450 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944452 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944454 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944457 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944461 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944464 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944467 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944471 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944474 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944477 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944480 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944482 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944485 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:14:41.945410 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944487 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944490 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944492 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944495 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944497 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944500 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944502 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944504 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944507 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944511 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944513 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944516 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944518 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944521 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944523 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944525 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944528 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944530 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944532 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:14:41.945934 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944534 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944537 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944539 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944542 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944544 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944546 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944548 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944552 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944554 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944557 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944560 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944562 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944565 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944567 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944570 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944572 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944575 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944577 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944579 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.944583 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:14:41.946397 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945297 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945304 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945306 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945310 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945312 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945316 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945319 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945322 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945324 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945327 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945329 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945332 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945334 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945337 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945340 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945343 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945345 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945348 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945350 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945353 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:14:41.946902 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945356 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945358 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945361 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945364 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945366 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945369 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945371 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945374 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945376 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945378 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945381 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945384 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945386 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945389 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945391 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945394 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945396 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945399 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945402 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945406 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:14:41.947407 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945410 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945412 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945415 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945418 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945421 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945423 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945426 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945429 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945431 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945434 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945437 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945442 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945444 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945447 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945449 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945452 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945455 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945457 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945460 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945462 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:14:41.947900 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945465 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945467 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945470 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945472 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945475 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945477 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945480 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945483 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945485 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945488 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945490 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945493 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945496 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945498 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945501 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945503 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945505 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945509 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945514 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:14:41.948439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945518 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945521 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945523 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945526 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945531 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945534 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945537 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945540 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945543 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945545 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945548 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945550 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945552 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945555 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945557 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945559 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945562 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945564 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945566 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.945569 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:14:41.948918 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946052 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946066 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946071 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946075 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946079 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946082 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946085 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946088 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946091 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946093 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946096 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946099 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946102 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946104 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946107 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946109 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946112 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946115 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946117 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:14:41.949406 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946120 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946122 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946125 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946127 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946130 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946132 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946135 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946137 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946140 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946142 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946145 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946147 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946149 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946153 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946156 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946159 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946163 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946165 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946168 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:14:41.949868 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946170 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946172 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946175 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946177 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946180 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946182 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946185 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946187 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946190 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946192 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946194 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946197 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946199 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946202 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946204 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946208 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946213 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946216 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946219 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:14:41.950352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946221 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946224 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946227 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946230 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946232 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946236 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946238 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946241 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946248 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946253 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946256 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946259 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946262 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946265 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946268 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946271 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946274 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946277 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946280 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946283 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:14:41.950830 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946286 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946288 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946291 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946294 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946296 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946299 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946301 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946304 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946306 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946308 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946311 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946313 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946316 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946318 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946321 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946323 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946326 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946328 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946330 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946334 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:14:41.951440 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946339 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.946342 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946419 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946427 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946434 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946438 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946443 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946447 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946451 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946458 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946461 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946464 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946467 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946471 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946474 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946477 2574 flags.go:64] FLAG: --cgroup-root="" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946479 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946482 2574 flags.go:64] FLAG: --client-ca-file="" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946485 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946487 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946491 2574 flags.go:64] FLAG: --cluster-domain="" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946494 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946497 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946500 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 19:14:41.951950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946503 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946507 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946510 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946513 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946517 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946520 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946523 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946527 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946531 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946534 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946539 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946542 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946545 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946548 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946551 2574 flags.go:64] FLAG: --enable-server="true" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946553 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946558 2574 flags.go:64] FLAG: --event-burst="100" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946561 2574 flags.go:64] FLAG: --event-qps="50" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946564 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946567 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946569 2574 flags.go:64] FLAG: --eviction-hard="" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946573 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946576 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946579 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946582 2574 flags.go:64] FLAG: --eviction-soft="" Jul 29 19:14:41.952528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946585 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946588 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946591 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946594 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946597 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946599 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946602 2574 flags.go:64] FLAG: --feature-gates="" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946606 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946609 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946612 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946614 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946617 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946620 2574 flags.go:64] FLAG: --help="false" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946623 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-132-216.ec2.internal" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946627 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946631 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946634 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946637 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946641 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946644 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946647 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946650 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946652 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 19:14:41.953140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946655 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946658 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946661 2574 flags.go:64] FLAG: --kube-reserved="" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946664 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946667 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946670 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946672 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946675 2574 flags.go:64] FLAG: --lock-file="" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946678 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946681 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946684 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946689 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946693 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946696 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946699 2574 flags.go:64] FLAG: --logging-format="text" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946702 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946705 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946707 2574 flags.go:64] FLAG: --manifest-url="" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946710 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946714 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946717 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946721 2574 flags.go:64] FLAG: --max-pods="110" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946724 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946728 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946731 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 19:14:41.953727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946734 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946737 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946740 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946743 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946751 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946754 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946757 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946760 2574 flags.go:64] FLAG: --pod-cidr="" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946763 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946769 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946771 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946774 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946777 2574 flags.go:64] FLAG: --port="10250" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946780 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946783 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01f084d919cfb60b5" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946786 2574 flags.go:64] FLAG: --qos-reserved="" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946789 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946792 2574 flags.go:64] FLAG: --register-node="true" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946795 2574 flags.go:64] FLAG: --register-with-taints="" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946798 2574 flags.go:64] FLAG: --registry-burst="10" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946801 2574 flags.go:64] FLAG: --registry-qps="5" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946804 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946806 2574 flags.go:64] FLAG: --reserved-memory="" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946819 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946823 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 19:14:41.954350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946826 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946829 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946831 2574 flags.go:64] FLAG: --runonce="false" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946835 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946838 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946842 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946845 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946847 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946851 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946854 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946857 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946861 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946864 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946866 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946869 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946872 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946874 2574 flags.go:64] FLAG: --system-cgroups="" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946877 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946882 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946898 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946901 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946905 2574 flags.go:64] FLAG: --tls-min-version="" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946908 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946911 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946914 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 19:14:41.955013 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946916 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946920 2574 flags.go:64] FLAG: --v="2" Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946923 2574 flags.go:64] FLAG: --version="false" Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946928 2574 flags.go:64] FLAG: --vmodule="" Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946931 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.946934 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947049 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947053 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947056 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947059 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947062 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947064 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947067 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947072 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947074 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947077 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947079 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947082 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947085 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947088 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947091 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:14:41.955663 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947094 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947096 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947099 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947101 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947103 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947106 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947108 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947111 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947113 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947117 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947121 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947124 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947126 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947129 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947131 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947134 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947136 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947139 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947141 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:14:41.956270 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947144 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947146 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947148 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947151 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947154 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947157 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947160 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947163 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947165 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947167 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947170 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947173 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947178 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947181 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947183 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947186 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947188 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947191 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947193 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947195 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:14:41.956738 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947198 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947200 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947203 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947205 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947208 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947210 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947212 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947215 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947217 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947220 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947222 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947225 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947227 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947230 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947232 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947234 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947237 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947241 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947243 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947246 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:14:41.957253 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947248 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947251 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947253 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947256 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947258 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947261 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947265 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947269 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947272 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947274 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947277 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947280 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947282 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947284 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947287 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947290 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947292 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947295 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947297 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:14:41.957945 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947300 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947302 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947306 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947309 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947312 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.947314 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.947320 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.954647 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.954664 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.954684 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.954691 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954753 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954758 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954762 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:14:41.958700 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954764 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954767 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954770 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954773 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954781 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954785 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954788 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954790 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954793 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954795 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954798 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954800 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954803 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954805 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954816 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954819 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954822 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954824 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954827 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954829 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:14:41.959117 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954832 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954834 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954837 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954839 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954842 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954845 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954848 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954851 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954853 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954856 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954858 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954861 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954864 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954866 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954868 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954871 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954873 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954881 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954884 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954903 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:14:41.959598 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954906 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954909 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954912 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954914 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954917 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954919 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954922 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954924 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954927 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954929 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954932 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954934 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954937 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954940 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954942 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954945 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954947 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954950 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954954 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954957 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:14:41.960114 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954959 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954962 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954964 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954967 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954970 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954974 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954977 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954980 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954983 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954985 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954994 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954997 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.954999 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955002 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955004 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955007 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955011 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955014 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955017 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:14:41.960626 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955019 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955022 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955024 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955027 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955029 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955032 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955035 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955037 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955040 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955042 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955045 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955048 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955051 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955055 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955058 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955060 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:14:41.961257 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955066 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.955071 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955224 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955228 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955231 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955234 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955236 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955239 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955247 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955250 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955252 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955255 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955257 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955260 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955262 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:14:41.961682 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955266 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955269 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955272 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955275 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955278 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955281 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955283 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955286 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955289 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955292 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955294 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955297 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955300 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955303 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955305 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955308 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955310 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955313 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955315 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955317 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:14:41.962084 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955320 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955323 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955325 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955327 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955330 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955332 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955340 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955342 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955345 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955347 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955350 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955352 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955354 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955356 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955359 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955361 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955364 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955366 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955369 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:14:41.962671 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955371 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955373 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955376 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955378 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955381 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955384 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955386 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955388 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955391 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955393 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955397 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955400 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955403 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955406 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955408 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955411 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955414 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955417 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955419 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:14:41.963176 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955421 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955429 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955432 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955440 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955443 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955445 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955447 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955450 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955453 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955456 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955459 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955461 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955464 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955466 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955469 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955471 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955474 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955477 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955479 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955481 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:14:41.963781 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955484 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955486 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955488 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955491 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955493 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955495 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955498 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:41.955500 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.955505 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.955631 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.960924 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.962350 2574 server.go:1019] "Starting client certificate rotation" Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.962460 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 19:14:41.964615 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.962514 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 19:14:41.965197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.965182 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 19:14:41.968229 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.968188 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 19:14:41.974939 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.974923 2574 log.go:25] "Validated CRI v1 runtime API" Jul 29 19:14:41.977130 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.977114 2574 log.go:25] "Validated CRI v1 image API" Jul 29 19:14:41.978275 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.978221 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 19:14:41.980839 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.980807 2574 fs.go:135] Filesystem UUIDs: map[50d96058-d406-4f49-a651-d93ee599ee7d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b40068d0-6f70-4d75-befb-99313f2369c5:/dev/nvme0n1p4] Jul 29 19:14:41.980953 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.980837 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 19:14:41.986026 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.985913 2574 manager.go:216] Machine: {Timestamp:2026-07-29 19:14:41.985359561 +0000 UTC m=+0.350442294 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100730 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ba7462da6eb712728abd481b4434e SystemUUID:ec2ba746-2da6-eb71-2728-abd481b4434e BootID:5b1a803c-fca1-4c43-8b59-a2bdee1842ff Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5d:7c:04:fc:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5d:7c:04:fc:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:7c:c7:2c:62:26 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 19:14:41.986026 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.986016 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 19:14:41.986152 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.986094 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 19:14:41.989170 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.989136 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 19:14:41.989350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.989174 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 19:14:41.989873 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.989861 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 19:14:41.989952 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.989878 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 19:14:41.989952 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.989905 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 19:14:41.989952 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.989920 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 19:14:41.991211 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.991199 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 19:14:41.993081 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.993066 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 29 19:14:41.993405 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.993392 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 19:14:41.993671 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.993661 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 29 19:14:41.994337 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.994305 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 19:14:41.994416 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.994360 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 19:14:41.994475 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.994434 2574 kubelet.go:398] "Adding apiserver pod source" Jul 29 19:14:41.994475 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.994453 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 19:14:41.995037 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.995023 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 19:14:41.995076 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.995054 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 19:14:41.996278 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.996256 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 19:14:41.998025 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.998008 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 19:14:41.999403 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.999389 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 19:14:41.999455 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:41.999419 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 19:14:42.001030 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001017 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 19:14:42.001090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001034 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 19:14:42.001090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001040 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 19:14:42.001090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001046 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 19:14:42.001090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001054 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 19:14:42.001090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001060 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 19:14:42.001090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001068 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 19:14:42.001090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001073 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 19:14:42.001090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001079 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 19:14:42.001090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001084 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 19:14:42.001459 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001095 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 19:14:42.001459 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001100 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 19:14:42.001459 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001123 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 19:14:42.001459 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.001129 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 19:14:42.004421 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.004410 2574 server.go:1268] "Started kubelet" Jul 29 19:14:42.004531 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.004507 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 19:14:42.004581 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.004508 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 19:14:42.004634 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.004583 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 19:14:42.005399 ip-10-0-132-216 systemd[1]: Started Kubernetes Kubelet. Jul 29 19:14:42.006332 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.006317 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-216.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 19:14:42.006455 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.006390 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 19:14:42.006663 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.006643 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 19:14:42.006718 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.006708 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 29 19:14:42.008243 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.008225 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 19:14:42.010934 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.010916 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 19:14:42.011265 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.010300 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-216.ec2.internal.18c6d89f88bbbc8e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-216.ec2.internal,UID:ip-10-0-132-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-216.ec2.internal,},FirstTimestamp:2026-07-29 19:14:42.00438491 +0000 UTC m=+0.369467643,LastTimestamp:2026-07-29 19:14:42.00438491 +0000 UTC m=+0.369467643,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-216.ec2.internal,}" Jul 29 19:14:42.015300 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.015282 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 19:14:42.015300 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.015287 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 19:14:42.015435 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.015380 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016008 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016039 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016078 2574 factory.go:55] Registering systemd factory Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016091 2574 factory.go:223] Registration of the systemd container factory successfully Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016011 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016253 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016261 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016377 2574 factory.go:153] Registering CRI-O factory Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016391 2574 factory.go:223] Registration of the crio container factory successfully Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016457 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016481 2574 factory.go:103] Registering Raw factory Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016495 2574 manager.go:1196] Started watching for new ooms in manager Jul 29 19:14:42.016966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.016968 2574 manager.go:349] Starting recovery of all containers Jul 29 19:14:42.027026 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.026621 2574 manager.go:354] Recovery completed Jul 29 19:14:42.027823 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.027795 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 19:14:42.028032 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.027966 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 19:14:42.028728 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.028709 2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 29 19:14:42.032350 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.032336 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:14:42.034457 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.034434 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:14:42.034510 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.034471 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:14:42.034510 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.034482 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:14:42.034993 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.034979 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 19:14:42.035039 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.034993 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 19:14:42.035039 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.035009 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 29 19:14:42.035092 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.035063 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:14:42.035718 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.035705 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:14:42.035771 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.035731 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:14:42.035771 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.035745 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:14:42.036632 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.036620 2574 policy_none.go:49] "None policy: Start" Jul 29 19:14:42.036666 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.036637 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 19:14:42.036666 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.036647 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 19:14:42.036939 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.036852 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-216.ec2.internal.18c6d89f8a869bb0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-216.ec2.internal,UID:ip-10-0-132-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-216.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-216.ec2.internal,},FirstTimestamp:2026-07-29 19:14:42.03445752 +0000 UTC m=+0.399540259,LastTimestamp:2026-07-29 19:14:42.03445752 +0000 UTC m=+0.399540259,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-216.ec2.internal,}" Jul 29 19:14:42.037662 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.037651 2574 policy_none.go:47] "Start" Jul 29 19:14:42.046758 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.046690 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-216.ec2.internal.18c6d89f8a86e4cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-216.ec2.internal,UID:ip-10-0-132-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-216.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-216.ec2.internal,},FirstTimestamp:2026-07-29 19:14:42.034476236 +0000 UTC m=+0.399558972,LastTimestamp:2026-07-29 19:14:42.034476236 +0000 UTC m=+0.399558972,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-216.ec2.internal,}" Jul 29 19:14:42.060966 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.060884 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-216.ec2.internal.18c6d89f8a8709ce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-216.ec2.internal,UID:ip-10-0-132-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-216.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-216.ec2.internal,},FirstTimestamp:2026-07-29 19:14:42.03448571 +0000 UTC m=+0.399568442,LastTimestamp:2026-07-29 19:14:42.03448571 +0000 UTC m=+0.399568442,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-216.ec2.internal,}" Jul 29 19:14:42.064825 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.064804 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp2bn" Jul 29 19:14:42.070357 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.070291 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-216.ec2.internal.18c6d89f8a869bb0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-216.ec2.internal.18c6d89f8a869bb0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-216.ec2.internal,UID:ip-10-0-132-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-216.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-216.ec2.internal,},FirstTimestamp:2026-07-29 19:14:42.03445752 +0000 UTC m=+0.399540259,LastTimestamp:2026-07-29 19:14:42.035718908 +0000 UTC m=+0.400801641,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-216.ec2.internal,}" Jul 29 19:14:42.080064 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.080000 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-216.ec2.internal.18c6d89f8a86e4cc\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-216.ec2.internal.18c6d89f8a86e4cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-216.ec2.internal,UID:ip-10-0-132-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-216.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-216.ec2.internal,},FirstTimestamp:2026-07-29 19:14:42.034476236 +0000 UTC m=+0.399558972,LastTimestamp:2026-07-29 19:14:42.03573814 +0000 UTC m=+0.400820873,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-216.ec2.internal,}" Jul 29 19:14:42.081964 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.081949 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp2bn" Jul 29 19:14:42.082527 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.082513 2574 manager.go:337] "Starting Device Plugin manager" Jul 29 19:14:42.082596 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.082549 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 19:14:42.082596 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.082561 2574 server.go:87] "Starting device plugin registration server" Jul 29 19:14:42.082841 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.082814 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 19:14:42.082925 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.082830 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 19:14:42.083051 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.083032 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 19:14:42.083130 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.083114 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 19:14:42.083130 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.083126 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 19:14:42.084629 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.084609 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 19:14:42.084715 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.084653 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.100692 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.100664 2574 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2609 into the system container \"/system.slice\": " Jul 29 19:14:42.183152 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.183113 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:14:42.184324 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.184308 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:14:42.184382 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.184340 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:14:42.184382 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.184350 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:14:42.184382 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.184382 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.194430 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.194379 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.194430 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.194406 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-216.ec2.internal\": node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.203805 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.203771 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 19:14:42.205181 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.205161 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 19:14:42.205310 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.205206 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 19:14:42.205310 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.205228 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 19:14:42.205310 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.205262 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 19:14:42.207873 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.207852 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:14:42.228109 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.228085 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.305717 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.305681 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal"] Jul 29 19:14:42.305916 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.305772 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:14:42.306725 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.306710 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:14:42.306776 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.306738 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:14:42.306776 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.306748 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:14:42.308036 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.308024 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:14:42.308168 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.308148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.308211 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.308187 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:14:42.308737 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.308715 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:14:42.308737 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.308738 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:14:42.308865 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.308748 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:14:42.308865 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.308753 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:14:42.308865 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.308773 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:14:42.308865 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.308785 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:14:42.309980 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.309967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.310040 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.309991 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:14:42.310601 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.310584 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:14:42.310692 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.310607 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:14:42.310692 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.310620 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:14:42.318301 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.318286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab083a5f108842bdd2b691b291245170-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal\" (UID: \"ab083a5f108842bdd2b691b291245170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.318368 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.318308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab083a5f108842bdd2b691b291245170-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal\" (UID: \"ab083a5f108842bdd2b691b291245170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.318368 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.318326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb03f04c0c3ccf4f43dec4c1ab69f17f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-216.ec2.internal\" (UID: \"bb03f04c0c3ccf4f43dec4c1ab69f17f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.328667 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.328646 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.336512 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.336495 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-216.ec2.internal\" not found" node="ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.343506 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.343474 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-216.ec2.internal\" not found" node="ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.418980 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.418948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab083a5f108842bdd2b691b291245170-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal\" (UID: \"ab083a5f108842bdd2b691b291245170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.419119 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.418984 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab083a5f108842bdd2b691b291245170-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal\" (UID: \"ab083a5f108842bdd2b691b291245170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.419119 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.419011 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb03f04c0c3ccf4f43dec4c1ab69f17f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-216.ec2.internal\" (UID: \"bb03f04c0c3ccf4f43dec4c1ab69f17f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.419119 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.419050 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab083a5f108842bdd2b691b291245170-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal\" (UID: \"ab083a5f108842bdd2b691b291245170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.419119 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.419050 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab083a5f108842bdd2b691b291245170-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal\" (UID: \"ab083a5f108842bdd2b691b291245170\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.419119 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.419077 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb03f04c0c3ccf4f43dec4c1ab69f17f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-216.ec2.internal\" (UID: \"bb03f04c0c3ccf4f43dec4c1ab69f17f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.429250 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.429231 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.529568 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.529483 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.630125 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.630084 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.639281 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.639252 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.647041 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.647019 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.731065 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.731016 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.831581 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:42.831499 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-216.ec2.internal\" not found" Jul 29 19:14:42.872375 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.872346 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:14:42.916372 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.916341 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.936189 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.936167 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 19:14:42.937884 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.937869 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal" Jul 29 19:14:42.949657 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.949636 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 19:14:42.961730 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.961705 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 19:14:42.961944 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.961921 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 19:14:42.996098 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:42.996070 2574 apiserver.go:52] "Watching apiserver" Jul 29 19:14:43.006621 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.006593 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 19:14:43.006984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.006964 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-qltft","openshift-network-diagnostics/network-check-target-jjff7","kube-system/global-pull-secret-syncer-82wbd","kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal","openshift-dns/node-resolver-ztx54","openshift-image-registry/node-ca-c55n4","openshift-network-operator/iptables-alerter-wtcbz","openshift-ovn-kubernetes/ovnkube-node-25jbh","kube-system/konnectivity-agent-krmhr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n","openshift-cluster-node-tuning-operator/tuned-24j7m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal","openshift-multus/multus-additional-cni-plugins-tkvr5","openshift-multus/multus-pwdqr"] Jul 29 19:14:43.008491 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.008473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.009653 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.009635 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.010547 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.010529 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.011017 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.011002 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2krxk\"" Jul 29 19:14:43.011540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.011525 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 19:14:43.011577 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.011551 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 19:14:43.011659 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.011645 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.012147 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.012132 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 19:14:43.012593 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.012580 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 19:14:43.012684 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.012673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.013095 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.013082 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 19:14:43.013670 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.013649 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 19:14:43.013761 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.013649 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 19:14:43.013761 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.013718 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 19:14:43.013761 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.013718 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 19:14:43.013961 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.013946 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.014574 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.014555 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-54ppz\"" Jul 29 19:14:43.014660 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.014555 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p96wx\"" Jul 29 19:14:43.015229 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.015216 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:14:43.015396 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.015380 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 19:14:43.016049 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.016035 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 19:14:43.016549 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.016534 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.017541 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.017526 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:43.017627 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.017591 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:14:43.018588 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.018571 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 19:14:43.018664 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.018573 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 19:14:43.018707 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.018671 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:43.018749 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.018721 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:14:43.019703 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.019684 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 19:14:43.019703 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.019697 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 19:14:43.020222 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.020199 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gd8v8\"" Jul 29 19:14:43.020314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.020235 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 19:14:43.020314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.020261 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 19:14:43.020314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.020283 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 19:14:43.020461 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.020422 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.022581 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.022386 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.022581 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.022451 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:14:43.022964 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.022947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/930d691e-e115-44f2-b81f-a9fa11919dc7-cni-binary-copy\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.023012 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.022975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.023012 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.022992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-run-netns\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023097 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-run-ovn\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023097 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-node-log\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023097 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2f87\" (UniqueName: \"kubernetes.io/projected/e867f183-9aaf-4af0-a5b5-b851debd1a7b-kube-api-access-j2f87\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.023206 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023139 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-cnibin\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.023206 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-var-lib-cni-multus\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.023206 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023201 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-systemd-units\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023336 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-system-cni-dir\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.023336 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f16995de-af89-44c3-8d9d-d5bbfec8dd14-ovnkube-config\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023336 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkqfg\" (UniqueName: \"kubernetes.io/projected/967e4490-1fbc-4b8b-8084-64bedcc3e271-kube-api-access-gkqfg\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.023336 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023292 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksl7l\" (UniqueName: \"kubernetes.io/projected/930d691e-e115-44f2-b81f-a9fa11919dc7-kube-api-access-ksl7l\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.023336 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-os-release\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.023501 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023344 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-log-socket\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023501 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-run-multus-certs\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.023501 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f16995de-af89-44c3-8d9d-d5bbfec8dd14-ovn-node-metrics-cert\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023501 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-cnibin\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.023501 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-cni-bin\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023501 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf021cd7-f744-4799-a0ed-b4764655efe6-host\") pod \"node-ca-c55n4\" (UID: \"cf021cd7-f744-4799-a0ed-b4764655efe6\") " pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.023501 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023513 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w7kz\" (UniqueName: \"kubernetes.io/projected/f270df64-ac28-4aaf-a05e-5311e2b5830b-kube-api-access-9w7kz\") pod \"iptables-alerter-wtcbz\" (UID: \"f270df64-ac28-4aaf-a05e-5311e2b5830b\") " pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f16995de-af89-44c3-8d9d-d5bbfec8dd14-env-overrides\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6415fb6e-0760-451f-9e00-778546bcda01-hosts-file\") pod \"node-resolver-ztx54\" (UID: \"6415fb6e-0760-451f-9e00-778546bcda01\") " pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-socket-dir-parent\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-run-k8s-cni-cncf-io\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023640 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-etc-kubernetes\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-run-ovn-kubernetes\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/930d691e-e115-44f2-b81f-a9fa11919dc7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023721 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-etc-openvswitch\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.023755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf021cd7-f744-4799-a0ed-b4764655efe6-serviceca\") pod \"node-ca-c55n4\" (UID: \"cf021cd7-f744-4799-a0ed-b4764655efe6\") " pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-run-systemd\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-run-openvswitch\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-socket-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023835 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-os-release\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023865 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f16995de-af89-44c3-8d9d-d5bbfec8dd14-ovnkube-script-lib\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023912 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flchb\" (UniqueName: \"kubernetes.io/projected/f16995de-af89-44c3-8d9d-d5bbfec8dd14-kube-api-access-flchb\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/930d691e-e115-44f2-b81f-a9fa11919dc7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f270df64-ac28-4aaf-a05e-5311e2b5830b-iptables-alerter-script\") pod \"iptables-alerter-wtcbz\" (UID: \"f270df64-ac28-4aaf-a05e-5311e2b5830b\") " pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f270df64-ac28-4aaf-a05e-5311e2b5830b-host-slash\") pod \"iptables-alerter-wtcbz\" (UID: \"f270df64-ac28-4aaf-a05e-5311e2b5830b\") " pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.023989 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-device-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-conf-dir\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-kubelet\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.024055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-cni-netd\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6415fb6e-0760-451f-9e00-778546bcda01-tmp-dir\") pod \"node-resolver-ztx54\" (UID: \"6415fb6e-0760-451f-9e00-778546bcda01\") " pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-registration-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-sys-fs\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-cni-dir\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967e4490-1fbc-4b8b-8084-64bedcc3e271-cni-binary-copy\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-run-netns\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-hostroot\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/939b0a59-b0e6-4a5b-bc41-2421e6d8d615-konnectivity-ca\") pod \"konnectivity-agent-krmhr\" (UID: \"939b0a59-b0e6-4a5b-bc41-2421e6d8d615\") " pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-system-cni-dir\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-var-lib-kubelet\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-daemon-config\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-slash\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-var-lib-openvswitch\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024292 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024311 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-var-lib-cni-bin\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.024452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024332 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9pkf\" (UniqueName: \"kubernetes.io/projected/6415fb6e-0760-451f-9e00-778546bcda01-kube-api-access-f9pkf\") pod \"node-resolver-ztx54\" (UID: \"6415fb6e-0760-451f-9e00-778546bcda01\") " pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.025007 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxtct\" (UniqueName: \"kubernetes.io/projected/cf021cd7-f744-4799-a0ed-b4764655efe6-kube-api-access-lxtct\") pod \"node-ca-c55n4\" (UID: \"cf021cd7-f744-4799-a0ed-b4764655efe6\") " pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.025007 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.024362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/939b0a59-b0e6-4a5b-bc41-2421e6d8d615-agent-certs\") pod \"konnectivity-agent-krmhr\" (UID: \"939b0a59-b0e6-4a5b-bc41-2421e6d8d615\") " pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:14:43.026254 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.026231 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 19:14:43.026333 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.026263 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 19:14:43.026333 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.026306 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 19:14:43.026436 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.026339 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 19:14:43.026436 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.026234 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d26nr\"" Jul 29 19:14:43.026436 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.026428 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:14:43.027505 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.027486 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8l258\"" Jul 29 19:14:43.027505 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.027500 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 19:14:43.027642 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.027534 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jrqxl\"" Jul 29 19:14:43.027642 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.027538 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 19:14:43.027642 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.027492 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c5rtv\"" Jul 29 19:14:43.027642 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.027613 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 19:14:43.034355 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.034330 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:14:43.034355 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.034342 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 19:14:43.034478 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.034357 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gckgz\"" Jul 29 19:14:43.047618 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.047599 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 19:14:43.070161 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.070136 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wsc4g" Jul 29 19:14:43.081000 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.080924 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wsc4g" Jul 29 19:14:43.086443 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.086405 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 19:09:42 +0000 UTC" deadline="2028-04-16 23:38:35.832395844 +0000 UTC" Jul 29 19:14:43.086443 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.086442 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15052h23m52.745956827s" Jul 29 19:14:43.117452 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.117432 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 19:14:43.124897 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.124867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksl7l\" (UniqueName: \"kubernetes.io/projected/930d691e-e115-44f2-b81f-a9fa11919dc7-kube-api-access-ksl7l\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.124976 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.124909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-os-release\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.124976 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.124927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-log-socket\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.124976 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.124943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-run-multus-certs\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.124976 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.124962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f16995de-af89-44c3-8d9d-d5bbfec8dd14-ovn-node-metrics-cert\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.124976 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.124977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-cnibin\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.124993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-cni-bin\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf021cd7-f744-4799-a0ed-b4764655efe6-host\") pod \"node-ca-c55n4\" (UID: \"cf021cd7-f744-4799-a0ed-b4764655efe6\") " pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125049 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-log-socket\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125086 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-run-multus-certs\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125091 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-cni-bin\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w7kz\" (UniqueName: \"kubernetes.io/projected/f270df64-ac28-4aaf-a05e-5311e2b5830b-kube-api-access-9w7kz\") pod \"iptables-alerter-wtcbz\" (UID: \"f270df64-ac28-4aaf-a05e-5311e2b5830b\") " pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125090 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-os-release\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125118 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf021cd7-f744-4799-a0ed-b4764655efe6-host\") pod \"node-ca-c55n4\" (UID: \"cf021cd7-f744-4799-a0ed-b4764655efe6\") " pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f16995de-af89-44c3-8d9d-d5bbfec8dd14-env-overrides\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125160 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6415fb6e-0760-451f-9e00-778546bcda01-hosts-file\") pod \"node-resolver-ztx54\" (UID: \"6415fb6e-0760-451f-9e00-778546bcda01\") " pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125135 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-cnibin\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.125213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125191 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125229 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6415fb6e-0760-451f-9e00-778546bcda01-hosts-file\") pod \"node-resolver-ztx54\" (UID: \"6415fb6e-0760-451f-9e00-778546bcda01\") " pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-run\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-socket-dir-parent\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125358 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-run-k8s-cni-cncf-io\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125419 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-socket-dir-parent\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-etc-kubernetes\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125549 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-etc-kubernetes\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.125727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125668 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-run-ovn-kubernetes\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126095 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125808 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f16995de-af89-44c3-8d9d-d5bbfec8dd14-env-overrides\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126095 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125392 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-run-k8s-cni-cncf-io\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.126095 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.125516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-run-ovn-kubernetes\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-kubernetes\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.126197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-systemd\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.126197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-var-lib-kubelet\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.126197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/930d691e-e115-44f2-b81f-a9fa11919dc7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.126377 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-etc-openvswitch\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126377 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126326 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-etc-openvswitch\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126377 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf021cd7-f744-4799-a0ed-b4764655efe6-serviceca\") pod \"node-ca-c55n4\" (UID: \"cf021cd7-f744-4799-a0ed-b4764655efe6\") " pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.126523 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-sysconfig\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.126523 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-tuned\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.126523 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/840bbe93-ede4-4686-a1e7-1448b0e9b794-tmp\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.126523 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d6e0bc83-0390-42b7-8eae-4123ab6713b1-dbus\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.126713 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-run-systemd\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126713 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-run-openvswitch\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126713 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-socket-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.126713 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-modprobe-d\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.126713 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126704 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-run-openvswitch\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126758 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/930d691e-e115-44f2-b81f-a9fa11919dc7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-os-release\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126805 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-socket-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f16995de-af89-44c3-8d9d-d5bbfec8dd14-ovnkube-script-lib\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126677 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-run-systemd\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126837 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-os-release\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flchb\" (UniqueName: \"kubernetes.io/projected/f16995de-af89-44c3-8d9d-d5bbfec8dd14-kube-api-access-flchb\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126875 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf021cd7-f744-4799-a0ed-b4764655efe6-serviceca\") pod \"node-ca-c55n4\" (UID: \"cf021cd7-f744-4799-a0ed-b4764655efe6\") " pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-host\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/930d691e-e115-44f2-b81f-a9fa11919dc7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126956 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f270df64-ac28-4aaf-a05e-5311e2b5830b-iptables-alerter-script\") pod \"iptables-alerter-wtcbz\" (UID: \"f270df64-ac28-4aaf-a05e-5311e2b5830b\") " pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.126984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f270df64-ac28-4aaf-a05e-5311e2b5830b-host-slash\") pod \"iptables-alerter-wtcbz\" (UID: \"f270df64-ac28-4aaf-a05e-5311e2b5830b\") " pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.127439 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.126991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.127439 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-device-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.127439 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d6e0bc83-0390-42b7-8eae-4123ab6713b1-kubelet-config\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.127439 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-conf-dir\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127715 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-kubelet\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127739 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127795 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-conf-dir\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-kubelet\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-cni-netd\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6415fb6e-0760-451f-9e00-778546bcda01-tmp-dir\") pod \"node-resolver-ztx54\" (UID: \"6415fb6e-0760-451f-9e00-778546bcda01\") " pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.127997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-registration-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-sys-fs\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-cni-dir\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128121 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/930d691e-e115-44f2-b81f-a9fa11919dc7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128129 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-cni-netd\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128127 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-device-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128181 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f270df64-ac28-4aaf-a05e-5311e2b5830b-host-slash\") pod \"iptables-alerter-wtcbz\" (UID: \"f270df64-ac28-4aaf-a05e-5311e2b5830b\") " pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128225 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-cni-dir\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128243 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f16995de-af89-44c3-8d9d-d5bbfec8dd14-ovnkube-script-lib\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128248 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-registration-dir\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.128586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128265 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967e4490-1fbc-4b8b-8084-64bedcc3e271-cni-binary-copy\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128309 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-sys-fs\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-run-netns\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128391 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-run-netns\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128417 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6415fb6e-0760-451f-9e00-778546bcda01-tmp-dir\") pod \"node-resolver-ztx54\" (UID: \"6415fb6e-0760-451f-9e00-778546bcda01\") " pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-hostroot\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128450 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f270df64-ac28-4aaf-a05e-5311e2b5830b-iptables-alerter-script\") pod \"iptables-alerter-wtcbz\" (UID: \"f270df64-ac28-4aaf-a05e-5311e2b5830b\") " pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/939b0a59-b0e6-4a5b-bc41-2421e6d8d615-konnectivity-ca\") pod \"konnectivity-agent-krmhr\" (UID: \"939b0a59-b0e6-4a5b-bc41-2421e6d8d615\") " pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-sys\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128539 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-hostroot\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-system-cni-dir\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-var-lib-kubelet\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128662 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-daemon-config\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-slash\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128746 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-system-cni-dir\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-var-lib-openvswitch\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128796 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967e4490-1fbc-4b8b-8084-64bedcc3e271-cni-binary-copy\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.129458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-var-lib-cni-bin\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128858 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-slash\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128874 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9pkf\" (UniqueName: \"kubernetes.io/projected/6415fb6e-0760-451f-9e00-778546bcda01-kube-api-access-f9pkf\") pod \"node-resolver-ztx54\" (UID: \"6415fb6e-0760-451f-9e00-778546bcda01\") " pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128919 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-var-lib-kubelet\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxtct\" (UniqueName: \"kubernetes.io/projected/cf021cd7-f744-4799-a0ed-b4764655efe6-kube-api-access-lxtct\") pod \"node-ca-c55n4\" (UID: \"cf021cd7-f744-4799-a0ed-b4764655efe6\") " pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.128965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/939b0a59-b0e6-4a5b-bc41-2421e6d8d615-agent-certs\") pod \"konnectivity-agent-krmhr\" (UID: \"939b0a59-b0e6-4a5b-bc41-2421e6d8d615\") " pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-sysctl-d\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtj6f\" (UniqueName: \"kubernetes.io/projected/840bbe93-ede4-4686-a1e7-1448b0e9b794-kube-api-access-wtj6f\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129048 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-var-lib-openvswitch\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/930d691e-e115-44f2-b81f-a9fa11919dc7-cni-binary-copy\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129140 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/939b0a59-b0e6-4a5b-bc41-2421e6d8d615-konnectivity-ca\") pod \"konnectivity-agent-krmhr\" (UID: \"939b0a59-b0e6-4a5b-bc41-2421e6d8d615\") " pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129001 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e867f183-9aaf-4af0-a5b5-b851debd1a7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129236 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f16995de-af89-44c3-8d9d-d5bbfec8dd14-ovn-node-metrics-cert\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129239 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-var-lib-cni-bin\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129266 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/967e4490-1fbc-4b8b-8084-64bedcc3e271-multus-daemon-config\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.130540 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-run-netns\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-run-ovn\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-node-log\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2f87\" (UniqueName: \"kubernetes.io/projected/e867f183-9aaf-4af0-a5b5-b851debd1a7b-kube-api-access-j2f87\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129500 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dksf\" (UniqueName: \"kubernetes.io/projected/36553e39-8d4d-4d1e-a229-a6a76954d530-kube-api-access-9dksf\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129504 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-host-run-netns\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-cnibin\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-var-lib-cni-multus\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129564 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/930d691e-e115-44f2-b81f-a9fa11919dc7-cni-binary-copy\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-systemd-units\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129643 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-node-log\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129654 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-systemd-units\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f16995de-af89-44c3-8d9d-d5bbfec8dd14-run-ovn\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129678 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/930d691e-e115-44f2-b81f-a9fa11919dc7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-sysctl-conf\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129711 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-host-var-lib-cni-multus\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-lib-modules\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.131433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-system-cni-dir\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.132165 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f16995de-af89-44c3-8d9d-d5bbfec8dd14-ovnkube-config\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.132165 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkqfg\" (UniqueName: \"kubernetes.io/projected/967e4490-1fbc-4b8b-8084-64bedcc3e271-kube-api-access-gkqfg\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.132165 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129883 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-cnibin\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.132165 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.129988 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967e4490-1fbc-4b8b-8084-64bedcc3e271-system-cni-dir\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.132165 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.130384 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f16995de-af89-44c3-8d9d-d5bbfec8dd14-ovnkube-config\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.132165 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.131836 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/939b0a59-b0e6-4a5b-bc41-2421e6d8d615-agent-certs\") pod \"konnectivity-agent-krmhr\" (UID: \"939b0a59-b0e6-4a5b-bc41-2421e6d8d615\") " pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:14:43.135507 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.135489 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksl7l\" (UniqueName: \"kubernetes.io/projected/930d691e-e115-44f2-b81f-a9fa11919dc7-kube-api-access-ksl7l\") pod \"multus-additional-cni-plugins-tkvr5\" (UID: \"930d691e-e115-44f2-b81f-a9fa11919dc7\") " pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.139753 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.139730 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flchb\" (UniqueName: \"kubernetes.io/projected/f16995de-af89-44c3-8d9d-d5bbfec8dd14-kube-api-access-flchb\") pod \"ovnkube-node-25jbh\" (UID: \"f16995de-af89-44c3-8d9d-d5bbfec8dd14\") " pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.139863 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.139764 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxtct\" (UniqueName: \"kubernetes.io/projected/cf021cd7-f744-4799-a0ed-b4764655efe6-kube-api-access-lxtct\") pod \"node-ca-c55n4\" (UID: \"cf021cd7-f744-4799-a0ed-b4764655efe6\") " pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.139863 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.139794 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w7kz\" (UniqueName: \"kubernetes.io/projected/f270df64-ac28-4aaf-a05e-5311e2b5830b-kube-api-access-9w7kz\") pod \"iptables-alerter-wtcbz\" (UID: \"f270df64-ac28-4aaf-a05e-5311e2b5830b\") " pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.142532 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.142503 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2f87\" (UniqueName: \"kubernetes.io/projected/e867f183-9aaf-4af0-a5b5-b851debd1a7b-kube-api-access-j2f87\") pod \"aws-ebs-csi-driver-node-z8d7n\" (UID: \"e867f183-9aaf-4af0-a5b5-b851debd1a7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.142607 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.142531 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9pkf\" (UniqueName: \"kubernetes.io/projected/6415fb6e-0760-451f-9e00-778546bcda01-kube-api-access-f9pkf\") pod \"node-resolver-ztx54\" (UID: \"6415fb6e-0760-451f-9e00-778546bcda01\") " pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.143429 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.143411 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkqfg\" (UniqueName: \"kubernetes.io/projected/967e4490-1fbc-4b8b-8084-64bedcc3e271-kube-api-access-gkqfg\") pod \"multus-pwdqr\" (UID: \"967e4490-1fbc-4b8b-8084-64bedcc3e271\") " pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.159476 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.159458 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:14:43.177125 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.177101 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wtcbz" Jul 29 19:14:43.215198 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.215158 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab083a5f108842bdd2b691b291245170.slice/crio-580f5157de54daead9592ca384ec7884ca2e12271715261fa02dfd1cc8020f5f WatchSource:0}: Error finding container 580f5157de54daead9592ca384ec7884ca2e12271715261fa02dfd1cc8020f5f: Status 404 returned error can't find the container with id 580f5157de54daead9592ca384ec7884ca2e12271715261fa02dfd1cc8020f5f Jul 29 19:14:43.215711 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.215686 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf270df64_ac28_4aaf_a05e_5311e2b5830b.slice/crio-fc3faf9ef30345e5a025bb3d4e40892c601df370f34d02391ec6416ccd567a63 WatchSource:0}: Error finding container fc3faf9ef30345e5a025bb3d4e40892c601df370f34d02391ec6416ccd567a63: Status 404 returned error can't find the container with id fc3faf9ef30345e5a025bb3d4e40892c601df370f34d02391ec6416ccd567a63 Jul 29 19:14:43.221733 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.221720 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 19:14:43.230519 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-sys\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.230614 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-sysctl-d\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.230614 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtj6f\" (UniqueName: \"kubernetes.io/projected/840bbe93-ede4-4686-a1e7-1448b0e9b794-kube-api-access-wtj6f\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.230614 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230600 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-sys\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.230761 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230704 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-sysctl-d\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.230761 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:43.230761 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dksf\" (UniqueName: \"kubernetes.io/projected/36553e39-8d4d-4d1e-a229-a6a76954d530-kube-api-access-9dksf\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:43.230931 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230787 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-sysctl-conf\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.230931 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.230802 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:43.230931 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-lib-modules\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.230931 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.230877 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs podName:36553e39-8d4d-4d1e-a229-a6a76954d530 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:43.730857247 +0000 UTC m=+2.095939987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs") pod "network-metrics-daemon-qltft" (UID: "36553e39-8d4d-4d1e-a229-a6a76954d530") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230930 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-sysctl-conf\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230966 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-lib-modules\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.230974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-run\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-kubernetes\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-systemd\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-var-lib-kubelet\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231057 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-kubernetes\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231044 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-run\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-sysconfig\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231090 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-systemd\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231112 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-var-lib-kubelet\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231139 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-sysconfig\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231149 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-tuned\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/840bbe93-ede4-4686-a1e7-1448b0e9b794-tmp\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231201 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d6e0bc83-0390-42b7-8eae-4123ab6713b1-dbus\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-modprobe-d\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231281 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-host\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231315 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-modprobe-d\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231320 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d6e0bc83-0390-42b7-8eae-4123ab6713b1-dbus\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d6e0bc83-0390-42b7-8eae-4123ab6713b1-kubelet-config\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231366 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840bbe93-ede4-4686-a1e7-1448b0e9b794-host\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.231395 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.231429 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret podName:d6e0bc83-0390-42b7-8eae-4123ab6713b1 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:43.731418359 +0000 UTC m=+2.096501078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret") pod "global-pull-secret-syncer-82wbd" (UID: "d6e0bc83-0390-42b7-8eae-4123ab6713b1") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:43.231681 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.231370 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d6e0bc83-0390-42b7-8eae-4123ab6713b1-kubelet-config\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.233315 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.233300 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/840bbe93-ede4-4686-a1e7-1448b0e9b794-tmp\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.233358 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.233337 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/840bbe93-ede4-4686-a1e7-1448b0e9b794-etc-tuned\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.241765 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.241747 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtj6f\" (UniqueName: \"kubernetes.io/projected/840bbe93-ede4-4686-a1e7-1448b0e9b794-kube-api-access-wtj6f\") pod \"tuned-24j7m\" (UID: \"840bbe93-ede4-4686-a1e7-1448b0e9b794\") " pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.242438 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.242423 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:14:43.242548 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.242444 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:14:43.242548 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.242456 2574 projected.go:196] Error preparing data for projected volume kube-api-access-22csf for pod openshift-network-diagnostics/network-check-target-jjff7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:43.242548 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.242520 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf podName:c5cf409f-4504-45fb-a6e8-17f93defa81c nodeName:}" failed. No retries permitted until 2026-07-29 19:14:43.74250421 +0000 UTC m=+2.107586944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-22csf" (UniqueName: "kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf") pod "network-check-target-jjff7" (UID: "c5cf409f-4504-45fb-a6e8-17f93defa81c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:43.244752 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.244735 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dksf\" (UniqueName: \"kubernetes.io/projected/36553e39-8d4d-4d1e-a229-a6a76954d530-kube-api-access-9dksf\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:43.347055 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.346974 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" Jul 29 19:14:43.356923 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.356883 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode867f183_9aaf_4af0_a5b5_b851debd1a7b.slice/crio-471ab921268a0ec0ad391d7e1ad1bec93527f07c642b1a1aba2c6321ffc5f922 WatchSource:0}: Error finding container 471ab921268a0ec0ad391d7e1ad1bec93527f07c642b1a1aba2c6321ffc5f922: Status 404 returned error can't find the container with id 471ab921268a0ec0ad391d7e1ad1bec93527f07c642b1a1aba2c6321ffc5f922 Jul 29 19:14:43.364404 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.364384 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" Jul 29 19:14:43.367697 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.367680 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:14:43.372431 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.372409 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod930d691e_e115_44f2_b81f_a9fa11919dc7.slice/crio-c5a86dee2c99cce921aaed187870ccfb59cfa85be331c8b1944bdd2f1e5c47f6 WatchSource:0}: Error finding container c5a86dee2c99cce921aaed187870ccfb59cfa85be331c8b1944bdd2f1e5c47f6: Status 404 returned error can't find the container with id c5a86dee2c99cce921aaed187870ccfb59cfa85be331c8b1944bdd2f1e5c47f6 Jul 29 19:14:43.382481 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.382466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pwdqr" Jul 29 19:14:43.390666 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.390642 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967e4490_1fbc_4b8b_8084_64bedcc3e271.slice/crio-40c5c155b11722f72f0ca42f4f7b2226e14de0e9946b40aa15243d345e0b9f71 WatchSource:0}: Error finding container 40c5c155b11722f72f0ca42f4f7b2226e14de0e9946b40aa15243d345e0b9f71: Status 404 returned error can't find the container with id 40c5c155b11722f72f0ca42f4f7b2226e14de0e9946b40aa15243d345e0b9f71 Jul 29 19:14:43.396723 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.396700 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:14:43.404722 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.404703 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16995de_af89_44c3_8d9d_d5bbfec8dd14.slice/crio-33c07fd0410e65c31ca0a074c5170773a6487f13963d68407ccd53158f299cac WatchSource:0}: Error finding container 33c07fd0410e65c31ca0a074c5170773a6487f13963d68407ccd53158f299cac: Status 404 returned error can't find the container with id 33c07fd0410e65c31ca0a074c5170773a6487f13963d68407ccd53158f299cac Jul 29 19:14:43.409594 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.409573 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ztx54" Jul 29 19:14:43.417358 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.417337 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6415fb6e_0760_451f_9e00_778546bcda01.slice/crio-6b6d8e836d56ae323c2361fc32d8547061be1562913f41aa25e8c936261d2d82 WatchSource:0}: Error finding container 6b6d8e836d56ae323c2361fc32d8547061be1562913f41aa25e8c936261d2d82: Status 404 returned error can't find the container with id 6b6d8e836d56ae323c2361fc32d8547061be1562913f41aa25e8c936261d2d82 Jul 29 19:14:43.437555 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.437530 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c55n4" Jul 29 19:14:43.446763 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.446742 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf021cd7_f744_4799_a0ed_b4764655efe6.slice/crio-0a8ac8021b1ff1dcd7a65ee6e28ba8a58b9889510b64a46ebba42c7d688a3a57 WatchSource:0}: Error finding container 0a8ac8021b1ff1dcd7a65ee6e28ba8a58b9889510b64a46ebba42c7d688a3a57: Status 404 returned error can't find the container with id 0a8ac8021b1ff1dcd7a65ee6e28ba8a58b9889510b64a46ebba42c7d688a3a57 Jul 29 19:14:43.483003 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.482974 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24j7m" Jul 29 19:14:43.496207 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.496183 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840bbe93_ede4_4686_a1e7_1448b0e9b794.slice/crio-f70db2dbea0790a61a30a1158f545e2efe4bf2eb967acee5957ee87430758b5a WatchSource:0}: Error finding container f70db2dbea0790a61a30a1158f545e2efe4bf2eb967acee5957ee87430758b5a: Status 404 returned error can't find the container with id f70db2dbea0790a61a30a1158f545e2efe4bf2eb967acee5957ee87430758b5a Jul 29 19:14:43.496859 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:14:43.496828 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb03f04c0c3ccf4f43dec4c1ab69f17f.slice/crio-77dd30295d6ebada97b02e8b9b40dbbb618cd5ed6dcf6d1005a96df41ff16033 WatchSource:0}: Error finding container 77dd30295d6ebada97b02e8b9b40dbbb618cd5ed6dcf6d1005a96df41ff16033: Status 404 returned error can't find the container with id 77dd30295d6ebada97b02e8b9b40dbbb618cd5ed6dcf6d1005a96df41ff16033 Jul 29 19:14:43.530307 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.530276 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:14:43.735837 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.735757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:43.735837 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.735822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:43.736071 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.735951 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:43.736071 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.735954 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:43.736071 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.736023 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret podName:d6e0bc83-0390-42b7-8eae-4123ab6713b1 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:44.736003163 +0000 UTC m=+3.101085897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret") pod "global-pull-secret-syncer-82wbd" (UID: "d6e0bc83-0390-42b7-8eae-4123ab6713b1") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:43.736071 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.736043 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs podName:36553e39-8d4d-4d1e-a229-a6a76954d530 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:44.736032987 +0000 UTC m=+3.101115708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs") pod "network-metrics-daemon-qltft" (UID: "36553e39-8d4d-4d1e-a229-a6a76954d530") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:43.836619 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.836568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:43.836784 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.836752 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:14:43.836784 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.836774 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:14:43.836909 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.836787 2574 projected.go:196] Error preparing data for projected volume kube-api-access-22csf for pod openshift-network-diagnostics/network-check-target-jjff7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:43.836909 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:43.836851 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf podName:c5cf409f-4504-45fb-a6e8-17f93defa81c nodeName:}" failed. No retries permitted until 2026-07-29 19:14:44.83683137 +0000 UTC m=+3.201914110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-22csf" (UniqueName: "kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf") pod "network-check-target-jjff7" (UID: "c5cf409f-4504-45fb-a6e8-17f93defa81c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:43.899062 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:43.899020 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:14:44.084556 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.084420 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:09:43 +0000 UTC" deadline="2028-02-29 20:17:49.927507292 +0000 UTC" Jul 29 19:14:44.084556 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.084494 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13921h3m5.843018358s" Jul 29 19:14:44.206691 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.206654 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:44.206892 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.206804 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:14:44.207358 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.207337 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:44.207495 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.207460 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:14:44.216098 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.215985 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krmhr" event={"ID":"939b0a59-b0e6-4a5b-bc41-2421e6d8d615","Type":"ContainerStarted","Data":"abd135862eb294cd44e80a86717f4b5152e7d38b3dcc35efe431ca7252bcc3c9"} Jul 29 19:14:44.225353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.225158 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal" event={"ID":"bb03f04c0c3ccf4f43dec4c1ab69f17f","Type":"ContainerStarted","Data":"77dd30295d6ebada97b02e8b9b40dbbb618cd5ed6dcf6d1005a96df41ff16033"} Jul 29 19:14:44.230296 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.230177 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" event={"ID":"f16995de-af89-44c3-8d9d-d5bbfec8dd14","Type":"ContainerStarted","Data":"33c07fd0410e65c31ca0a074c5170773a6487f13963d68407ccd53158f299cac"} Jul 29 19:14:44.235272 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.235191 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" event={"ID":"930d691e-e115-44f2-b81f-a9fa11919dc7","Type":"ContainerStarted","Data":"c5a86dee2c99cce921aaed187870ccfb59cfa85be331c8b1944bdd2f1e5c47f6"} Jul 29 19:14:44.238005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.237915 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" event={"ID":"ab083a5f108842bdd2b691b291245170","Type":"ContainerStarted","Data":"580f5157de54daead9592ca384ec7884ca2e12271715261fa02dfd1cc8020f5f"} Jul 29 19:14:44.242729 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.242702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24j7m" event={"ID":"840bbe93-ede4-4686-a1e7-1448b0e9b794","Type":"ContainerStarted","Data":"f70db2dbea0790a61a30a1158f545e2efe4bf2eb967acee5957ee87430758b5a"} Jul 29 19:14:44.244299 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.244273 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c55n4" event={"ID":"cf021cd7-f744-4799-a0ed-b4764655efe6","Type":"ContainerStarted","Data":"0a8ac8021b1ff1dcd7a65ee6e28ba8a58b9889510b64a46ebba42c7d688a3a57"} Jul 29 19:14:44.245940 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.245913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ztx54" event={"ID":"6415fb6e-0760-451f-9e00-778546bcda01","Type":"ContainerStarted","Data":"6b6d8e836d56ae323c2361fc32d8547061be1562913f41aa25e8c936261d2d82"} Jul 29 19:14:44.248145 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.248119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pwdqr" event={"ID":"967e4490-1fbc-4b8b-8084-64bedcc3e271","Type":"ContainerStarted","Data":"40c5c155b11722f72f0ca42f4f7b2226e14de0e9946b40aa15243d345e0b9f71"} Jul 29 19:14:44.250251 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.250226 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" event={"ID":"e867f183-9aaf-4af0-a5b5-b851debd1a7b","Type":"ContainerStarted","Data":"471ab921268a0ec0ad391d7e1ad1bec93527f07c642b1a1aba2c6321ffc5f922"} Jul 29 19:14:44.252596 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.252573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wtcbz" event={"ID":"f270df64-ac28-4aaf-a05e-5311e2b5830b","Type":"ContainerStarted","Data":"fc3faf9ef30345e5a025bb3d4e40892c601df370f34d02391ec6416ccd567a63"} Jul 29 19:14:44.744815 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.744772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:44.745056 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.744877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:44.745056 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.745046 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:44.745190 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.745114 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs podName:36553e39-8d4d-4d1e-a229-a6a76954d530 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:46.745093201 +0000 UTC m=+5.110175950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs") pod "network-metrics-daemon-qltft" (UID: "36553e39-8d4d-4d1e-a229-a6a76954d530") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:44.745570 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.745549 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:44.745646 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.745609 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret podName:d6e0bc83-0390-42b7-8eae-4123ab6713b1 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:46.745593141 +0000 UTC m=+5.110675879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret") pod "global-pull-secret-syncer-82wbd" (UID: "d6e0bc83-0390-42b7-8eae-4123ab6713b1") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:44.846112 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:44.846070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:44.846347 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.846323 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:14:44.846347 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.846344 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:14:44.846466 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.846358 2574 projected.go:196] Error preparing data for projected volume kube-api-access-22csf for pod openshift-network-diagnostics/network-check-target-jjff7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:44.846523 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:44.846508 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf podName:c5cf409f-4504-45fb-a6e8-17f93defa81c nodeName:}" failed. No retries permitted until 2026-07-29 19:14:46.846488481 +0000 UTC m=+5.211571218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-22csf" (UniqueName: "kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf") pod "network-check-target-jjff7" (UID: "c5cf409f-4504-45fb-a6e8-17f93defa81c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:45.085475 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:45.085375 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:09:43 +0000 UTC" deadline="2028-03-02 13:07:12.046472588 +0000 UTC" Jul 29 19:14:45.085475 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:45.085426 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13961h52m26.961051901s" Jul 29 19:14:45.205957 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:45.205815 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:45.206161 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:45.205967 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:14:46.205979 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:46.205840 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:46.206473 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.206008 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:14:46.206473 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:46.205840 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:46.206592 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.206533 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:14:46.763736 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:46.763692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:46.764003 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:46.763778 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:46.764003 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.763961 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:46.764166 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.764034 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs podName:36553e39-8d4d-4d1e-a229-a6a76954d530 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:50.764011135 +0000 UTC m=+9.129093883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs") pod "network-metrics-daemon-qltft" (UID: "36553e39-8d4d-4d1e-a229-a6a76954d530") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:46.764466 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.764443 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:46.764558 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.764537 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret podName:d6e0bc83-0390-42b7-8eae-4123ab6713b1 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:50.764521561 +0000 UTC m=+9.129604301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret") pod "global-pull-secret-syncer-82wbd" (UID: "d6e0bc83-0390-42b7-8eae-4123ab6713b1") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:46.866007 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:46.865292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:46.866007 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.865499 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:14:46.866007 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.865524 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:14:46.866007 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.865537 2574 projected.go:196] Error preparing data for projected volume kube-api-access-22csf for pod openshift-network-diagnostics/network-check-target-jjff7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:46.866007 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:46.865603 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf podName:c5cf409f-4504-45fb-a6e8-17f93defa81c nodeName:}" failed. No retries permitted until 2026-07-29 19:14:50.865584227 +0000 UTC m=+9.230666973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-22csf" (UniqueName: "kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf") pod "network-check-target-jjff7" (UID: "c5cf409f-4504-45fb-a6e8-17f93defa81c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:47.205785 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:47.205698 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:47.205944 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:47.205838 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:14:48.208409 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:48.208374 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:48.208911 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:48.208540 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:14:48.209029 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:48.208918 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:48.209095 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:48.209039 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:14:49.205547 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:49.205513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:49.205719 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:49.205639 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:14:50.206422 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:50.206388 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:50.206422 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:50.206411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:50.206968 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.206533 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:14:50.206968 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.206676 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:14:50.800222 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:50.800185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:50.800403 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:50.800242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:50.800403 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.800355 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:50.800513 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.800413 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs podName:36553e39-8d4d-4d1e-a229-a6a76954d530 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:58.800396993 +0000 UTC m=+17.165479712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs") pod "network-metrics-daemon-qltft" (UID: "36553e39-8d4d-4d1e-a229-a6a76954d530") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:50.800746 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.800730 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:50.800828 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.800774 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret podName:d6e0bc83-0390-42b7-8eae-4123ab6713b1 nodeName:}" failed. No retries permitted until 2026-07-29 19:14:58.800761703 +0000 UTC m=+17.165844423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret") pod "global-pull-secret-syncer-82wbd" (UID: "d6e0bc83-0390-42b7-8eae-4123ab6713b1") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:50.901135 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:50.901099 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:50.901331 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.901306 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:14:50.901372 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.901332 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:14:50.901372 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.901346 2574 projected.go:196] Error preparing data for projected volume kube-api-access-22csf for pod openshift-network-diagnostics/network-check-target-jjff7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:50.901442 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:50.901398 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf podName:c5cf409f-4504-45fb-a6e8-17f93defa81c nodeName:}" failed. No retries permitted until 2026-07-29 19:14:58.901385426 +0000 UTC m=+17.266468162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-22csf" (UniqueName: "kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf") pod "network-check-target-jjff7" (UID: "c5cf409f-4504-45fb-a6e8-17f93defa81c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:51.206281 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:51.205633 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:51.206281 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:51.205763 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:14:52.207362 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:52.207324 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:52.207768 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:52.207452 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:14:52.207978 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:52.207957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:52.208102 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:52.208072 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:14:53.205661 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:53.205625 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:53.205820 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:53.205752 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:14:54.205777 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:54.205741 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:54.206226 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:54.205875 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:14:54.206226 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:54.205934 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:54.206226 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:54.206034 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:14:55.206015 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:55.205987 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:55.206368 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:55.206085 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:14:56.206215 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:56.206175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:56.206653 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:56.206312 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:14:56.206653 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:56.206369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:56.206653 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:56.206499 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:14:57.206360 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:57.206321 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:57.206825 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:57.206434 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:14:58.206009 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:58.205972 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:58.206190 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:58.205982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:58.206190 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.206114 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:14:58.206190 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.206162 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:14:58.859573 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:58.859535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:14:58.860076 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:58.859625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:14:58.860076 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.859713 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:58.860076 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.859740 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:58.860076 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.859793 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs podName:36553e39-8d4d-4d1e-a229-a6a76954d530 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:14.859771473 +0000 UTC m=+33.224854193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs") pod "network-metrics-daemon-qltft" (UID: "36553e39-8d4d-4d1e-a229-a6a76954d530") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:14:58.860076 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.859815 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret podName:d6e0bc83-0390-42b7-8eae-4123ab6713b1 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:14.859804159 +0000 UTC m=+33.224886886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret") pod "global-pull-secret-syncer-82wbd" (UID: "d6e0bc83-0390-42b7-8eae-4123ab6713b1") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:14:58.960525 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:58.960488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:58.960732 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.960705 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:14:58.960732 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.960733 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:14:58.960842 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.960747 2574 projected.go:196] Error preparing data for projected volume kube-api-access-22csf for pod openshift-network-diagnostics/network-check-target-jjff7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:58.960842 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:58.960819 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf podName:c5cf409f-4504-45fb-a6e8-17f93defa81c nodeName:}" failed. No retries permitted until 2026-07-29 19:15:14.960794044 +0000 UTC m=+33.325876784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-22csf" (UniqueName: "kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf") pod "network-check-target-jjff7" (UID: "c5cf409f-4504-45fb-a6e8-17f93defa81c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:14:59.206131 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:14:59.206027 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:14:59.206291 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:14:59.206174 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:00.206485 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:00.205864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:00.206485 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:00.205927 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:00.206485 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:00.206016 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:00.206485 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:00.206154 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:01.205991 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:01.205955 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:01.206226 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:01.206089 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:02.206762 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:02.206718 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:02.207234 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:02.206909 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:02.207234 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:02.206939 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:02.207234 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:02.207033 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:03.205398 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:03.205362 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:03.205588 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:03.205479 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:04.205813 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.205639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:04.206538 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.205688 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:04.206538 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:04.205921 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:04.206538 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:04.206010 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:04.308369 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.308333 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal" event={"ID":"bb03f04c0c3ccf4f43dec4c1ab69f17f","Type":"ContainerStarted","Data":"de416d8b2d0b1b46e5f34782ae1d9da9f4b7e82717f98e05aaed7b299e33c54f"} Jul 29 19:15:04.310816 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.310779 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" event={"ID":"f16995de-af89-44c3-8d9d-d5bbfec8dd14","Type":"ContainerStarted","Data":"504a8befc1fb6b59a6c3c840f54cc2e394db88197d3d19612a3f94883f315eac"} Jul 29 19:15:04.310969 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.310869 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" event={"ID":"f16995de-af89-44c3-8d9d-d5bbfec8dd14","Type":"ContainerStarted","Data":"c1078e81f43c95b937de3dca3a70e594cf5ff81e3746df0e971c3602a1328a67"} Jul 29 19:15:04.310969 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.310921 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" event={"ID":"f16995de-af89-44c3-8d9d-d5bbfec8dd14","Type":"ContainerStarted","Data":"6c6d772174645bff0464c3c74a056e0187ef052405ef14e96ba7c86292f88557"} Jul 29 19:15:04.310969 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.310960 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" event={"ID":"f16995de-af89-44c3-8d9d-d5bbfec8dd14","Type":"ContainerStarted","Data":"e91cb5f81a8be9a5a4898dcebba99dd554d97bd5cf48783d21d638e41eb926b9"} Jul 29 19:15:04.312313 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.312287 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24j7m" event={"ID":"840bbe93-ede4-4686-a1e7-1448b0e9b794","Type":"ContainerStarted","Data":"01b9e3658c323b87caee5f9e8aa9ca5e21e9447d6db529ab6e970b1f947e505c"} Jul 29 19:15:04.313623 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.313598 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pwdqr" event={"ID":"967e4490-1fbc-4b8b-8084-64bedcc3e271","Type":"ContainerStarted","Data":"26fd4658e27862a6bc5167222d3f01462493ffab5af087dfe30fc7d807f3fc73"} Jul 29 19:15:04.328980 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.328926 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-216.ec2.internal" podStartSLOduration=21.328909817 podStartE2EDuration="21.328909817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:04.328841219 +0000 UTC m=+22.693923957" watchObservedRunningTime="2026-07-29 19:15:04.328909817 +0000 UTC m=+22.693992558" Jul 29 19:15:04.348423 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.348377 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pwdqr" podStartSLOduration=1.978610805 podStartE2EDuration="22.348358568s" totalImagesPullingTime="20.369747763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:04.348225094 +0000 UTC m=+22.713307835" watchObservedRunningTime="2026-07-29 19:15:04.348358568 +0000 UTC m=+22.713441300" Jul 29 19:15:04.393263 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:04.393214 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-24j7m" podStartSLOduration=2.187713118 podStartE2EDuration="22.393196457s" totalImagesPullingTime="20.205483339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:04.392420961 +0000 UTC m=+22.757503703" watchObservedRunningTime="2026-07-29 19:15:04.393196457 +0000 UTC m=+22.758279198" Jul 29 19:15:05.206230 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.206043 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:05.206646 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:05.206327 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:05.317587 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.317480 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c55n4" event={"ID":"cf021cd7-f744-4799-a0ed-b4764655efe6","Type":"ContainerStarted","Data":"a417ea6671a03836136a1eeb00be452246a00b7e1cdde788cb148dadb0ec7624"} Jul 29 19:15:05.320758 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.320721 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ztx54" event={"ID":"6415fb6e-0760-451f-9e00-778546bcda01","Type":"ContainerStarted","Data":"51690f42bedf60f4f299d959a7655e791453d113b8a4e9c01a01ffcd323c01da"} Jul 29 19:15:05.322293 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.322257 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" event={"ID":"e867f183-9aaf-4af0-a5b5-b851debd1a7b","Type":"ContainerStarted","Data":"a69489e7faa682a3c0e4f79ca2c8e6749d70b572da093299d8c277a8263d0f66"} Jul 29 19:15:05.323538 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.323516 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wtcbz" event={"ID":"f270df64-ac28-4aaf-a05e-5311e2b5830b","Type":"ContainerStarted","Data":"e69a124d7ad67637e1c8ecaca83d6401062febc2405a1d8d27b2e984c132edf3"} Jul 29 19:15:05.324771 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.324753 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krmhr" event={"ID":"939b0a59-b0e6-4a5b-bc41-2421e6d8d615","Type":"ContainerStarted","Data":"b6c515c3fb20a710adfecd711d1d445189e4e45348d055173caa5c752c30beec"} Jul 29 19:15:05.327619 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.327599 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" event={"ID":"f16995de-af89-44c3-8d9d-d5bbfec8dd14","Type":"ContainerStarted","Data":"e37098b3a97dc0af3ed52efd354c3f0ba66d42b8b2231439e71b862b8d58ad9f"} Jul 29 19:15:05.327729 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.327674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" event={"ID":"f16995de-af89-44c3-8d9d-d5bbfec8dd14","Type":"ContainerStarted","Data":"8c538c53856d956ce96e6e812bcccbe3bdb28cf6a03a640d6a5409a69c6a3399"} Jul 29 19:15:05.328983 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.328957 2574 generic.go:356] "Generic (PLEG): container finished" podID="930d691e-e115-44f2-b81f-a9fa11919dc7" containerID="db288d729d65559a1a59fc7acfb43554d58bf582f17a93111102e2b54e299aee" exitCode=0 Jul 29 19:15:05.329067 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.329020 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" event={"ID":"930d691e-e115-44f2-b81f-a9fa11919dc7","Type":"ContainerDied","Data":"db288d729d65559a1a59fc7acfb43554d58bf582f17a93111102e2b54e299aee"} Jul 29 19:15:05.330492 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.330436 2574 generic.go:356] "Generic (PLEG): container finished" podID="ab083a5f108842bdd2b691b291245170" containerID="7769deac6db329b1132e709d8d6c077b76f33896dae6f5fcd0f1f46281daceae" exitCode=0 Jul 29 19:15:05.330549 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.330502 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" event={"ID":"ab083a5f108842bdd2b691b291245170","Type":"ContainerDied","Data":"7769deac6db329b1132e709d8d6c077b76f33896dae6f5fcd0f1f46281daceae"} Jul 29 19:15:05.336341 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.336304 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c55n4" podStartSLOduration=3.088835889 podStartE2EDuration="23.336290846s" totalImagesPullingTime="20.247454957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:05.335937113 +0000 UTC m=+23.701019857" watchObservedRunningTime="2026-07-29 19:15:05.336290846 +0000 UTC m=+23.701373588" Jul 29 19:15:05.422959 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.422906 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ztx54" podStartSLOduration=3.146054015 podStartE2EDuration="23.422874397s" totalImagesPullingTime="20.276820382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:05.422663184 +0000 UTC m=+23.787745926" watchObservedRunningTime="2026-07-29 19:15:05.422874397 +0000 UTC m=+23.787957139" Jul 29 19:15:05.441198 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.441148 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wtcbz" podStartSLOduration=2.960584801 podStartE2EDuration="23.441127968s" totalImagesPullingTime="20.480543167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:05.440725153 +0000 UTC m=+23.805807920" watchObservedRunningTime="2026-07-29 19:15:05.441127968 +0000 UTC m=+23.806210778" Jul 29 19:15:05.931670 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:05.931641 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 19:15:06.096582 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:06.096421 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T19:15:05.931664559Z","UUID":"2d6dd5fb-b24b-4036-97be-da038881069a","Handler":null,"Name":"","Endpoint":""} Jul 29 19:15:06.098004 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:06.097975 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 19:15:06.098135 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:06.098022 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 19:15:06.205751 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:06.205715 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:06.205994 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:06.205864 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:06.205994 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:06.205918 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:06.206122 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:06.206048 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:06.334687 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:06.334652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" event={"ID":"ab083a5f108842bdd2b691b291245170","Type":"ContainerStarted","Data":"4ec35d4b96f07a5736f452dee00dbbd0a846c4b8dcd2a2e033a6049847f92542"} Jul 29 19:15:06.337420 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:06.337387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" event={"ID":"e867f183-9aaf-4af0-a5b5-b851debd1a7b","Type":"ContainerStarted","Data":"8599b1dc79e4a6974a697c3fb57e70ec106ccb2ef21823d11873bd0adc226976"} Jul 29 19:15:06.354654 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:06.354568 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-krmhr" podStartSLOduration=4.403774709 podStartE2EDuration="24.354546335s" totalImagesPullingTime="19.950771626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:05.469460852 +0000 UTC m=+23.834543594" watchObservedRunningTime="2026-07-29 19:15:06.354546335 +0000 UTC m=+24.719629074" Jul 29 19:15:06.355023 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:06.354943 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-216.ec2.internal" podStartSLOduration=23.35493143 podStartE2EDuration="23.35493143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:06.354762945 +0000 UTC m=+24.719845690" watchObservedRunningTime="2026-07-29 19:15:06.35493143 +0000 UTC m=+24.720014175" Jul 29 19:15:07.205437 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:07.205407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:07.205656 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:07.205531 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:07.343334 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:07.343297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" event={"ID":"f16995de-af89-44c3-8d9d-d5bbfec8dd14","Type":"ContainerStarted","Data":"415f5f50f58154af71e53e799d0671423019ca1daa3fbbaacfa7cf8c0179e043"} Jul 29 19:15:08.206062 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:08.205871 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:08.206346 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:08.205926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:08.206346 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:08.206168 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:08.206346 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:08.206204 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:08.347750 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:08.347713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" event={"ID":"e867f183-9aaf-4af0-a5b5-b851debd1a7b","Type":"ContainerStarted","Data":"908bc3c2211288bbc50d6ed9b188127cdf27bc3a0a7bdf94f2366314cc7a1540"} Jul 29 19:15:09.206147 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:09.206065 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:09.206307 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:09.206203 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:09.288311 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:09.288279 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:15:09.289052 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:09.289029 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:15:09.320818 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:09.320753 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z8d7n" podStartSLOduration=4.143462715 podStartE2EDuration="27.32073657s" totalImagesPullingTime="23.177273855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:08.367338378 +0000 UTC m=+26.732421120" watchObservedRunningTime="2026-07-29 19:15:09.32073657 +0000 UTC m=+27.685819312" Jul 29 19:15:10.206024 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:10.205990 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:10.206744 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:10.205990 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:10.206744 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:10.206112 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:10.206744 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:10.206174 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:10.355771 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:10.355679 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" event={"ID":"f16995de-af89-44c3-8d9d-d5bbfec8dd14","Type":"ContainerStarted","Data":"09b6017c2ed6040ccb5afad2bdff87344a35d1997072a4a1f94112e538194b1b"} Jul 29 19:15:10.355967 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:10.355937 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:15:10.357560 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:10.357535 2574 generic.go:356] "Generic (PLEG): container finished" podID="930d691e-e115-44f2-b81f-a9fa11919dc7" containerID="992b82130734fcb6496583d91a2144ae1ce30d0cb879cad8ba51f9dca5498eb3" exitCode=0 Jul 29 19:15:10.357656 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:10.357569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" event={"ID":"930d691e-e115-44f2-b81f-a9fa11919dc7","Type":"ContainerDied","Data":"992b82130734fcb6496583d91a2144ae1ce30d0cb879cad8ba51f9dca5498eb3"} Jul 29 19:15:10.372537 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:10.372352 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:15:10.387032 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:10.386988 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" podStartSLOduration=8.026939667 podStartE2EDuration="28.386969533s" totalImagesPullingTime="20.360029866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:10.38647809 +0000 UTC m=+28.751560832" watchObservedRunningTime="2026-07-29 19:15:10.386969533 +0000 UTC m=+28.752052277" Jul 29 19:15:11.206208 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:11.206178 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:11.206756 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:11.206308 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:11.359866 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:11.359824 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:15:11.360033 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:11.359947 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:15:11.375637 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:11.375613 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:15:11.724776 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:11.724746 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:15:11.725012 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:11.724908 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 19:15:11.725315 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:11.725293 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-krmhr" Jul 29 19:15:12.207117 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.207094 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:12.207468 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.207178 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:12.207468 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:12.207180 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:12.207468 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:12.207299 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:12.241596 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.241563 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qltft"] Jul 29 19:15:12.244312 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.244022 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jjff7"] Jul 29 19:15:12.244312 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.244150 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:12.244312 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:12.244259 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:12.244632 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.244611 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-82wbd"] Jul 29 19:15:12.364308 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.364219 2574 generic.go:356] "Generic (PLEG): container finished" podID="930d691e-e115-44f2-b81f-a9fa11919dc7" containerID="5b41b8106e406a9ce40c4e78b178f6d2798cad516770fbba81cb9d3517f6a8ca" exitCode=0 Jul 29 19:15:12.364308 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.364294 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:12.364515 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.364321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" event={"ID":"930d691e-e115-44f2-b81f-a9fa11919dc7","Type":"ContainerDied","Data":"5b41b8106e406a9ce40c4e78b178f6d2798cad516770fbba81cb9d3517f6a8ca"} Jul 29 19:15:12.364515 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:12.364381 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:12.364515 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:12.364490 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:12.364670 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:12.364618 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:14.206053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:14.205962 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:14.206494 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:14.205962 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:14.206494 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:14.206083 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:14.206494 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.206086 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:14.206494 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.206155 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:14.206494 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.206224 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:14.370942 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:14.370906 2574 generic.go:356] "Generic (PLEG): container finished" podID="930d691e-e115-44f2-b81f-a9fa11919dc7" containerID="5c09f4267edf48615c5021bb76bc240b0365dfdabbda2b31a6fe8fac61e0b15e" exitCode=0 Jul 29 19:15:14.371096 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:14.370958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" event={"ID":"930d691e-e115-44f2-b81f-a9fa11919dc7","Type":"ContainerDied","Data":"5c09f4267edf48615c5021bb76bc240b0365dfdabbda2b31a6fe8fac61e0b15e"} Jul 29 19:15:14.884374 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:14.884340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:14.884571 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:14.884396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:14.884571 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.884484 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:15:14.884571 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.884493 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:15:14.884571 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.884535 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret podName:d6e0bc83-0390-42b7-8eae-4123ab6713b1 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:46.884523269 +0000 UTC m=+65.249605988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret") pod "global-pull-secret-syncer-82wbd" (UID: "d6e0bc83-0390-42b7-8eae-4123ab6713b1") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:15:14.884571 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.884559 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs podName:36553e39-8d4d-4d1e-a229-a6a76954d530 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:46.884541172 +0000 UTC m=+65.249623912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs") pod "network-metrics-daemon-qltft" (UID: "36553e39-8d4d-4d1e-a229-a6a76954d530") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:15:14.985806 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:14.985566 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:14.985976 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.985752 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:15:14.985976 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.985872 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:15:14.985976 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.985904 2574 projected.go:196] Error preparing data for projected volume kube-api-access-22csf for pod openshift-network-diagnostics/network-check-target-jjff7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:15:14.985976 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:14.985969 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf podName:c5cf409f-4504-45fb-a6e8-17f93defa81c nodeName:}" failed. No retries permitted until 2026-07-29 19:15:46.985952232 +0000 UTC m=+65.351034970 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-22csf" (UniqueName: "kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf") pod "network-check-target-jjff7" (UID: "c5cf409f-4504-45fb-a6e8-17f93defa81c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:15:16.206589 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:16.206488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:16.207114 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:16.206502 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:16.207114 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:16.206688 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:16.207114 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:16.206702 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qltft" podUID="36553e39-8d4d-4d1e-a229-a6a76954d530" Jul 29 19:15:16.207114 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:16.207048 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-82wbd" podUID="d6e0bc83-0390-42b7-8eae-4123ab6713b1" Jul 29 19:15:16.207347 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:16.207201 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jjff7" podUID="c5cf409f-4504-45fb-a6e8-17f93defa81c" Jul 29 19:15:17.364391 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.364363 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-216.ec2.internal" event="NodeReady" Jul 29 19:15:17.364768 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.364502 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 19:15:17.421476 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.421440 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59c4ff5bc9-fjkhf"] Jul 29 19:15:17.425844 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.425822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.429794 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.429773 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2"] Jul 29 19:15:17.432960 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.432938 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf"] Jul 29 19:15:17.433098 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.433054 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.433704 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.433541 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 19:15:17.434020 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.433917 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 19:15:17.434256 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.434236 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-82qj5\"" Jul 29 19:15:17.436167 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.436150 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 19:15:17.437355 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.436668 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-4fnpr"] Jul 29 19:15:17.437355 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.436745 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:17.437911 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.437875 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 29 19:15:17.438382 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.438363 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mndg8\"" Jul 29 19:15:17.439756 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.439726 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92"] Jul 29 19:15:17.439861 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.439844 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.440869 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.440850 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.440996 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.440957 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.440996 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.440967 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kmzxk\"" Jul 29 19:15:17.441518 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.441257 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 29 19:15:17.443089 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.442920 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 19:15:17.443089 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.442959 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t"] Jul 29 19:15:17.443229 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.443217 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:17.446059 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.446042 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bfbd696bc-8jlrm"] Jul 29 19:15:17.446160 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.446147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.449105 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.449089 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.464909 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.464862 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 29 19:15:17.465455 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.465431 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 29 19:15:17.465564 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.465461 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.465737 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.465724 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.465909 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.465970 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.466233 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.466324 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.466459 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.466722 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.466809 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.466828 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.467019 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.467022 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.467095 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2"] Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.467139 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.467255 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.467337 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.467257 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.468134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.467417 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 19:15:17.468875 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.468275 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 29 19:15:17.468875 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.468328 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4d6b5\"" Jul 29 19:15:17.468875 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.468616 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ntqt5\"" Jul 29 19:15:17.469057 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.468900 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mq5lh\"" Jul 29 19:15:17.469252 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.469236 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kjxkx\"" Jul 29 19:15:17.469702 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.469679 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 19:15:17.473451 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.472290 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c4ff5bc9-fjkhf"] Jul 29 19:15:17.473451 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.472365 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf"] Jul 29 19:15:17.476088 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.475566 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 29 19:15:17.478868 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.478833 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92"] Jul 29 19:15:17.481986 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.481955 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t"] Jul 29 19:15:17.482822 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.482793 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-4fnpr"] Jul 29 19:15:17.492710 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.492681 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bfbd696bc-8jlrm"] Jul 29 19:15:17.504033 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.503997 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x9c5s"] Jul 29 19:15:17.505071 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.505046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-bound-sa-token\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.505196 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.505083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-registry-certificates\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.505196 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.505116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.505196 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.505138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-installation-pull-secrets\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.505196 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.505192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0622e6ea-39f7-490e-a205-cb92d450f100-ca-trust-extracted\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.505343 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.505215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrhff\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-kube-api-access-jrhff\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.505343 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.505312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-image-registry-private-configuration\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.505411 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.505360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-trusted-ca\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.507827 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.507809 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.511117 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.511100 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ffrr\"" Jul 29 19:15:17.511235 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.511213 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 19:15:17.511907 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.511872 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 19:15:17.516546 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.516524 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq"] Jul 29 19:15:17.521131 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.521107 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc"] Jul 29 19:15:17.521250 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.521234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:17.524104 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.524086 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-rbpfw"] Jul 29 19:15:17.524221 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.524204 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc" Jul 29 19:15:17.527580 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.526979 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 19:15:17.527580 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.527199 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 19:15:17.527580 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.527255 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.527580 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.527301 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qdgpx\"" Jul 29 19:15:17.527580 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.527423 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6tc67\"" Jul 29 19:15:17.527580 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.527578 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.527580 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.527585 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl"] Jul 29 19:15:17.527982 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.527850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.530741 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.530710 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bwdmq"] Jul 29 19:15:17.530836 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.530826 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl" Jul 29 19:15:17.533079 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.533061 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 29 19:15:17.533599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.533581 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.534380 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.534361 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9c5s"] Jul 29 19:15:17.534472 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.534457 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bwdmq" Jul 29 19:15:17.534728 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.534707 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 29 19:15:17.534811 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.534715 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq"] Jul 29 19:15:17.535133 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.535114 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7p4h7\"" Jul 29 19:15:17.535507 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.535489 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.537108 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.536946 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.537218 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.537190 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.537757 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.537740 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 19:15:17.538273 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.538083 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fbd97\"" Jul 29 19:15:17.541993 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.541970 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 19:15:17.544107 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.544086 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl"] Jul 29 19:15:17.545610 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.545589 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc"] Jul 29 19:15:17.549994 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.549679 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 19:15:17.550500 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.550448 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8c742\"" Jul 29 19:15:17.552882 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.552861 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 29 19:15:17.553651 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.553634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bwdmq"] Jul 29 19:15:17.569590 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.569566 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-rbpfw"] Jul 29 19:15:17.606428 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1940e899-f629-405a-9765-aee5aeb94f1f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t\" (UID: \"1940e899-f629-405a-9765-aee5aeb94f1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.606599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66c6ea58-7211-44bf-9bd0-3baa37879269-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:17.606599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xrp4\" (UniqueName: \"kubernetes.io/projected/e6b38a35-f491-4e16-ad59-3c8847af8951-kube-api-access-2xrp4\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:17.606599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.606599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-installation-pull-secrets\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.606599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-serving-cert\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.606599 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.606579 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:15:17.606599 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.606595 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c4ff5bc9-fjkhf: secret "image-registry-tls" not found Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-stats-auth\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.606655 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls podName:0622e6ea-39f7-490e-a205-cb92d450f100 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:18.106634098 +0000 UTC m=+36.471716818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls") pod "image-registry-59c4ff5bc9-fjkhf" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100") : secret "image-registry-tls" not found Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599add3b-5995-4c28-b799-4b19e10992d6-config\") pod \"service-ca-operator-5d6c75f84f-kscw2\" (UID: \"599add3b-5995-4c28-b799-4b19e10992d6\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-trusted-ca\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-tmp-dir\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xkn5\" (UniqueName: \"kubernetes.io/projected/8da9004e-42d6-4e3e-b28d-c828d75884a5-kube-api-access-8xkn5\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606849 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa61cb03-3266-4e88-9397-623780de00ee-serving-cert\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzljd\" (UniqueName: \"kubernetes.io/projected/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-kube-api-access-dzljd\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl29c\" (UniqueName: \"kubernetes.io/projected/7ef74d92-a802-4a6d-adc9-362975dd5709-kube-api-access-zl29c\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:17.607005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.606974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-snapshots\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-registry-certificates\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-config-volume\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrhff\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-kube-api-access-jrhff\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0622e6ea-39f7-490e-a205-cb92d450f100-ca-trust-extracted\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wxjz\" (UniqueName: \"kubernetes.io/projected/fa403135-d0db-490e-a570-20bcbbdc550e-kube-api-access-2wxjz\") pod \"network-check-source-7d88cb55d8-cbfnl\" (UID: \"fa403135-d0db-490e-a570-20bcbbdc550e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-tmp\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1940e899-f629-405a-9765-aee5aeb94f1f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t\" (UID: \"1940e899-f629-405a-9765-aee5aeb94f1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607353 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-image-registry-private-configuration\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa61cb03-3266-4e88-9397-623780de00ee-config\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607554 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rz5b\" (UniqueName: \"kubernetes.io/projected/fa61cb03-3266-4e88-9397-623780de00ee-kube-api-access-9rz5b\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.607575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ttl7\" (UniqueName: \"kubernetes.io/projected/1940e899-f629-405a-9765-aee5aeb94f1f-kube-api-access-2ttl7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t\" (UID: \"1940e899-f629-405a-9765-aee5aeb94f1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607628 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-registry-certificates\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-bound-sa-token\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607683 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-default-certificate\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dfvw\" (UniqueName: \"kubernetes.io/projected/599add3b-5995-4c28-b799-4b19e10992d6-kube-api-access-7dfvw\") pod \"service-ca-operator-5d6c75f84f-kscw2\" (UID: \"599add3b-5995-4c28-b799-4b19e10992d6\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607809 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-service-ca-bundle\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607824 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-trusted-ca\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607842 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jbfg\" (UniqueName: \"kubernetes.io/projected/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-kube-api-access-8jbfg\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa61cb03-3266-4e88-9397-623780de00ee-trusted-ca\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6b38a35-f491-4e16-ad59-3c8847af8951-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.607961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stxrm\" (UniqueName: \"kubernetes.io/projected/6f762915-9790-4f0b-82ad-e675c2a38d7e-kube-api-access-stxrm\") pod \"volume-data-source-validator-549c6d54cf-xrmmc\" (UID: \"6f762915-9790-4f0b-82ad-e675c2a38d7e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.608022 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/599add3b-5995-4c28-b799-4b19e10992d6-serving-cert\") pod \"service-ca-operator-5d6c75f84f-kscw2\" (UID: \"599add3b-5995-4c28-b799-4b19e10992d6\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.608314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.608285 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0622e6ea-39f7-490e-a205-cb92d450f100-ca-trust-extracted\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.611512 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.611483 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-installation-pull-secrets\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.611630 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.611573 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-image-registry-private-configuration\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.624312 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.624287 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-bound-sa-token\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.626869 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.626847 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrhff\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-kube-api-access-jrhff\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:17.708668 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.708637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-stats-auth\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.708844 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.708682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95f04637-47b9-4e84-90a8-12e5b5932e7f-cert\") pod \"ingress-canary-bwdmq\" (UID: \"95f04637-47b9-4e84-90a8-12e5b5932e7f\") " pod="openshift-ingress-canary/ingress-canary-bwdmq" Jul 29 19:15:17.708844 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.708715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.708844 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.708736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599add3b-5995-4c28-b799-4b19e10992d6-config\") pod \"service-ca-operator-5d6c75f84f-kscw2\" (UID: \"599add3b-5995-4c28-b799-4b19e10992d6\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.709054 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.709030 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-tmp-dir\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.709054 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.709047 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:18.209024781 +0000 UTC m=+36.574107519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : configmap references non-existent config key: service-ca.crt Jul 29 19:15:17.709142 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.709091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkn5\" (UniqueName: \"kubernetes.io/projected/8da9004e-42d6-4e3e-b28d-c828d75884a5-kube-api-access-8xkn5\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.709142 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.709117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa61cb03-3266-4e88-9397-623780de00ee-serving-cert\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.709201 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.709142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzljd\" (UniqueName: \"kubernetes.io/projected/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-kube-api-access-dzljd\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.709201 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.709168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gxcc\" (UniqueName: \"kubernetes.io/projected/95f04637-47b9-4e84-90a8-12e5b5932e7f-kube-api-access-6gxcc\") pod \"ingress-canary-bwdmq\" (UID: \"95f04637-47b9-4e84-90a8-12e5b5932e7f\") " pod="openshift-ingress-canary/ingress-canary-bwdmq" Jul 29 19:15:17.709383 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.709356 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599add3b-5995-4c28-b799-4b19e10992d6-config\") pod \"service-ca-operator-5d6c75f84f-kscw2\" (UID: \"599add3b-5995-4c28-b799-4b19e10992d6\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.709523 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.709485 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-tmp-dir\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.709969 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.709946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl29c\" (UniqueName: \"kubernetes.io/projected/7ef74d92-a802-4a6d-adc9-362975dd5709-kube-api-access-zl29c\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:17.710073 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.709994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-snapshots\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.710073 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:17.710073 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-config-volume\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wxjz\" (UniqueName: \"kubernetes.io/projected/fa403135-d0db-490e-a570-20bcbbdc550e-kube-api-access-2wxjz\") pod \"network-check-source-7d88cb55d8-cbfnl\" (UID: \"fa403135-d0db-490e-a570-20bcbbdc550e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-tmp\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.710180 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710198 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1940e899-f629-405a-9765-aee5aeb94f1f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t\" (UID: \"1940e899-f629-405a-9765-aee5aeb94f1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa61cb03-3266-4e88-9397-623780de00ee-config\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rz5b\" (UniqueName: \"kubernetes.io/projected/fa61cb03-3266-4e88-9397-623780de00ee-kube-api-access-9rz5b\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ttl7\" (UniqueName: \"kubernetes.io/projected/1940e899-f629-405a-9765-aee5aeb94f1f-kube-api-access-2ttl7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t\" (UID: \"1940e899-f629-405a-9765-aee5aeb94f1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-default-certificate\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.710400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dfvw\" (UniqueName: \"kubernetes.io/projected/599add3b-5995-4c28-b799-4b19e10992d6-kube-api-access-7dfvw\") pod \"service-ca-operator-5d6c75f84f-kscw2\" (UID: \"599add3b-5995-4c28-b799-4b19e10992d6\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-service-ca-bundle\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jbfg\" (UniqueName: \"kubernetes.io/projected/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-kube-api-access-8jbfg\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa61cb03-3266-4e88-9397-623780de00ee-trusted-ca\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6b38a35-f491-4e16-ad59-3c8847af8951-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stxrm\" (UniqueName: \"kubernetes.io/projected/6f762915-9790-4f0b-82ad-e675c2a38d7e-kube-api-access-stxrm\") pod \"volume-data-source-validator-549c6d54cf-xrmmc\" (UID: \"6f762915-9790-4f0b-82ad-e675c2a38d7e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/599add3b-5995-4c28-b799-4b19e10992d6-serving-cert\") pod \"service-ca-operator-5d6c75f84f-kscw2\" (UID: \"599add3b-5995-4c28-b799-4b19e10992d6\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1940e899-f629-405a-9765-aee5aeb94f1f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t\" (UID: \"1940e899-f629-405a-9765-aee5aeb94f1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66c6ea58-7211-44bf-9bd0-3baa37879269-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xrp4\" (UniqueName: \"kubernetes.io/projected/e6b38a35-f491-4e16-ad59-3c8847af8951-kube-api-access-2xrp4\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-serving-cert\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.710828 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-snapshots\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.710937 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:15:17.711053 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.710980 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls podName:f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:18.210963493 +0000 UTC m=+36.576046213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls") pod "dns-default-x9c5s" (UID: "f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41") : secret "dns-default-metrics-tls" not found Jul 29 19:15:17.712360 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.712339 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66c6ea58-7211-44bf-9bd0-3baa37879269-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:17.712725 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.712697 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.712807 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.712771 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa61cb03-3266-4e88-9397-623780de00ee-trusted-ca\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.713275 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.713245 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-service-ca-bundle\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.713275 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.713265 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-config-volume\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.713442 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.713413 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6b38a35-f491-4e16-ad59-3c8847af8951-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:17.713552 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.713513 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-tmp\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.713628 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.713596 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 19:15:17.713628 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.713604 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls podName:e6b38a35-f491-4e16-ad59-3c8847af8951 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:18.213587485 +0000 UTC m=+36.578670205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-x8zvf" (UID: "e6b38a35-f491-4e16-ad59-3c8847af8951") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:17.713734 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.713640 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert podName:66c6ea58-7211-44bf-9bd0-3baa37879269 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:18.213624686 +0000 UTC m=+36.578707406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6b7zq" (UID: "66c6ea58-7211-44bf-9bd0-3baa37879269") : secret "networking-console-plugin-cert" not found Jul 29 19:15:17.713734 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.713718 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:15:17.713810 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.713753 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:18.213740849 +0000 UTC m=+36.578823598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : secret "router-metrics-certs-default" not found Jul 29 19:15:17.713847 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.713817 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:15:17.713879 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:17.713849 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls podName:7ef74d92-a802-4a6d-adc9-362975dd5709 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:18.213838936 +0000 UTC m=+36.578921680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls") pod "cluster-samples-operator-6748489656-2lp92" (UID: "7ef74d92-a802-4a6d-adc9-362975dd5709") : secret "samples-operator-tls" not found Jul 29 19:15:17.714088 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.714063 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/599add3b-5995-4c28-b799-4b19e10992d6-serving-cert\") pod \"service-ca-operator-5d6c75f84f-kscw2\" (UID: \"599add3b-5995-4c28-b799-4b19e10992d6\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.714158 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.714114 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1940e899-f629-405a-9765-aee5aeb94f1f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t\" (UID: \"1940e899-f629-405a-9765-aee5aeb94f1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.714239 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.714211 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa61cb03-3266-4e88-9397-623780de00ee-config\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.715166 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.715147 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-serving-cert\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.715507 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.715483 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-default-certificate\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.716464 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.716441 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1940e899-f629-405a-9765-aee5aeb94f1f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t\" (UID: \"1940e899-f629-405a-9765-aee5aeb94f1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.716766 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.716728 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-stats-auth\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.717821 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.717801 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa61cb03-3266-4e88-9397-623780de00ee-serving-cert\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.738952 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.738868 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jbfg\" (UniqueName: \"kubernetes.io/projected/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-kube-api-access-8jbfg\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:17.739994 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.739960 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ttl7\" (UniqueName: \"kubernetes.io/projected/1940e899-f629-405a-9765-aee5aeb94f1f-kube-api-access-2ttl7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t\" (UID: \"1940e899-f629-405a-9765-aee5aeb94f1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.740411 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.740387 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wxjz\" (UniqueName: \"kubernetes.io/projected/fa403135-d0db-490e-a570-20bcbbdc550e-kube-api-access-2wxjz\") pod \"network-check-source-7d88cb55d8-cbfnl\" (UID: \"fa403135-d0db-490e-a570-20bcbbdc550e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl" Jul 29 19:15:17.741050 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.741026 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzljd\" (UniqueName: \"kubernetes.io/projected/0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e-kube-api-access-dzljd\") pod \"insights-operator-5885fdb759-4fnpr\" (UID: \"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e\") " pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.741136 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.741121 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xkn5\" (UniqueName: \"kubernetes.io/projected/8da9004e-42d6-4e3e-b28d-c828d75884a5-kube-api-access-8xkn5\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:17.750188 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.750164 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stxrm\" (UniqueName: \"kubernetes.io/projected/6f762915-9790-4f0b-82ad-e675c2a38d7e-kube-api-access-stxrm\") pod \"volume-data-source-validator-549c6d54cf-xrmmc\" (UID: \"6f762915-9790-4f0b-82ad-e675c2a38d7e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc" Jul 29 19:15:17.762525 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.762497 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xrp4\" (UniqueName: \"kubernetes.io/projected/e6b38a35-f491-4e16-ad59-3c8847af8951-kube-api-access-2xrp4\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:17.763718 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.763692 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dfvw\" (UniqueName: \"kubernetes.io/projected/599add3b-5995-4c28-b799-4b19e10992d6-kube-api-access-7dfvw\") pod \"service-ca-operator-5d6c75f84f-kscw2\" (UID: \"599add3b-5995-4c28-b799-4b19e10992d6\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:17.766985 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.766961 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rz5b\" (UniqueName: \"kubernetes.io/projected/fa61cb03-3266-4e88-9397-623780de00ee-kube-api-access-9rz5b\") pod \"console-operator-584dcb6b54-rbpfw\" (UID: \"fa61cb03-3266-4e88-9397-623780de00ee\") " pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.767516 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.767495 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl29c\" (UniqueName: \"kubernetes.io/projected/7ef74d92-a802-4a6d-adc9-362975dd5709-kube-api-access-zl29c\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:17.772397 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.772371 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-4fnpr" Jul 29 19:15:17.789095 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.789074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" Jul 29 19:15:17.811178 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.811113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gxcc\" (UniqueName: \"kubernetes.io/projected/95f04637-47b9-4e84-90a8-12e5b5932e7f-kube-api-access-6gxcc\") pod \"ingress-canary-bwdmq\" (UID: \"95f04637-47b9-4e84-90a8-12e5b5932e7f\") " pod="openshift-ingress-canary/ingress-canary-bwdmq" Jul 29 19:15:17.811317 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.811300 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95f04637-47b9-4e84-90a8-12e5b5932e7f-cert\") pod \"ingress-canary-bwdmq\" (UID: \"95f04637-47b9-4e84-90a8-12e5b5932e7f\") " pod="openshift-ingress-canary/ingress-canary-bwdmq" Jul 29 19:15:17.814057 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.814035 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95f04637-47b9-4e84-90a8-12e5b5932e7f-cert\") pod \"ingress-canary-bwdmq\" (UID: \"95f04637-47b9-4e84-90a8-12e5b5932e7f\") " pod="openshift-ingress-canary/ingress-canary-bwdmq" Jul 29 19:15:17.826601 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.826577 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gxcc\" (UniqueName: \"kubernetes.io/projected/95f04637-47b9-4e84-90a8-12e5b5932e7f-kube-api-access-6gxcc\") pod \"ingress-canary-bwdmq\" (UID: \"95f04637-47b9-4e84-90a8-12e5b5932e7f\") " pod="openshift-ingress-canary/ingress-canary-bwdmq" Jul 29 19:15:17.842579 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.842546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc" Jul 29 19:15:17.857810 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.857776 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:17.863950 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.863919 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl" Jul 29 19:15:17.870221 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:17.870192 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bwdmq" Jul 29 19:15:18.048657 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.048621 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" Jul 29 19:15:18.113962 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.113928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:18.114143 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.114113 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:15:18.114143 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.114142 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c4ff5bc9-fjkhf: secret "image-registry-tls" not found Jul 29 19:15:18.114292 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.114265 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls podName:0622e6ea-39f7-490e-a205-cb92d450f100 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:19.11424343 +0000 UTC m=+37.479326155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls") pod "image-registry-59c4ff5bc9-fjkhf" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100") : secret "image-registry-tls" not found Jul 29 19:15:18.206984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.206500 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:18.206984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.206514 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:18.206984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.206637 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:18.213755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.213730 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 19:15:18.213924 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.213729 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 19:15:18.214803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.214302 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:18.214803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.214414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:18.214803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.214472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:18.214803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.214525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:18.214803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.214553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:18.214803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.214613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:18.214803 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.214767 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.214875 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls podName:f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:19.21483674 +0000 UTC m=+37.579919477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls") pod "dns-default-x9c5s" (UID: "f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41") : secret "dns-default-metrics-tls" not found Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.215112 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.215123 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:19.215104493 +0000 UTC m=+37.580187230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : configmap references non-existent config key: service-ca.crt Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.215147 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.215162 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.215170 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls podName:e6b38a35-f491-4e16-ad59-3c8847af8951 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:19.215154003 +0000 UTC m=+37.580236723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-x8zvf" (UID: "e6b38a35-f491-4e16-ad59-3c8847af8951") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.215112 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.215191 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls podName:7ef74d92-a802-4a6d-adc9-362975dd5709 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:19.21518199 +0000 UTC m=+37.580264710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls") pod "cluster-samples-operator-6748489656-2lp92" (UID: "7ef74d92-a802-4a6d-adc9-362975dd5709") : secret "samples-operator-tls" not found Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.215208 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert podName:66c6ea58-7211-44bf-9bd0-3baa37879269 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:19.215198925 +0000 UTC m=+37.580281651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6b7zq" (UID: "66c6ea58-7211-44bf-9bd0-3baa37879269") : secret "networking-console-plugin-cert" not found Jul 29 19:15:18.215426 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:18.215225 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:19.215216635 +0000 UTC m=+37.580299355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : secret "router-metrics-certs-default" not found Jul 29 19:15:18.215873 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.215515 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8b4l\"" Jul 29 19:15:18.216240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.216221 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhwzv\"" Jul 29 19:15:18.794060 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.793971 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-rbpfw"] Jul 29 19:15:18.802921 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:18.801879 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa61cb03_3266_4e88_9397_623780de00ee.slice/crio-30d085d8b942e0f694b24a9cad06fd97d744f2822d2aeb4dce21f9c033cfca04 WatchSource:0}: Error finding container 30d085d8b942e0f694b24a9cad06fd97d744f2822d2aeb4dce21f9c033cfca04: Status 404 returned error can't find the container with id 30d085d8b942e0f694b24a9cad06fd97d744f2822d2aeb4dce21f9c033cfca04 Jul 29 19:15:18.819825 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.819774 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc"] Jul 29 19:15:18.822486 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.822336 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t"] Jul 29 19:15:18.823713 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.823693 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2"] Jul 29 19:15:18.826209 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:18.826139 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599add3b_5995_4c28_b799_4b19e10992d6.slice/crio-ab56364f85442b090fab62897ef7f421a48c6f27285eaf68996d4d58f3e41c2e WatchSource:0}: Error finding container ab56364f85442b090fab62897ef7f421a48c6f27285eaf68996d4d58f3e41c2e: Status 404 returned error can't find the container with id ab56364f85442b090fab62897ef7f421a48c6f27285eaf68996d4d58f3e41c2e Jul 29 19:15:18.830006 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.829634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl"] Jul 29 19:15:18.833791 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.833767 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bwdmq"] Jul 29 19:15:18.834189 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:18.834168 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f762915_9790_4f0b_82ad_e675c2a38d7e.slice/crio-fc83e2477649405bd6bfde58414932ff8db2ec0a0a193fa67bf5d928312ee746 WatchSource:0}: Error finding container fc83e2477649405bd6bfde58414932ff8db2ec0a0a193fa67bf5d928312ee746: Status 404 returned error can't find the container with id fc83e2477649405bd6bfde58414932ff8db2ec0a0a193fa67bf5d928312ee746 Jul 29 19:15:18.837060 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:18.836994 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-4fnpr"] Jul 29 19:15:18.837434 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:18.837402 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa403135_d0db_490e_a570_20bcbbdc550e.slice/crio-b88eb9f2e0f2bc969976ee8677075176c8dfc3f435bfd338cd1884d04c34b7f4 WatchSource:0}: Error finding container b88eb9f2e0f2bc969976ee8677075176c8dfc3f435bfd338cd1884d04c34b7f4: Status 404 returned error can't find the container with id b88eb9f2e0f2bc969976ee8677075176c8dfc3f435bfd338cd1884d04c34b7f4 Jul 29 19:15:18.838020 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:18.837999 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f04637_47b9_4e84_90a8_12e5b5932e7f.slice/crio-c232d802070bce01855aea2824559f1ff2eb6eef0867fc4131dcf3a2f496de5b WatchSource:0}: Error finding container c232d802070bce01855aea2824559f1ff2eb6eef0867fc4131dcf3a2f496de5b: Status 404 returned error can't find the container with id c232d802070bce01855aea2824559f1ff2eb6eef0867fc4131dcf3a2f496de5b Jul 29 19:15:18.840578 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:18.840554 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0095bbb6_69e4_4ef6_8b14_90e1ef0bcc8e.slice/crio-7497443d662992bcbd64ed513749ff3a2851a5a99b10ec125cf4205291b3bb21 WatchSource:0}: Error finding container 7497443d662992bcbd64ed513749ff3a2851a5a99b10ec125cf4205291b3bb21: Status 404 returned error can't find the container with id 7497443d662992bcbd64ed513749ff3a2851a5a99b10ec125cf4205291b3bb21 Jul 29 19:15:19.124572 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.124535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:19.124755 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.124698 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:15:19.124755 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.124721 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c4ff5bc9-fjkhf: secret "image-registry-tls" not found Jul 29 19:15:19.124836 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.124776 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls podName:0622e6ea-39f7-490e-a205-cb92d450f100 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:21.124761426 +0000 UTC m=+39.489844146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls") pod "image-registry-59c4ff5bc9-fjkhf" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100") : secret "image-registry-tls" not found Jul 29 19:15:19.225208 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.225173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:19.225208 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.225215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:19.225427 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.225287 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:19.225427 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.225327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:19.225427 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225337 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:15:19.225427 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.225370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:19.225427 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225388 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:15:19.225427 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225398 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls podName:f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:21.225382103 +0000 UTC m=+39.590464823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls") pod "dns-default-x9c5s" (UID: "f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41") : secret "dns-default-metrics-tls" not found Jul 29 19:15:19.225661 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225442 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 19:15:19.225661 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.225447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:19.225661 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225486 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert podName:66c6ea58-7211-44bf-9bd0-3baa37879269 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:21.225470775 +0000 UTC m=+39.590553497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6b7zq" (UID: "66c6ea58-7211-44bf-9bd0-3baa37879269") : secret "networking-console-plugin-cert" not found Jul 29 19:15:19.225661 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225492 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:19.225661 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225504 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:21.225492156 +0000 UTC m=+39.590574879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : configmap references non-existent config key: service-ca.crt Jul 29 19:15:19.225661 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225504 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:15:19.225661 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225519 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:21.225511352 +0000 UTC m=+39.590594071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : secret "router-metrics-certs-default" not found Jul 29 19:15:19.225661 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225542 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls podName:7ef74d92-a802-4a6d-adc9-362975dd5709 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:21.225534676 +0000 UTC m=+39.590617396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls") pod "cluster-samples-operator-6748489656-2lp92" (UID: "7ef74d92-a802-4a6d-adc9-362975dd5709") : secret "samples-operator-tls" not found Jul 29 19:15:19.225661 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:19.225553 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls podName:e6b38a35-f491-4e16-ad59-3c8847af8951 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:21.225548209 +0000 UTC m=+39.590630928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-x8zvf" (UID: "e6b38a35-f491-4e16-ad59-3c8847af8951") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:19.384183 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.384097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl" event={"ID":"fa403135-d0db-490e-a570-20bcbbdc550e","Type":"ContainerStarted","Data":"b88eb9f2e0f2bc969976ee8677075176c8dfc3f435bfd338cd1884d04c34b7f4"} Jul 29 19:15:19.385343 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.385305 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" event={"ID":"fa61cb03-3266-4e88-9397-623780de00ee","Type":"ContainerStarted","Data":"30d085d8b942e0f694b24a9cad06fd97d744f2822d2aeb4dce21f9c033cfca04"} Jul 29 19:15:19.386439 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.386416 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bwdmq" event={"ID":"95f04637-47b9-4e84-90a8-12e5b5932e7f","Type":"ContainerStarted","Data":"c232d802070bce01855aea2824559f1ff2eb6eef0867fc4131dcf3a2f496de5b"} Jul 29 19:15:19.387521 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.387494 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc" event={"ID":"6f762915-9790-4f0b-82ad-e675c2a38d7e","Type":"ContainerStarted","Data":"fc83e2477649405bd6bfde58414932ff8db2ec0a0a193fa67bf5d928312ee746"} Jul 29 19:15:19.388534 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.388516 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" event={"ID":"1940e899-f629-405a-9765-aee5aeb94f1f","Type":"ContainerStarted","Data":"ebd5506a6cff9f15a007a19b618c63d1c22ab921e1326181c94f9d3bbaae5ad3"} Jul 29 19:15:19.391153 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.391131 2574 generic.go:356] "Generic (PLEG): container finished" podID="930d691e-e115-44f2-b81f-a9fa11919dc7" containerID="9eb7f731ad131af1faa79c041b3db8632cdf53193cab5990032cfbef7aaf50f9" exitCode=0 Jul 29 19:15:19.391242 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.391220 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" event={"ID":"930d691e-e115-44f2-b81f-a9fa11919dc7","Type":"ContainerDied","Data":"9eb7f731ad131af1faa79c041b3db8632cdf53193cab5990032cfbef7aaf50f9"} Jul 29 19:15:19.392377 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.392348 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-4fnpr" event={"ID":"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e","Type":"ContainerStarted","Data":"7497443d662992bcbd64ed513749ff3a2851a5a99b10ec125cf4205291b3bb21"} Jul 29 19:15:19.393481 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:19.393464 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" event={"ID":"599add3b-5995-4c28-b799-4b19e10992d6","Type":"ContainerStarted","Data":"ab56364f85442b090fab62897ef7f421a48c6f27285eaf68996d4d58f3e41c2e"} Jul 29 19:15:20.403074 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:20.403034 2574 generic.go:356] "Generic (PLEG): container finished" podID="930d691e-e115-44f2-b81f-a9fa11919dc7" containerID="dd3ca4316c757cabfc831f5ee1f40c7946191efcb38751511f12cca0a5f14f84" exitCode=0 Jul 29 19:15:20.403586 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:20.403126 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" event={"ID":"930d691e-e115-44f2-b81f-a9fa11919dc7","Type":"ContainerDied","Data":"dd3ca4316c757cabfc831f5ee1f40c7946191efcb38751511f12cca0a5f14f84"} Jul 29 19:15:20.974662 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:20.974606 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:21.131233 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.131149 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:21.146252 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.145596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:21.146252 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.145823 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:15:21.146252 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.145839 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c4ff5bc9-fjkhf: secret "image-registry-tls" not found Jul 29 19:15:21.146252 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.145916 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls podName:0622e6ea-39f7-490e-a205-cb92d450f100 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:25.145879831 +0000 UTC m=+43.510962576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls") pod "image-registry-59c4ff5bc9-fjkhf" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100") : secret "image-registry-tls" not found Jul 29 19:15:21.246310 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.246225 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:21.246471 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.246311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:21.246471 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.246363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:21.246471 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.246394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:21.246471 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.246445 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:25.246418611 +0000 UTC m=+43.611501354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : configmap references non-existent config key: service-ca.crt Jul 29 19:15:21.246691 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.246502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:21.246691 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.246551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:21.246785 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.246756 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:15:21.246832 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.246819 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:25.246796279 +0000 UTC m=+43.611879002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : secret "router-metrics-certs-default" not found Jul 29 19:15:21.246919 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.246857 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 19:15:21.246919 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.246912 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:15:21.247020 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.246931 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert podName:66c6ea58-7211-44bf-9bd0-3baa37879269 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:25.246915762 +0000 UTC m=+43.611998499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6b7zq" (UID: "66c6ea58-7211-44bf-9bd0-3baa37879269") : secret "networking-console-plugin-cert" not found Jul 29 19:15:21.247020 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.246952 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls podName:7ef74d92-a802-4a6d-adc9-362975dd5709 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:25.246941242 +0000 UTC m=+43.612023966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls") pod "cluster-samples-operator-6748489656-2lp92" (UID: "7ef74d92-a802-4a6d-adc9-362975dd5709") : secret "samples-operator-tls" not found Jul 29 19:15:21.247020 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.246977 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:15:21.247020 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.247001 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls podName:f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:25.24699222 +0000 UTC m=+43.612074939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls") pod "dns-default-x9c5s" (UID: "f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41") : secret "dns-default-metrics-tls" not found Jul 29 19:15:21.247020 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.247015 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:21.247277 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:21.247049 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls podName:e6b38a35-f491-4e16-ad59-3c8847af8951 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:25.247038862 +0000 UTC m=+43.612121601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-x8zvf" (UID: "e6b38a35-f491-4e16-ad59-3c8847af8951") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:21.409944 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.409577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc" event={"ID":"6f762915-9790-4f0b-82ad-e675c2a38d7e","Type":"ContainerStarted","Data":"d5111ca3bc30e32fb700b89fd21566f3d876960bb397c22b70b3f8c9fb16dac5"} Jul 29 19:15:21.418755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.418066 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" event={"ID":"930d691e-e115-44f2-b81f-a9fa11919dc7","Type":"ContainerStarted","Data":"e21eb9dca5322c277b92a644e4cacd3cacc7a8049a202e89ac39a65f1d5416d6"} Jul 29 19:15:21.430308 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.429228 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xrmmc" podStartSLOduration=15.400786666 podStartE2EDuration="17.429205281s" totalImagesPullingTime="2.028418615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:21.428300873 +0000 UTC m=+39.793383617" watchObservedRunningTime="2026-07-29 19:15:21.429205281 +0000 UTC m=+39.794288014" Jul 29 19:15:21.456717 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.456250 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tkvr5" podStartSLOduration=7.35021542 podStartE2EDuration="39.456227038s" totalImagesPullingTime="32.106011618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:21.454417089 +0000 UTC m=+39.819499832" watchObservedRunningTime="2026-07-29 19:15:21.456227038 +0000 UTC m=+39.821309784" Jul 29 19:15:21.582680 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.582642 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:21.686446 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.686406 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:21.787147 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.787063 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:21.883784 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:21.883740 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:24.000319 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:24.000276 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:24.073536 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:24.073500 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:25.183576 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:25.183312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:25.184064 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.183770 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:15:25.184064 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.183790 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c4ff5bc9-fjkhf: secret "image-registry-tls" not found Jul 29 19:15:25.184064 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.184020 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls podName:0622e6ea-39f7-490e-a205-cb92d450f100 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:33.18399847 +0000 UTC m=+51.549081209 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls") pod "image-registry-59c4ff5bc9-fjkhf" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100") : secret "image-registry-tls" not found Jul 29 19:15:25.284790 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:25.284756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:25.284985 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:25.284826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:25.284985 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:25.284872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:25.284985 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:25.284915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:25.284985 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:25.284948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:25.285155 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.284989 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:33.284966755 +0000 UTC m=+51.650049497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : configmap references non-existent config key: service-ca.crt Jul 29 19:15:25.285155 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:25.285016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:25.285155 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285015 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:25.285155 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285070 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:15:25.285155 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285070 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:15:25.285391 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285073 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls podName:e6b38a35-f491-4e16-ad59-3c8847af8951 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:33.285059422 +0000 UTC m=+51.650142156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-x8zvf" (UID: "e6b38a35-f491-4e16-ad59-3c8847af8951") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:25.285391 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285015 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 19:15:25.285391 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285186 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls podName:f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:33.285169154 +0000 UTC m=+51.650251874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls") pod "dns-default-x9c5s" (UID: "f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41") : secret "dns-default-metrics-tls" not found Jul 29 19:15:25.285391 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285077 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:15:25.285391 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285237 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert podName:66c6ea58-7211-44bf-9bd0-3baa37879269 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:33.285208447 +0000 UTC m=+51.650291182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6b7zq" (UID: "66c6ea58-7211-44bf-9bd0-3baa37879269") : secret "networking-console-plugin-cert" not found Jul 29 19:15:25.285391 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285272 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls podName:7ef74d92-a802-4a6d-adc9-362975dd5709 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:33.28526132 +0000 UTC m=+51.650344056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls") pod "cluster-samples-operator-6748489656-2lp92" (UID: "7ef74d92-a802-4a6d-adc9-362975dd5709") : secret "samples-operator-tls" not found Jul 29 19:15:25.285391 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:25.285292 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:33.285282746 +0000 UTC m=+51.650365481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : secret "router-metrics-certs-default" not found Jul 29 19:15:25.658312 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:25.658276 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:25.756451 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:25.756411 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:27.436125 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.435645 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bwdmq" event={"ID":"95f04637-47b9-4e84-90a8-12e5b5932e7f","Type":"ContainerStarted","Data":"0283984a525e1b5738fe9d67fa3eda88518e812588977f295f0bd905f1c07426"} Jul 29 19:15:27.437364 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.437333 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" event={"ID":"1940e899-f629-405a-9765-aee5aeb94f1f","Type":"ContainerStarted","Data":"0812ba8d0e7333648e698d780e363a941abadaedd30b18bde1772a722828ab5d"} Jul 29 19:15:27.439235 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.439211 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-4fnpr" event={"ID":"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e","Type":"ContainerStarted","Data":"c700f489dbf39a5c5e74a2e3b6c7f5a51dc2798a9b59678c682e0821dde7e322"} Jul 29 19:15:27.440780 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.440752 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" event={"ID":"599add3b-5995-4c28-b799-4b19e10992d6","Type":"ContainerStarted","Data":"2efed19f1a2da86fd4bb0599729569930aacdfa8d9764912eff175de3d8222d6"} Jul 29 19:15:27.442409 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.442382 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl" event={"ID":"fa403135-d0db-490e-a570-20bcbbdc550e","Type":"ContainerStarted","Data":"2cc418e1d405751069cc9c8eb647b911cc074ccab8ff86fe8abada5a3c890711"} Jul 29 19:15:27.444310 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.444292 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/0.log" Jul 29 19:15:27.444401 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.444331 2574 generic.go:356] "Generic (PLEG): container finished" podID="fa61cb03-3266-4e88-9397-623780de00ee" containerID="d5b4fbb9ad0202d5a50c03a818d49630ceaa8a370e1e4f29fb7cc30040702bae" exitCode=255 Jul 29 19:15:27.444401 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.444357 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" event={"ID":"fa61cb03-3266-4e88-9397-623780de00ee","Type":"ContainerDied","Data":"d5b4fbb9ad0202d5a50c03a818d49630ceaa8a370e1e4f29fb7cc30040702bae"} Jul 29 19:15:27.444580 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.444564 2574 scope.go:117] "RemoveContainer" containerID="d5b4fbb9ad0202d5a50c03a818d49630ceaa8a370e1e4f29fb7cc30040702bae" Jul 29 19:15:27.456505 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.455903 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bwdmq" podStartSLOduration=2.673220224 podStartE2EDuration="10.455860118s" totalImagesPullingTime="7.782639894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:27.455631146 +0000 UTC m=+45.820713890" watchObservedRunningTime="2026-07-29 19:15:27.455860118 +0000 UTC m=+45.820942862" Jul 29 19:15:27.522517 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.522455 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cbfnl" podStartSLOduration=15.738639031 podStartE2EDuration="23.52243506s" totalImagesPullingTime="7.783796029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:27.498330875 +0000 UTC m=+45.863413629" watchObservedRunningTime="2026-07-29 19:15:27.52243506 +0000 UTC m=+45.887517803" Jul 29 19:15:27.523328 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.523290 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-4fnpr" podStartSLOduration=15.743621315 podStartE2EDuration="23.523276649s" totalImagesPullingTime="7.779655334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:27.521629486 +0000 UTC m=+45.886712229" watchObservedRunningTime="2026-07-29 19:15:27.523276649 +0000 UTC m=+45.888359390" Jul 29 19:15:27.555296 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.555252 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" podStartSLOduration=16.761150638 podStartE2EDuration="24.555235639s" totalImagesPullingTime="7.794085001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:27.55465044 +0000 UTC m=+45.919733183" watchObservedRunningTime="2026-07-29 19:15:27.555235639 +0000 UTC m=+45.920318380" Jul 29 19:15:27.666131 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.665862 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" podStartSLOduration=15.868893122 podStartE2EDuration="23.665838406s" totalImagesPullingTime="7.796945284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:27.578307049 +0000 UTC m=+45.943389792" watchObservedRunningTime="2026-07-29 19:15:27.665838406 +0000 UTC m=+46.030921149" Jul 29 19:15:27.667032 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.666999 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cjk6d"] Jul 29 19:15:27.681876 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.681846 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.687471 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.687404 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7r8x\"" Jul 29 19:15:27.687699 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.687681 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 19:15:27.688126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.687966 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 19:15:27.688731 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.688681 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjk6d"] Jul 29 19:15:27.710847 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.710801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.710847 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.710852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-data-volume\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.711108 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.711000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-crio-socket\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.711108 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.711072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.711208 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.711114 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdbsc\" (UniqueName: \"kubernetes.io/projected/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-api-access-jdbsc\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.747649 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.747610 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:27.778529 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.778495 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp"] Jul 29 19:15:27.799865 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.799821 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp"] Jul 29 19:15:27.800078 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.799990 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp" Jul 29 19:15:27.803902 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.803854 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 29 19:15:27.804073 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.804051 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 29 19:15:27.804253 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.804232 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nwckx\"" Jul 29 19:15:27.812197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.812170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.812318 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.812209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-data-volume\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.812318 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:27.812293 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 19:15:27.812406 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.812319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-crio-socket\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.812406 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:27.812358 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:28.312337387 +0000 UTC m=+46.677420116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : configmap "kube-rbac-proxy" not found Jul 29 19:15:27.812406 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.812381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-669x8\" (UniqueName: \"kubernetes.io/projected/a068b387-2317-4649-8c3b-b5de01b20a96-kube-api-access-669x8\") pod \"migrator-6865c9967-kzjvp\" (UID: \"a068b387-2317-4649-8c3b-b5de01b20a96\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp" Jul 29 19:15:27.812406 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.812398 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-crio-socket\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.812602 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.812442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.812602 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.812484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdbsc\" (UniqueName: \"kubernetes.io/projected/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-api-access-jdbsc\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.812602 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.812517 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-data-volume\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.812602 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:27.812567 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:15:27.812727 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:27.812613 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:28.312597739 +0000 UTC m=+46.677680482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : secret "insights-runtime-extractor-tls" not found Jul 29 19:15:27.823970 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.823934 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdbsc\" (UniqueName: \"kubernetes.io/projected/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-api-access-jdbsc\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:27.844804 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.844749 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:27.858003 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.857966 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:27.858151 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.858020 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:27.913666 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.913621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-669x8\" (UniqueName: \"kubernetes.io/projected/a068b387-2317-4649-8c3b-b5de01b20a96-kube-api-access-669x8\") pod \"migrator-6865c9967-kzjvp\" (UID: \"a068b387-2317-4649-8c3b-b5de01b20a96\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp" Jul 29 19:15:27.923066 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.923037 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-669x8\" (UniqueName: \"kubernetes.io/projected/a068b387-2317-4649-8c3b-b5de01b20a96-kube-api-access-669x8\") pod \"migrator-6865c9967-kzjvp\" (UID: \"a068b387-2317-4649-8c3b-b5de01b20a96\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp" Jul 29 19:15:27.946439 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:27.946341 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" limit=1024 Jul 29 19:15:28.109678 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.109639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp" Jul 29 19:15:28.277680 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.277651 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp"] Jul 29 19:15:28.281188 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:28.281163 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda068b387_2317_4649_8c3b_b5de01b20a96.slice/crio-77b5c021610c9f33c949db5d4651963f557c9d27d895ff3dd0437537bddcea68 WatchSource:0}: Error finding container 77b5c021610c9f33c949db5d4651963f557c9d27d895ff3dd0437537bddcea68: Status 404 returned error can't find the container with id 77b5c021610c9f33c949db5d4651963f557c9d27d895ff3dd0437537bddcea68 Jul 29 19:15:28.316562 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.316527 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:28.316727 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:28.316650 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 19:15:28.316727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.316682 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:28.316727 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:28.316718 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:29.316697564 +0000 UTC m=+47.681780284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : configmap "kube-rbac-proxy" not found Jul 29 19:15:28.316946 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:28.316782 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:15:28.316946 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:28.316851 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:29.316834407 +0000 UTC m=+47.681917144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : secret "insights-runtime-extractor-tls" not found Jul 29 19:15:28.451478 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.451447 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:15:28.451985 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.451967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/0.log" Jul 29 19:15:28.452057 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.452004 2574 generic.go:356] "Generic (PLEG): container finished" podID="fa61cb03-3266-4e88-9397-623780de00ee" containerID="295d4328f61ae30b4f306c4494b264514715cbd7d128d950a4d26295a46ff86d" exitCode=255 Jul 29 19:15:28.452117 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.452074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" event={"ID":"fa61cb03-3266-4e88-9397-623780de00ee","Type":"ContainerDied","Data":"295d4328f61ae30b4f306c4494b264514715cbd7d128d950a4d26295a46ff86d"} Jul 29 19:15:28.452162 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.452132 2574 scope.go:117] "RemoveContainer" containerID="d5b4fbb9ad0202d5a50c03a818d49630ceaa8a370e1e4f29fb7cc30040702bae" Jul 29 19:15:28.452378 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.452361 2574 scope.go:117] "RemoveContainer" containerID="295d4328f61ae30b4f306c4494b264514715cbd7d128d950a4d26295a46ff86d" Jul 29 19:15:28.452598 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:28.452578 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-rbpfw_openshift-console-operator(fa61cb03-3266-4e88-9397-623780de00ee)\"" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" podUID="fa61cb03-3266-4e88-9397-623780de00ee" Jul 29 19:15:28.453492 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:28.453328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp" event={"ID":"a068b387-2317-4649-8c3b-b5de01b20a96","Type":"ContainerStarted","Data":"77b5c021610c9f33c949db5d4651963f557c9d27d895ff3dd0437537bddcea68"} Jul 29 19:15:29.071431 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:29.071400 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ztx54_6415fb6e-0760-451f-9e00-778546bcda01/dns-node-resolver/0.log" Jul 29 19:15:29.326182 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:29.326083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:29.326353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:29.326199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:29.326353 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:29.326227 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:15:29.326353 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:29.326280 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 19:15:29.326353 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:29.326295 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:31.326279654 +0000 UTC m=+49.691362374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : secret "insights-runtime-extractor-tls" not found Jul 29 19:15:29.326353 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:29.326333 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:31.326316662 +0000 UTC m=+49.691399402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : configmap "kube-rbac-proxy" not found Jul 29 19:15:29.459531 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:29.459503 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:15:29.460978 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:29.460258 2574 scope.go:117] "RemoveContainer" containerID="295d4328f61ae30b4f306c4494b264514715cbd7d128d950a4d26295a46ff86d" Jul 29 19:15:29.460978 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:29.460536 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-rbpfw_openshift-console-operator(fa61cb03-3266-4e88-9397-623780de00ee)\"" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" podUID="fa61cb03-3266-4e88-9397-623780de00ee" Jul 29 19:15:29.675115 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:29.675084 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c55n4_cf021cd7-f744-4799-a0ed-b4764655efe6/node-ca/0.log" Jul 29 19:15:30.464234 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:30.464205 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp" event={"ID":"a068b387-2317-4649-8c3b-b5de01b20a96","Type":"ContainerStarted","Data":"01dc482055947edf8d2bb1f16cc02d2e943a526b79c5742e561bcf5a4609140f"} Jul 29 19:15:30.492269 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:30.492229 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bwdmq_95f04637-47b9-4e84-90a8-12e5b5932e7f/serve-healthcheck-canary/0.log" Jul 29 19:15:31.346716 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:31.346676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:31.346928 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:31.346811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:31.346928 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:31.346843 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:15:31.346928 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:31.346917 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:35.346902019 +0000 UTC m=+53.711984755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : secret "insights-runtime-extractor-tls" not found Jul 29 19:15:31.347085 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:31.346947 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 19:15:31.347085 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:31.347002 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:35.34698846 +0000 UTC m=+53.712071180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : configmap "kube-rbac-proxy" not found Jul 29 19:15:31.468733 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:31.468702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp" event={"ID":"a068b387-2317-4649-8c3b-b5de01b20a96","Type":"ContainerStarted","Data":"49e6c2b9e4fd3a2c9cbd56e2c55a3280c916b1637d8dc9f04f100766edfd870d"} Jul 29 19:15:31.498403 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:31.498351 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kzjvp" podStartSLOduration=2.5285017400000003 podStartE2EDuration="4.498337222s" totalImagesPullingTime="1.969835482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:31.497442026 +0000 UTC m=+49.862524768" watchObservedRunningTime="2026-07-29 19:15:31.498337222 +0000 UTC m=+49.863419964" Jul 29 19:15:32.071629 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.071594 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-clw42"] Jul 29 19:15:32.083791 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.083764 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.087752 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.087727 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 19:15:32.087990 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.087874 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 19:15:32.089125 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.089103 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 19:15:32.089230 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.089150 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 19:15:32.089289 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.089103 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5pkrl\"" Jul 29 19:15:32.090801 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.090717 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-clw42"] Jul 29 19:15:32.154172 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.154146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10499a85-d107-4eec-90b3-f64c5bec55aa-signing-key\") pod \"service-ca-658d7b7c78-clw42\" (UID: \"10499a85-d107-4eec-90b3-f64c5bec55aa\") " pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.154314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.154212 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10499a85-d107-4eec-90b3-f64c5bec55aa-signing-cabundle\") pod \"service-ca-658d7b7c78-clw42\" (UID: \"10499a85-d107-4eec-90b3-f64c5bec55aa\") " pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.154314 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.154262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54zxs\" (UniqueName: \"kubernetes.io/projected/10499a85-d107-4eec-90b3-f64c5bec55aa-kube-api-access-54zxs\") pod \"service-ca-658d7b7c78-clw42\" (UID: \"10499a85-d107-4eec-90b3-f64c5bec55aa\") " pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.255009 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.254967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10499a85-d107-4eec-90b3-f64c5bec55aa-signing-cabundle\") pod \"service-ca-658d7b7c78-clw42\" (UID: \"10499a85-d107-4eec-90b3-f64c5bec55aa\") " pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.255177 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.255012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54zxs\" (UniqueName: \"kubernetes.io/projected/10499a85-d107-4eec-90b3-f64c5bec55aa-kube-api-access-54zxs\") pod \"service-ca-658d7b7c78-clw42\" (UID: \"10499a85-d107-4eec-90b3-f64c5bec55aa\") " pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.255213 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.255200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10499a85-d107-4eec-90b3-f64c5bec55aa-signing-key\") pod \"service-ca-658d7b7c78-clw42\" (UID: \"10499a85-d107-4eec-90b3-f64c5bec55aa\") " pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.255755 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.255722 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10499a85-d107-4eec-90b3-f64c5bec55aa-signing-cabundle\") pod \"service-ca-658d7b7c78-clw42\" (UID: \"10499a85-d107-4eec-90b3-f64c5bec55aa\") " pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.257772 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.257750 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10499a85-d107-4eec-90b3-f64c5bec55aa-signing-key\") pod \"service-ca-658d7b7c78-clw42\" (UID: \"10499a85-d107-4eec-90b3-f64c5bec55aa\") " pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.269410 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.269385 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54zxs\" (UniqueName: \"kubernetes.io/projected/10499a85-d107-4eec-90b3-f64c5bec55aa-kube-api-access-54zxs\") pod \"service-ca-658d7b7c78-clw42\" (UID: \"10499a85-d107-4eec-90b3-f64c5bec55aa\") " pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.394338 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.394304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-clw42" Jul 29 19:15:32.549045 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:32.549016 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10499a85_d107_4eec_90b3_f64c5bec55aa.slice/crio-79b3e8b6abc9368181ffae940bf70a75ecc6b7467a7a8c3777cc9eb06dea65d7 WatchSource:0}: Error finding container 79b3e8b6abc9368181ffae940bf70a75ecc6b7467a7a8c3777cc9eb06dea65d7: Status 404 returned error can't find the container with id 79b3e8b6abc9368181ffae940bf70a75ecc6b7467a7a8c3777cc9eb06dea65d7 Jul 29 19:15:32.554483 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:32.554461 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-clw42"] Jul 29 19:15:33.264633 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.264602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:33.264794 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.264770 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:15:33.264794 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.264791 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c4ff5bc9-fjkhf: secret "image-registry-tls" not found Jul 29 19:15:33.264872 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.264853 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls podName:0622e6ea-39f7-490e-a205-cb92d450f100 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:49.26483855 +0000 UTC m=+67.629921286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls") pod "image-registry-59c4ff5bc9-fjkhf" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100") : secret "image-registry-tls" not found Jul 29 19:15:33.365651 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.365609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:33.365651 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.365654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:33.365847 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.365728 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:33.365847 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.365773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:33.365847 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365790 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:15:33.365847 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.365821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365855 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365865 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls podName:f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:49.365844345 +0000 UTC m=+67.730927076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls") pod "dns-default-x9c5s" (UID: "f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41") : secret "dns-default-metrics-tls" not found Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.365915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365928 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:49.365912836 +0000 UTC m=+67.730995577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : secret "router-metrics-certs-default" not found Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365931 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365950 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365966 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle podName:8da9004e-42d6-4e3e-b28d-c828d75884a5 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:49.365955926 +0000 UTC m=+67.731038646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle") pod "router-default-6bfbd696bc-8jlrm" (UID: "8da9004e-42d6-4e3e-b28d-c828d75884a5") : configmap references non-existent config key: service-ca.crt Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365982 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert podName:66c6ea58-7211-44bf-9bd0-3baa37879269 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:49.365976779 +0000 UTC m=+67.731059498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6b7zq" (UID: "66c6ea58-7211-44bf-9bd0-3baa37879269") : secret "networking-console-plugin-cert" not found Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365981 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.365994 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls podName:e6b38a35-f491-4e16-ad59-3c8847af8951 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:49.365988694 +0000 UTC m=+67.731071413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-x8zvf" (UID: "e6b38a35-f491-4e16-ad59-3c8847af8951") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:15:33.366103 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:33.366014 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls podName:7ef74d92-a802-4a6d-adc9-362975dd5709 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:49.366009544 +0000 UTC m=+67.731092264 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls") pod "cluster-samples-operator-6748489656-2lp92" (UID: "7ef74d92-a802-4a6d-adc9-362975dd5709") : secret "samples-operator-tls" not found Jul 29 19:15:33.480130 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.480086 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-clw42" event={"ID":"10499a85-d107-4eec-90b3-f64c5bec55aa","Type":"ContainerStarted","Data":"42621ac581532f0f517a2568bf8295a447f8b75ff2a28638f304fb895ca6f03c"} Jul 29 19:15:33.480319 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.480147 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-clw42" event={"ID":"10499a85-d107-4eec-90b3-f64c5bec55aa","Type":"ContainerStarted","Data":"79b3e8b6abc9368181ffae940bf70a75ecc6b7467a7a8c3777cc9eb06dea65d7"} Jul 29 19:15:33.507041 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:33.506985 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-clw42" podStartSLOduration=1.506969476 podStartE2EDuration="1.506969476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:33.506576679 +0000 UTC m=+51.871659422" watchObservedRunningTime="2026-07-29 19:15:33.506969476 +0000 UTC m=+51.872052217" Jul 29 19:15:35.384805 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:35.384755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:35.385367 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:35.384878 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:15:35.385367 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:35.384927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:35.385367 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:35.384965 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:43.384945643 +0000 UTC m=+61.750028369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : secret "insights-runtime-extractor-tls" not found Jul 29 19:15:35.385596 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:35.385573 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:37.858771 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:37.858735 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:37.859228 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:37.858814 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:37.859228 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:37.859162 2574 scope.go:117] "RemoveContainer" containerID="295d4328f61ae30b4f306c4494b264514715cbd7d128d950a4d26295a46ff86d" Jul 29 19:15:38.499750 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:38.499720 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:15:38.499937 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:38.499768 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" event={"ID":"fa61cb03-3266-4e88-9397-623780de00ee","Type":"ContainerStarted","Data":"c6a292ef7db4e1b5fb4876555081619af50a0c1ef44fc6f83aa7f137a73fc3c5"} Jul 29 19:15:38.500047 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:38.500028 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:38.504536 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:38.504510 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" Jul 29 19:15:38.522646 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:38.522592 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-rbpfw" podStartSLOduration=26.698912513 podStartE2EDuration="34.522576389s" totalImagesPullingTime="7.823663876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:38.521578414 +0000 UTC m=+56.886661156" watchObservedRunningTime="2026-07-29 19:15:38.522576389 +0000 UTC m=+56.887659169" Jul 29 19:15:43.382752 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:43.382721 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25jbh" Jul 29 19:15:43.459704 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:43.459665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:43.459941 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:43.459840 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:15:43.459941 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:15:43.459938 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls podName:7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432 nodeName:}" failed. No retries permitted until 2026-07-29 19:15:59.459918075 +0000 UTC m=+77.825000812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjk6d" (UID: "7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432") : secret "insights-runtime-extractor-tls" not found Jul 29 19:15:46.893566 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:46.893513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:46.893566 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:46.893580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:46.896538 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:46.896519 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 19:15:46.897630 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:46.897615 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 19:15:46.906218 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:46.906196 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36553e39-8d4d-4d1e-a229-a6a76954d530-metrics-certs\") pod \"network-metrics-daemon-qltft\" (UID: \"36553e39-8d4d-4d1e-a229-a6a76954d530\") " pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:46.906313 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:46.906198 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6e0bc83-0390-42b7-8eae-4123ab6713b1-original-pull-secret\") pod \"global-pull-secret-syncer-82wbd\" (UID: \"d6e0bc83-0390-42b7-8eae-4123ab6713b1\") " pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:46.994304 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:46.994267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:46.996934 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:46.996910 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22csf\" (UniqueName: \"kubernetes.io/projected/c5cf409f-4504-45fb-a6e8-17f93defa81c-kube-api-access-22csf\") pod \"network-check-target-jjff7\" (UID: \"c5cf409f-4504-45fb-a6e8-17f93defa81c\") " pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:47.020582 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.020552 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhwzv\"" Jul 29 19:15:47.026169 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.026147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-82wbd" Jul 29 19:15:47.028268 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.028247 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:47.034944 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.034926 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8b4l\"" Jul 29 19:15:47.043190 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.043166 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qltft" Jul 29 19:15:47.191786 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.191756 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-82wbd"] Jul 29 19:15:47.198558 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:47.198498 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e0bc83_0390_42b7_8eae_4123ab6713b1.slice/crio-e2e8458484cc9bc913a1f9caa59257f648ce4ed07ece281d27b462d8e0f50883 WatchSource:0}: Error finding container e2e8458484cc9bc913a1f9caa59257f648ce4ed07ece281d27b462d8e0f50883: Status 404 returned error can't find the container with id e2e8458484cc9bc913a1f9caa59257f648ce4ed07ece281d27b462d8e0f50883 Jul 29 19:15:47.212186 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.212164 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jjff7"] Jul 29 19:15:47.215100 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:47.215074 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cf409f_4504_45fb_a6e8_17f93defa81c.slice/crio-87088c9c91e4fef699c9c900d2f123f7036c21454c6663f115fb10b6dfe36a9c WatchSource:0}: Error finding container 87088c9c91e4fef699c9c900d2f123f7036c21454c6663f115fb10b6dfe36a9c: Status 404 returned error can't find the container with id 87088c9c91e4fef699c9c900d2f123f7036c21454c6663f115fb10b6dfe36a9c Jul 29 19:15:47.238469 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.238446 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qltft"] Jul 29 19:15:47.240784 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:47.240760 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36553e39_8d4d_4d1e_a229_a6a76954d530.slice/crio-0ee53f98fa5030010b083d5849da3d00d3cd7a240bfa5199289bde81fa9b3e23 WatchSource:0}: Error finding container 0ee53f98fa5030010b083d5849da3d00d3cd7a240bfa5199289bde81fa9b3e23: Status 404 returned error can't find the container with id 0ee53f98fa5030010b083d5849da3d00d3cd7a240bfa5199289bde81fa9b3e23 Jul 29 19:15:47.532052 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.531950 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jjff7" event={"ID":"c5cf409f-4504-45fb-a6e8-17f93defa81c","Type":"ContainerStarted","Data":"f356e1b2f805bbf9997cdd69cd56e1327e45024905965f1889291ad1aff57ee0"} Jul 29 19:15:47.532052 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.532006 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jjff7" event={"ID":"c5cf409f-4504-45fb-a6e8-17f93defa81c","Type":"ContainerStarted","Data":"87088c9c91e4fef699c9c900d2f123f7036c21454c6663f115fb10b6dfe36a9c"} Jul 29 19:15:47.532052 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.532030 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:15:47.533190 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.533164 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qltft" event={"ID":"36553e39-8d4d-4d1e-a229-a6a76954d530","Type":"ContainerStarted","Data":"0ee53f98fa5030010b083d5849da3d00d3cd7a240bfa5199289bde81fa9b3e23"} Jul 29 19:15:47.534157 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.534126 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-82wbd" event={"ID":"d6e0bc83-0390-42b7-8eae-4123ab6713b1","Type":"ContainerStarted","Data":"e2e8458484cc9bc913a1f9caa59257f648ce4ed07ece281d27b462d8e0f50883"} Jul 29 19:15:47.553304 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:47.553256 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jjff7" podStartSLOduration=65.553239631 podStartE2EDuration="1m5.553239631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:47.552521644 +0000 UTC m=+65.917604387" watchObservedRunningTime="2026-07-29 19:15:47.553239631 +0000 UTC m=+65.918322372" Jul 29 19:15:48.540735 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:48.540642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qltft" event={"ID":"36553e39-8d4d-4d1e-a229-a6a76954d530","Type":"ContainerStarted","Data":"dba18a034f3fe38a95c0ee6d7b74c91606042310a587dc3f84ad67d20493e3cd"} Jul 29 19:15:48.540735 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:48.540693 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qltft" event={"ID":"36553e39-8d4d-4d1e-a229-a6a76954d530","Type":"ContainerStarted","Data":"ed7a89af96508e4dd799b1c058caa7925ab1d8d5c934fd2e9f5e6be93a7e1791"} Jul 29 19:15:48.563811 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:48.563761 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qltft" podStartSLOduration=65.556203541 podStartE2EDuration="1m6.563742623s" totalImagesPullingTime="1.007539082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:48.562200965 +0000 UTC m=+66.927283708" watchObservedRunningTime="2026-07-29 19:15:48.563742623 +0000 UTC m=+66.928825365" Jul 29 19:15:49.316598 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.316550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:49.319287 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.319251 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"image-registry-59c4ff5bc9-fjkhf\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:49.417552 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.417510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:49.417753 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.417568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:49.417753 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.417614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:49.417753 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.417654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:49.417753 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.417688 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:49.417753 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.417718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:49.418365 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.418334 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9004e-42d6-4e3e-b28d-c828d75884a5-service-ca-bundle\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:49.420934 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.420884 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66c6ea58-7211-44bf-9bd0-3baa37879269-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6b7zq\" (UID: \"66c6ea58-7211-44bf-9bd0-3baa37879269\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:49.421064 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.420949 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6b38a35-f491-4e16-ad59-3c8847af8951-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-x8zvf\" (UID: \"e6b38a35-f491-4e16-ad59-3c8847af8951\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:49.421064 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.421043 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41-metrics-tls\") pod \"dns-default-x9c5s\" (UID: \"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41\") " pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:49.421163 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.421098 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ef74d92-a802-4a6d-adc9-362975dd5709-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2lp92\" (UID: \"7ef74d92-a802-4a6d-adc9-362975dd5709\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:49.421509 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.421489 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da9004e-42d6-4e3e-b28d-c828d75884a5-metrics-certs\") pod \"router-default-6bfbd696bc-8jlrm\" (UID: \"8da9004e-42d6-4e3e-b28d-c828d75884a5\") " pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:49.543442 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.543409 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-82qj5\"" Jul 29 19:15:49.551044 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.551020 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:49.560333 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.560310 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kmzxk\"" Jul 29 19:15:49.567765 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.567697 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" Jul 29 19:15:49.584967 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.584947 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ntqt5\"" Jul 29 19:15:49.592331 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.592275 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" Jul 29 19:15:49.599694 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.599671 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4d6b5\"" Jul 29 19:15:49.607178 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.607125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:49.622661 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.622637 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ffrr\"" Jul 29 19:15:49.630348 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.630317 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:49.635461 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.635436 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qdgpx\"" Jul 29 19:15:49.643303 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.643130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" Jul 29 19:15:49.788319 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.787602 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c4ff5bc9-fjkhf"] Jul 29 19:15:49.810352 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:49.810308 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0622e6ea_39f7_490e_a205_cb92d450f100.slice/crio-291d3d17c804396476464385d7195183ec99faff15392e0531a4a358ca02eda5 WatchSource:0}: Error finding container 291d3d17c804396476464385d7195183ec99faff15392e0531a4a358ca02eda5: Status 404 returned error can't find the container with id 291d3d17c804396476464385d7195183ec99faff15392e0531a4a358ca02eda5 Jul 29 19:15:49.825964 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.825659 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf"] Jul 29 19:15:49.834755 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:49.834715 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b38a35_f491_4e16_ad59_3c8847af8951.slice/crio-e476e6a7c967fd30aab0f9f5b759e61f0cbaaba027152a4fb14b3fba6cebe116 WatchSource:0}: Error finding container e476e6a7c967fd30aab0f9f5b759e61f0cbaaba027152a4fb14b3fba6cebe116: Status 404 returned error can't find the container with id e476e6a7c967fd30aab0f9f5b759e61f0cbaaba027152a4fb14b3fba6cebe116 Jul 29 19:15:49.847650 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.847622 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92"] Jul 29 19:15:49.873327 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.871872 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bfbd696bc-8jlrm"] Jul 29 19:15:49.878212 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:49.878108 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da9004e_42d6_4e3e_b28d_c828d75884a5.slice/crio-f8ef914403a510e1bcc6bfbf003b8afaf5c953c6c38a52cd4f4c97ad932d2646 WatchSource:0}: Error finding container f8ef914403a510e1bcc6bfbf003b8afaf5c953c6c38a52cd4f4c97ad932d2646: Status 404 returned error can't find the container with id f8ef914403a510e1bcc6bfbf003b8afaf5c953c6c38a52cd4f4c97ad932d2646 Jul 29 19:15:49.906273 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.906188 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq"] Jul 29 19:15:49.910967 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:49.910933 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c6ea58_7211_44bf_9bd0_3baa37879269.slice/crio-695870efdbbfec221c768c8f958b487129d4fc64ff0e07007aa1d18a65fbdcb9 WatchSource:0}: Error finding container 695870efdbbfec221c768c8f958b487129d4fc64ff0e07007aa1d18a65fbdcb9: Status 404 returned error can't find the container with id 695870efdbbfec221c768c8f958b487129d4fc64ff0e07007aa1d18a65fbdcb9 Jul 29 19:15:49.926667 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:49.926642 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9c5s"] Jul 29 19:15:49.929784 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:49.929744 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a4ef84_8298_4de0_9e3a_dc7ca0d1ed41.slice/crio-0affbcce71cfa614d5acaa61590cd6a05ee8984f0f1db2321ebb77b3cf590d05 WatchSource:0}: Error finding container 0affbcce71cfa614d5acaa61590cd6a05ee8984f0f1db2321ebb77b3cf590d05: Status 404 returned error can't find the container with id 0affbcce71cfa614d5acaa61590cd6a05ee8984f0f1db2321ebb77b3cf590d05 Jul 29 19:15:50.551084 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.551042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" event={"ID":"8da9004e-42d6-4e3e-b28d-c828d75884a5","Type":"ContainerStarted","Data":"1790cfee4a40f0f10ebfb4cba63e511e19cd83979ac348f9c25cf3b561c90181"} Jul 29 19:15:50.551522 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.551102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" event={"ID":"8da9004e-42d6-4e3e-b28d-c828d75884a5","Type":"ContainerStarted","Data":"f8ef914403a510e1bcc6bfbf003b8afaf5c953c6c38a52cd4f4c97ad932d2646"} Jul 29 19:15:50.553947 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.553876 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9c5s" event={"ID":"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41","Type":"ContainerStarted","Data":"0affbcce71cfa614d5acaa61590cd6a05ee8984f0f1db2321ebb77b3cf590d05"} Jul 29 19:15:50.555354 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.555319 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" event={"ID":"7ef74d92-a802-4a6d-adc9-362975dd5709","Type":"ContainerStarted","Data":"0b8d5a199cfa37b1aae3d183a5f16a902543c6c6b86a9c9c12792d1ba381f8ac"} Jul 29 19:15:50.557665 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.557637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" event={"ID":"e6b38a35-f491-4e16-ad59-3c8847af8951","Type":"ContainerStarted","Data":"e476e6a7c967fd30aab0f9f5b759e61f0cbaaba027152a4fb14b3fba6cebe116"} Jul 29 19:15:50.559398 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.559328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" event={"ID":"66c6ea58-7211-44bf-9bd0-3baa37879269","Type":"ContainerStarted","Data":"695870efdbbfec221c768c8f958b487129d4fc64ff0e07007aa1d18a65fbdcb9"} Jul 29 19:15:50.561880 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.561258 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" event={"ID":"0622e6ea-39f7-490e-a205-cb92d450f100","Type":"ContainerStarted","Data":"e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694"} Jul 29 19:15:50.561880 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.561298 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" event={"ID":"0622e6ea-39f7-490e-a205-cb92d450f100","Type":"ContainerStarted","Data":"291d3d17c804396476464385d7195183ec99faff15392e0531a4a358ca02eda5"} Jul 29 19:15:50.561880 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.561841 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:15:50.579797 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.579006 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" podStartSLOduration=46.57898695 podStartE2EDuration="46.57898695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:50.577355378 +0000 UTC m=+68.942438133" watchObservedRunningTime="2026-07-29 19:15:50.57898695 +0000 UTC m=+68.944069670" Jul 29 19:15:50.608045 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.607967 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:50.610795 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.610766 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:50.642416 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:50.642367 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" podStartSLOduration=67.642348165 podStartE2EDuration="1m7.642348165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:50.606386453 +0000 UTC m=+68.971469390" watchObservedRunningTime="2026-07-29 19:15:50.642348165 +0000 UTC m=+69.007430906" Jul 29 19:15:51.484291 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.484253 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8"] Jul 29 19:15:51.486366 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.486346 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" Jul 29 19:15:51.505757 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.505732 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 19:15:51.506870 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.506463 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 19:15:51.506870 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.506465 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-q2mck\"" Jul 29 19:15:51.507610 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.507367 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 19:15:51.507930 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.507911 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 29 19:15:51.508853 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.508834 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj"] Jul 29 19:15:51.511026 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.511008 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq"] Jul 29 19:15:51.511146 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.511127 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.513259 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.513243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.513849 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.513817 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 29 19:15:51.522725 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.522674 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 29 19:15:51.523970 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.523207 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 29 19:15:51.523970 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.523407 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 29 19:15:51.524490 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.524326 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 29 19:15:51.541228 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.541191 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8"] Jul 29 19:15:51.544639 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.544610 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq"] Jul 29 19:15:51.544773 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.544666 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj"] Jul 29 19:15:51.559457 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.558235 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-7dm4z"] Jul 29 19:15:51.561407 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.560678 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-7dm4z" Jul 29 19:15:51.563815 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.563792 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 19:15:51.563955 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.563861 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 19:15:51.564262 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.564104 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7kjht\"" Jul 29 19:15:51.569933 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.569874 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:51.571235 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.571216 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bfbd696bc-8jlrm" Jul 29 19:15:51.576607 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.576585 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-7dm4z"] Jul 29 19:15:51.642630 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vv6s\" (UniqueName: \"kubernetes.io/projected/34883c53-b5b1-4ca5-9fb8-d7b4ab663f35-kube-api-access-9vv6s\") pod \"managed-serviceaccount-addon-agent-6c8b796d88-5xqg8\" (UID: \"34883c53-b5b1-4ca5-9fb8-d7b4ab663f35\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" Jul 29 19:15:51.642803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09abe488-cfba-4e3b-8693-b8f34c1f1a3a-tmp\") pod \"klusterlet-addon-workmgr-784848485-mvbhj\" (UID: \"09abe488-cfba-4e3b-8693-b8f34c1f1a3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.642803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-hub\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.642803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642735 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2stm5\" (UniqueName: \"kubernetes.io/projected/b1e22723-c03f-4f64-8c14-c2d8db850fe9-kube-api-access-2stm5\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.642962 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89lc2\" (UniqueName: \"kubernetes.io/projected/09abe488-cfba-4e3b-8693-b8f34c1f1a3a-kube-api-access-89lc2\") pod \"klusterlet-addon-workmgr-784848485-mvbhj\" (UID: \"09abe488-cfba-4e3b-8693-b8f34c1f1a3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.642962 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e22723-c03f-4f64-8c14-c2d8db850fe9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.642962 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642916 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34883c53-b5b1-4ca5-9fb8-d7b4ab663f35-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c8b796d88-5xqg8\" (UID: \"34883c53-b5b1-4ca5-9fb8-d7b4ab663f35\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" Jul 29 19:15:51.642962 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-ca\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.643119 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.643119 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.642999 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09abe488-cfba-4e3b-8693-b8f34c1f1a3a-klusterlet-config\") pod \"klusterlet-addon-workmgr-784848485-mvbhj\" (UID: \"09abe488-cfba-4e3b-8693-b8f34c1f1a3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.643119 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.643023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.643119 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.643064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxmjx\" (UniqueName: \"kubernetes.io/projected/fe09f2ee-bd85-4cef-91f9-60b4495b04ed-kube-api-access-hxmjx\") pod \"downloads-7c97dc4555-7dm4z\" (UID: \"fe09f2ee-bd85-4cef-91f9-60b4495b04ed\") " pod="openshift-console/downloads-7c97dc4555-7dm4z" Jul 29 19:15:51.743909 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.743810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2stm5\" (UniqueName: \"kubernetes.io/projected/b1e22723-c03f-4f64-8c14-c2d8db850fe9-kube-api-access-2stm5\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.743909 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.743879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89lc2\" (UniqueName: \"kubernetes.io/projected/09abe488-cfba-4e3b-8693-b8f34c1f1a3a-kube-api-access-89lc2\") pod \"klusterlet-addon-workmgr-784848485-mvbhj\" (UID: \"09abe488-cfba-4e3b-8693-b8f34c1f1a3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.744122 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.743932 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e22723-c03f-4f64-8c14-c2d8db850fe9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.744122 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.743959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34883c53-b5b1-4ca5-9fb8-d7b4ab663f35-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c8b796d88-5xqg8\" (UID: \"34883c53-b5b1-4ca5-9fb8-d7b4ab663f35\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" Jul 29 19:15:51.744122 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.743982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-ca\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.744122 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.744011 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.744122 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.744037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09abe488-cfba-4e3b-8693-b8f34c1f1a3a-klusterlet-config\") pod \"klusterlet-addon-workmgr-784848485-mvbhj\" (UID: \"09abe488-cfba-4e3b-8693-b8f34c1f1a3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.744122 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.744059 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.744122 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.744102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxmjx\" (UniqueName: \"kubernetes.io/projected/fe09f2ee-bd85-4cef-91f9-60b4495b04ed-kube-api-access-hxmjx\") pod \"downloads-7c97dc4555-7dm4z\" (UID: \"fe09f2ee-bd85-4cef-91f9-60b4495b04ed\") " pod="openshift-console/downloads-7c97dc4555-7dm4z" Jul 29 19:15:51.744925 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.744167 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vv6s\" (UniqueName: \"kubernetes.io/projected/34883c53-b5b1-4ca5-9fb8-d7b4ab663f35-kube-api-access-9vv6s\") pod \"managed-serviceaccount-addon-agent-6c8b796d88-5xqg8\" (UID: \"34883c53-b5b1-4ca5-9fb8-d7b4ab663f35\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" Jul 29 19:15:51.744925 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.744200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09abe488-cfba-4e3b-8693-b8f34c1f1a3a-tmp\") pod \"klusterlet-addon-workmgr-784848485-mvbhj\" (UID: \"09abe488-cfba-4e3b-8693-b8f34c1f1a3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.744925 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.744222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-hub\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.744925 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.744839 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e22723-c03f-4f64-8c14-c2d8db850fe9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.745128 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.744964 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09abe488-cfba-4e3b-8693-b8f34c1f1a3a-tmp\") pod \"klusterlet-addon-workmgr-784848485-mvbhj\" (UID: \"09abe488-cfba-4e3b-8693-b8f34c1f1a3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.748045 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.748017 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09abe488-cfba-4e3b-8693-b8f34c1f1a3a-klusterlet-config\") pod \"klusterlet-addon-workmgr-784848485-mvbhj\" (UID: \"09abe488-cfba-4e3b-8693-b8f34c1f1a3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.748045 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.748031 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-hub\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.748220 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.748178 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.748278 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.748245 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.749236 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.749213 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34883c53-b5b1-4ca5-9fb8-d7b4ab663f35-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c8b796d88-5xqg8\" (UID: \"34883c53-b5b1-4ca5-9fb8-d7b4ab663f35\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" Jul 29 19:15:51.749563 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.749545 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1e22723-c03f-4f64-8c14-c2d8db850fe9-ca\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.762983 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.762925 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxmjx\" (UniqueName: \"kubernetes.io/projected/fe09f2ee-bd85-4cef-91f9-60b4495b04ed-kube-api-access-hxmjx\") pod \"downloads-7c97dc4555-7dm4z\" (UID: \"fe09f2ee-bd85-4cef-91f9-60b4495b04ed\") " pod="openshift-console/downloads-7c97dc4555-7dm4z" Jul 29 19:15:51.764186 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.764138 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89lc2\" (UniqueName: \"kubernetes.io/projected/09abe488-cfba-4e3b-8693-b8f34c1f1a3a-kube-api-access-89lc2\") pod \"klusterlet-addon-workmgr-784848485-mvbhj\" (UID: \"09abe488-cfba-4e3b-8693-b8f34c1f1a3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.764710 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.764687 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2stm5\" (UniqueName: \"kubernetes.io/projected/b1e22723-c03f-4f64-8c14-c2d8db850fe9-kube-api-access-2stm5\") pod \"cluster-proxy-proxy-agent-5fd667cdcc-5n9dq\" (UID: \"b1e22723-c03f-4f64-8c14-c2d8db850fe9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.767178 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.766718 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vv6s\" (UniqueName: \"kubernetes.io/projected/34883c53-b5b1-4ca5-9fb8-d7b4ab663f35-kube-api-access-9vv6s\") pod \"managed-serviceaccount-addon-agent-6c8b796d88-5xqg8\" (UID: \"34883c53-b5b1-4ca5-9fb8-d7b4ab663f35\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" Jul 29 19:15:51.807587 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.807551 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" Jul 29 19:15:51.827595 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.827564 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:15:51.836618 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.836591 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" Jul 29 19:15:51.885063 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:51.885015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-7dm4z" Jul 29 19:15:53.543955 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:53.543929 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8"] Jul 29 19:15:54.145288 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:54.145249 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34883c53_b5b1_4ca5_9fb8_d7b4ab663f35.slice/crio-9b8b51f4382b6797e832c1a846d4d2930a26303d4cd0ab62ff858227ec994284 WatchSource:0}: Error finding container 9b8b51f4382b6797e832c1a846d4d2930a26303d4cd0ab62ff858227ec994284: Status 404 returned error can't find the container with id 9b8b51f4382b6797e832c1a846d4d2930a26303d4cd0ab62ff858227ec994284 Jul 29 19:15:54.318043 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.314425 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj"] Jul 29 19:15:54.333448 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:54.333411 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09abe488_cfba_4e3b_8693_b8f34c1f1a3a.slice/crio-6eb1b239c3b1254e8b6d73d5cd960669b9cb08bad1bde0aa48b7051af260c19b WatchSource:0}: Error finding container 6eb1b239c3b1254e8b6d73d5cd960669b9cb08bad1bde0aa48b7051af260c19b: Status 404 returned error can't find the container with id 6eb1b239c3b1254e8b6d73d5cd960669b9cb08bad1bde0aa48b7051af260c19b Jul 29 19:15:54.337670 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.337598 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq"] Jul 29 19:15:54.375351 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.375304 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-7dm4z"] Jul 29 19:15:54.378219 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:54.377753 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe09f2ee_bd85_4cef_91f9_60b4495b04ed.slice/crio-ba28e2f13d19a84960276d69b166a466238e56f9ab51bf80bd169105f00bf66a WatchSource:0}: Error finding container ba28e2f13d19a84960276d69b166a466238e56f9ab51bf80bd169105f00bf66a: Status 404 returned error can't find the container with id ba28e2f13d19a84960276d69b166a466238e56f9ab51bf80bd169105f00bf66a Jul 29 19:15:54.585183 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.585146 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-82wbd" event={"ID":"d6e0bc83-0390-42b7-8eae-4123ab6713b1","Type":"ContainerStarted","Data":"80522f3fb42391e5aa40e125dae6b464bce464cfdefef05bee6ddd358a9f31cd"} Jul 29 19:15:54.587639 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.587583 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" event={"ID":"7ef74d92-a802-4a6d-adc9-362975dd5709","Type":"ContainerStarted","Data":"96df168a813daded206e654d6fbd2935a666932bda877a9021d5e3f0ce831e1e"} Jul 29 19:15:54.587639 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.587626 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" event={"ID":"7ef74d92-a802-4a6d-adc9-362975dd5709","Type":"ContainerStarted","Data":"4e2fa073c73ee92b8cb5cb3e9174beba19e45964b7098a1f3a5ee1a605263b99"} Jul 29 19:15:54.589806 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.589427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" event={"ID":"e6b38a35-f491-4e16-ad59-3c8847af8951","Type":"ContainerStarted","Data":"7d4cadf9b4572caaa5d1481c96f47ab88fc2b8a4110f6f77c9de51dce67adc2a"} Jul 29 19:15:54.590784 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.590758 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" event={"ID":"b1e22723-c03f-4f64-8c14-c2d8db850fe9","Type":"ContainerStarted","Data":"11f1ff8caea91a02ba916ca6329663b9970839862786df6e043232fdf2f684f5"} Jul 29 19:15:54.591928 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.591881 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" event={"ID":"66c6ea58-7211-44bf-9bd0-3baa37879269","Type":"ContainerStarted","Data":"ebfbece834b49cdc66297a5bed1ab523e0f8c1e57ab173b9e1d86f09294e3548"} Jul 29 19:15:54.593429 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.593370 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-7dm4z" event={"ID":"fe09f2ee-bd85-4cef-91f9-60b4495b04ed","Type":"ContainerStarted","Data":"ba28e2f13d19a84960276d69b166a466238e56f9ab51bf80bd169105f00bf66a"} Jul 29 19:15:54.595270 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.595045 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" event={"ID":"09abe488-cfba-4e3b-8693-b8f34c1f1a3a","Type":"ContainerStarted","Data":"6eb1b239c3b1254e8b6d73d5cd960669b9cb08bad1bde0aa48b7051af260c19b"} Jul 29 19:15:54.597855 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.597272 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9c5s" event={"ID":"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41","Type":"ContainerStarted","Data":"d6181f20cd207d6e0fad36ac1c42472c6d0929050069a98a41d16cc576ddc671"} Jul 29 19:15:54.597855 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.597317 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9c5s" event={"ID":"f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41","Type":"ContainerStarted","Data":"8a93b183eece065aa5bc17fabb311e319f5196d395dbc6047802b833b6c7a024"} Jul 29 19:15:54.597855 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.597810 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x9c5s" Jul 29 19:15:54.599244 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.599202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" event={"ID":"34883c53-b5b1-4ca5-9fb8-d7b4ab663f35","Type":"ContainerStarted","Data":"9b8b51f4382b6797e832c1a846d4d2930a26303d4cd0ab62ff858227ec994284"} Jul 29 19:15:54.612043 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.611993 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-82wbd" podStartSLOduration=65.433236981 podStartE2EDuration="1m11.611975627s" totalImagesPullingTime="6.178738646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:54.610437182 +0000 UTC m=+72.975519919" watchObservedRunningTime="2026-07-29 19:15:54.611975627 +0000 UTC m=+72.977058370" Jul 29 19:15:54.636568 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.636516 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-x8zvf" podStartSLOduration=46.255727741 podStartE2EDuration="50.636499696s" totalImagesPullingTime="4.380771955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:54.635751178 +0000 UTC m=+73.000833919" watchObservedRunningTime="2026-07-29 19:15:54.636499696 +0000 UTC m=+73.001582459" Jul 29 19:15:54.670602 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.670497 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6b7zq" podStartSLOduration=35.359797524 podStartE2EDuration="39.670480346s" totalImagesPullingTime="4.310682822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:54.669784051 +0000 UTC m=+73.034866792" watchObservedRunningTime="2026-07-29 19:15:54.670480346 +0000 UTC m=+73.035563067" Jul 29 19:15:54.692557 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.692496 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2lp92" podStartSLOduration=46.399998011 podStartE2EDuration="50.692478864s" totalImagesPullingTime="4.292480853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:54.690612687 +0000 UTC m=+73.055695429" watchObservedRunningTime="2026-07-29 19:15:54.692478864 +0000 UTC m=+73.057561605" Jul 29 19:15:54.717415 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.716848 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x9c5s" podStartSLOduration=33.433998881 podStartE2EDuration="37.716825401s" totalImagesPullingTime="4.28282652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:54.715758363 +0000 UTC m=+73.080841108" watchObservedRunningTime="2026-07-29 19:15:54.716825401 +0000 UTC m=+73.081908147" Jul 29 19:15:54.847447 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.847400 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v"] Jul 29 19:15:54.850752 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.850731 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" Jul 29 19:15:54.854034 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.854011 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 19:15:54.854034 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.854027 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mvflm\"" Jul 29 19:15:54.870958 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.870930 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v"] Jul 29 19:15:54.979933 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:54.979802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/efcdd686-3730-4f0a-a4e5-ed7b5ee6a578-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-x2v6v\" (UID: \"efcdd686-3730-4f0a-a4e5-ed7b5ee6a578\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" Jul 29 19:15:55.080511 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:55.080465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/efcdd686-3730-4f0a-a4e5-ed7b5ee6a578-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-x2v6v\" (UID: \"efcdd686-3730-4f0a-a4e5-ed7b5ee6a578\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" Jul 29 19:15:55.083110 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:55.083086 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/efcdd686-3730-4f0a-a4e5-ed7b5ee6a578-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-x2v6v\" (UID: \"efcdd686-3730-4f0a-a4e5-ed7b5ee6a578\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" Jul 29 19:15:55.161575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:55.161536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" Jul 29 19:15:55.347050 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:55.346884 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v"] Jul 29 19:15:55.350680 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:15:55.350639 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefcdd686_3730_4f0a_a4e5_ed7b5ee6a578.slice/crio-65520dfae0ff991329084ae1fc4b450751638cc8f16981e10e6698856075b9fe WatchSource:0}: Error finding container 65520dfae0ff991329084ae1fc4b450751638cc8f16981e10e6698856075b9fe: Status 404 returned error can't find the container with id 65520dfae0ff991329084ae1fc4b450751638cc8f16981e10e6698856075b9fe Jul 29 19:15:55.606918 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:55.606677 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" event={"ID":"efcdd686-3730-4f0a-a4e5-ed7b5ee6a578","Type":"ContainerStarted","Data":"65520dfae0ff991329084ae1fc4b450751638cc8f16981e10e6698856075b9fe"} Jul 29 19:15:56.791876 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.791839 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-698bf56c74-9przp"] Jul 29 19:15:56.802061 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.802028 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:56.809944 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.808947 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-698bf56c74-9przp"] Jul 29 19:15:56.809944 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.809129 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 19:15:56.809944 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.809457 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 19:15:56.812292 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.810580 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hktpp\"" Jul 29 19:15:56.812292 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.810832 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 19:15:56.812292 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.811093 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 19:15:56.812292 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.811288 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 19:15:56.902460 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.902386 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-oauth-config\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:56.902460 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.902451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-service-ca\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:56.902774 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.902493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-oauth-serving-cert\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:56.902774 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.902553 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx2p6\" (UniqueName: \"kubernetes.io/projected/3aed8102-ed3d-4232-8777-c2187cb701df-kube-api-access-xx2p6\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:56.902774 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.902602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-serving-cert\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:56.902774 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:56.902625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-console-config\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.003825 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.003779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-serving-cert\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.004012 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.003835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-console-config\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.004012 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.003905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-oauth-config\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.004012 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.003943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-service-ca\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.004012 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.003981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-oauth-serving-cert\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.004239 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.004038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx2p6\" (UniqueName: \"kubernetes.io/projected/3aed8102-ed3d-4232-8777-c2187cb701df-kube-api-access-xx2p6\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.006598 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.005372 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-console-config\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.006598 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.005962 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-service-ca\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.006598 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.006523 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-oauth-serving-cert\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.019413 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.017913 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-oauth-config\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.019413 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.018060 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-serving-cert\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.032732 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.032701 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx2p6\" (UniqueName: \"kubernetes.io/projected/3aed8102-ed3d-4232-8777-c2187cb701df-kube-api-access-xx2p6\") pod \"console-698bf56c74-9przp\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:57.125936 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:57.125698 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:15:59.531170 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:59.531129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:59.533984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:59.533963 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjk6d\" (UID: \"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432\") " pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:15:59.802089 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:59.802002 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7r8x\"" Jul 29 19:15:59.809829 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:15:59.809581 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjk6d" Jul 29 19:16:03.384883 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.384807 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-698bf56c74-9przp"] Jul 29 19:16:03.389186 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:16:03.389128 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aed8102_ed3d_4232_8777_c2187cb701df.slice/crio-388f6bea32634e7a06cb19c7be6ea3edd75cbf7f94db2ab4226c6adf4dd39dab WatchSource:0}: Error finding container 388f6bea32634e7a06cb19c7be6ea3edd75cbf7f94db2ab4226c6adf4dd39dab: Status 404 returned error can't find the container with id 388f6bea32634e7a06cb19c7be6ea3edd75cbf7f94db2ab4226c6adf4dd39dab Jul 29 19:16:03.414061 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.413969 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjk6d"] Jul 29 19:16:03.419451 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:16:03.419370 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a62ef6a_b0d8_4a3d_ac89_5e55ac2ff432.slice/crio-0bce5e2d2261399ea85c5a5e1f4457b1d546154a985ee977794d5cca57716521 WatchSource:0}: Error finding container 0bce5e2d2261399ea85c5a5e1f4457b1d546154a985ee977794d5cca57716521: Status 404 returned error can't find the container with id 0bce5e2d2261399ea85c5a5e1f4457b1d546154a985ee977794d5cca57716521 Jul 29 19:16:03.651338 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.651297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjk6d" event={"ID":"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432","Type":"ContainerStarted","Data":"0bce5e2d2261399ea85c5a5e1f4457b1d546154a985ee977794d5cca57716521"} Jul 29 19:16:03.653129 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.653086 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" event={"ID":"09abe488-cfba-4e3b-8693-b8f34c1f1a3a","Type":"ContainerStarted","Data":"71161e2cbe13dbe429a4252786bad123cc58494d4cca28c04504da6643dfe017"} Jul 29 19:16:03.653283 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.653229 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:16:03.655124 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.655098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" event={"ID":"34883c53-b5b1-4ca5-9fb8-d7b4ab663f35","Type":"ContainerStarted","Data":"29aa0a5ce63acf5a82fd6512287121580bc0b4b53c1eddfba44f3948e19ee0cf"} Jul 29 19:16:03.655233 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.655190 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" Jul 29 19:16:03.656663 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.656638 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" event={"ID":"efcdd686-3730-4f0a-a4e5-ed7b5ee6a578","Type":"ContainerStarted","Data":"8731009008cd1e6e8a13cffc37392355a07d2574e79f87e30668ca1d137de3cc"} Jul 29 19:16:03.657284 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.657266 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" Jul 29 19:16:03.658558 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.658515 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698bf56c74-9przp" event={"ID":"3aed8102-ed3d-4232-8777-c2187cb701df","Type":"ContainerStarted","Data":"388f6bea32634e7a06cb19c7be6ea3edd75cbf7f94db2ab4226c6adf4dd39dab"} Jul 29 19:16:03.660809 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.660787 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" event={"ID":"b1e22723-c03f-4f64-8c14-c2d8db850fe9","Type":"ContainerStarted","Data":"8ac41c4694c67dc5605f850bf595dc5cff69dbe3f9ef657c93d972f749f7d038"} Jul 29 19:16:03.660948 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.660823 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" event={"ID":"b1e22723-c03f-4f64-8c14-c2d8db850fe9","Type":"ContainerStarted","Data":"e8447aaaf65b5470df2b140774c3690f805a38c8e9156ebd03be6982e24f950c"} Jul 29 19:16:03.660948 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.660843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" event={"ID":"b1e22723-c03f-4f64-8c14-c2d8db850fe9","Type":"ContainerStarted","Data":"d4db6d318b3b59a0adda86ed7cb5fc09be0fa4ccfda908af887d7f85f7620d21"} Jul 29 19:16:03.663085 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.663053 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" Jul 29 19:16:03.678258 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.678138 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784848485-mvbhj" podStartSLOduration=3.804554029 podStartE2EDuration="12.67809692s" totalImagesPullingTime="8.873542891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:03.677751757 +0000 UTC m=+82.042834501" watchObservedRunningTime="2026-07-29 19:16:03.67809692 +0000 UTC m=+82.043179658" Jul 29 19:16:03.725246 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.725174 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8b796d88-5xqg8" podStartSLOduration=3.706713965 podStartE2EDuration="12.725153041s" totalImagesPullingTime="9.018439076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:03.723795266 +0000 UTC m=+82.088878030" watchObservedRunningTime="2026-07-29 19:16:03.725153041 +0000 UTC m=+82.090235782" Jul 29 19:16:03.745993 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.745928 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd667cdcc-5n9dq" podStartSLOduration=3.906273712 podStartE2EDuration="12.745878674s" totalImagesPullingTime="8.839604962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:03.744323709 +0000 UTC m=+82.109406453" watchObservedRunningTime="2026-07-29 19:16:03.745878674 +0000 UTC m=+82.110961416" Jul 29 19:16:03.772505 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:03.772440 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x2v6v" podStartSLOduration=1.93114909 podStartE2EDuration="9.772417219s" totalImagesPullingTime="7.841268129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:03.770987138 +0000 UTC m=+82.136069878" watchObservedRunningTime="2026-07-29 19:16:03.772417219 +0000 UTC m=+82.137499963" Jul 29 19:16:05.616475 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:05.616437 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x9c5s" Jul 29 19:16:09.556883 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:09.556836 2574 patch_prober.go:28] interesting pod/image-registry-59c4ff5bc9-fjkhf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 29 19:16:09.557430 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:09.556947 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" podUID="0622e6ea-39f7-490e-a205-cb92d450f100" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 19:16:11.379041 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.379003 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7cbzj"] Jul 29 19:16:11.431799 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.431471 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.434766 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.434739 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 19:16:11.435097 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.435079 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 19:16:11.436002 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.435729 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 19:16:11.436002 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.435752 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 19:16:11.436002 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.435759 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wq7jd\"" Jul 29 19:16:11.450127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.449645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-textfile\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.450127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.449691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c5638-318c-44af-9e3a-d7912dc2e63b-metrics-client-ca\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.450127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.449753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-accelerators-collector-config\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.450127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.449783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-wtmp\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.450127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.449830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzxhx\" (UniqueName: \"kubernetes.io/projected/6f2c5638-318c-44af-9e3a-d7912dc2e63b-kube-api-access-bzxhx\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.450127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.449849 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f2c5638-318c-44af-9e3a-d7912dc2e63b-sys\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.450127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.449881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f2c5638-318c-44af-9e3a-d7912dc2e63b-root\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.450127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.449934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-tls\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.450127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.449971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.550751 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.550707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-textfile\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.550751 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.550745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c5638-318c-44af-9e3a-d7912dc2e63b-metrics-client-ca\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551033 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.550788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-accelerators-collector-config\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551033 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.550813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-wtmp\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551033 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.550847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzxhx\" (UniqueName: \"kubernetes.io/projected/6f2c5638-318c-44af-9e3a-d7912dc2e63b-kube-api-access-bzxhx\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551033 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.550870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f2c5638-318c-44af-9e3a-d7912dc2e63b-sys\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551033 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.550918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f2c5638-318c-44af-9e3a-d7912dc2e63b-root\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551033 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.550941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-tls\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551033 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.550969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551359 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.551119 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-textfile\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551614 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.551490 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-wtmp\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551614 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.551508 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-accelerators-collector-config\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551614 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.551536 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f2c5638-318c-44af-9e3a-d7912dc2e63b-root\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551614 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.551573 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f2c5638-318c-44af-9e3a-d7912dc2e63b-sys\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.551614 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:16:11.551607 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 19:16:11.552098 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:16:11.551663 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-tls podName:6f2c5638-318c-44af-9e3a-d7912dc2e63b nodeName:}" failed. No retries permitted until 2026-07-29 19:16:12.05164385 +0000 UTC m=+90.416726607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-tls") pod "node-exporter-7cbzj" (UID: "6f2c5638-318c-44af-9e3a-d7912dc2e63b") : secret "node-exporter-tls" not found Jul 29 19:16:11.552098 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.551965 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c5638-318c-44af-9e3a-d7912dc2e63b-metrics-client-ca\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.553866 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.553838 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:11.562767 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:11.562731 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzxhx\" (UniqueName: \"kubernetes.io/projected/6f2c5638-318c-44af-9e3a-d7912dc2e63b-kube-api-access-bzxhx\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:12.055914 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:12.055842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-tls\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:12.058779 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:12.058739 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f2c5638-318c-44af-9e3a-d7912dc2e63b-node-exporter-tls\") pod \"node-exporter-7cbzj\" (UID: \"6f2c5638-318c-44af-9e3a-d7912dc2e63b\") " pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:12.345456 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:12.345419 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7cbzj" Jul 29 19:16:12.580252 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:12.580221 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:16:16.105134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:16.105100 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-698bf56c74-9przp"] Jul 29 19:16:17.990681 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:16:17.990638 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2c5638_318c_44af_9e3a_d7912dc2e63b.slice/crio-618704940da667b644d77f7b19190083c7f1bf0f27b153d16fe374cf1c96c615 WatchSource:0}: Error finding container 618704940da667b644d77f7b19190083c7f1bf0f27b153d16fe374cf1c96c615: Status 404 returned error can't find the container with id 618704940da667b644d77f7b19190083c7f1bf0f27b153d16fe374cf1c96c615 Jul 29 19:16:18.544328 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:18.544248 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jjff7" Jul 29 19:16:18.747260 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:18.746910 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698bf56c74-9przp" event={"ID":"3aed8102-ed3d-4232-8777-c2187cb701df","Type":"ContainerStarted","Data":"0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468"} Jul 29 19:16:18.749110 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:18.749075 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7cbzj" event={"ID":"6f2c5638-318c-44af-9e3a-d7912dc2e63b","Type":"ContainerStarted","Data":"618704940da667b644d77f7b19190083c7f1bf0f27b153d16fe374cf1c96c615"} Jul 29 19:16:18.750949 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:18.750874 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjk6d" event={"ID":"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432","Type":"ContainerStarted","Data":"e440688960353994f113943f2c872a91bf1384cb0b75226c586094dcf293ef3b"} Jul 29 19:16:18.753764 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:18.752800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-7dm4z" event={"ID":"fe09f2ee-bd85-4cef-91f9-60b4495b04ed","Type":"ContainerStarted","Data":"158b4b9963b21a0cbf1c9a8bec8b437c3a6f884326dc115845f10da5cce535db"} Jul 29 19:16:18.753764 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:18.753723 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-7dm4z" Jul 29 19:16:18.772323 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:18.772286 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-7dm4z" Jul 29 19:16:18.777206 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:18.777148 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-698bf56c74-9przp" podStartSLOduration=8.183135156 podStartE2EDuration="22.777126203s" totalImagesPullingTime="14.593991047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:18.776111981 +0000 UTC m=+97.141194722" watchObservedRunningTime="2026-07-29 19:16:18.777126203 +0000 UTC m=+97.142208946" Jul 29 19:16:18.800125 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:18.800031 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-7dm4z" podStartSLOduration=4.143053952 podStartE2EDuration="27.800016243s" totalImagesPullingTime="23.656962291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:18.797584955 +0000 UTC m=+97.162667698" watchObservedRunningTime="2026-07-29 19:16:18.800016243 +0000 UTC m=+97.165098985" Jul 29 19:16:19.001078 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:19.001039 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59c4ff5bc9-fjkhf"] Jul 29 19:16:20.766613 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:20.766535 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7cbzj" event={"ID":"6f2c5638-318c-44af-9e3a-d7912dc2e63b","Type":"ContainerStarted","Data":"da46453a82a6b5c78219d34f68f906e5dca359dbde85c8a4dc300116453f17e6"} Jul 29 19:16:23.785097 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:23.785053 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f2c5638-318c-44af-9e3a-d7912dc2e63b" containerID="da46453a82a6b5c78219d34f68f906e5dca359dbde85c8a4dc300116453f17e6" exitCode=0 Jul 29 19:16:23.785570 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:23.785143 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7cbzj" event={"ID":"6f2c5638-318c-44af-9e3a-d7912dc2e63b","Type":"ContainerDied","Data":"da46453a82a6b5c78219d34f68f906e5dca359dbde85c8a4dc300116453f17e6"} Jul 29 19:16:24.792863 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:24.792824 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7cbzj" event={"ID":"6f2c5638-318c-44af-9e3a-d7912dc2e63b","Type":"ContainerStarted","Data":"476a50ca08062493490a47c62dc40429f4dfbb261943f9896c4a90a614eea07d"} Jul 29 19:16:24.793370 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:24.792969 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7cbzj" event={"ID":"6f2c5638-318c-44af-9e3a-d7912dc2e63b","Type":"ContainerStarted","Data":"62d5fe1e0390c2cd00c2a097c9301f5bcb61989d791b0e1608c696b7d95dc1e5"} Jul 29 19:16:24.795012 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:24.794987 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjk6d" event={"ID":"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432","Type":"ContainerStarted","Data":"d511ca9ad9b0016c1d543ca1d3f927fe62621e2a16418cf2d642c4336b8ecd58"} Jul 29 19:16:24.815600 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:24.815530 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7cbzj" podStartSLOduration=11.191132534 podStartE2EDuration="13.815509872s" totalImagesPullingTime="2.52170016s" totalInitContainerRuntime="102.677178ms" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:24.815372368 +0000 UTC m=+103.180455111" watchObservedRunningTime="2026-07-29 19:16:24.815509872 +0000 UTC m=+103.180592616" Jul 29 19:16:27.126439 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:27.126400 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:16:29.820744 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:29.820655 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjk6d" event={"ID":"7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432","Type":"ContainerStarted","Data":"869af060cfa536d2faaeed713f1c6b29ed809e2262d6d9475909ea28137c9191"} Jul 29 19:16:29.857116 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:29.857060 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cjk6d" podStartSLOduration=37.154164403 podStartE2EDuration="1m2.857043007s" totalImagesPullingTime="25.702878604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:15:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:29.855207817 +0000 UTC m=+108.220290560" watchObservedRunningTime="2026-07-29 19:16:29.857043007 +0000 UTC m=+108.222125749" Jul 29 19:16:37.859697 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:37.859662 2574 generic.go:356] "Generic (PLEG): container finished" podID="1940e899-f629-405a-9765-aee5aeb94f1f" containerID="0812ba8d0e7333648e698d780e363a941abadaedd30b18bde1772a722828ab5d" exitCode=0 Jul 29 19:16:37.860163 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:37.859740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" event={"ID":"1940e899-f629-405a-9765-aee5aeb94f1f","Type":"ContainerDied","Data":"0812ba8d0e7333648e698d780e363a941abadaedd30b18bde1772a722828ab5d"} Jul 29 19:16:37.860163 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:37.860102 2574 scope.go:117] "RemoveContainer" containerID="0812ba8d0e7333648e698d780e363a941abadaedd30b18bde1772a722828ab5d" Jul 29 19:16:38.864949 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:38.864920 2574 generic.go:356] "Generic (PLEG): container finished" podID="599add3b-5995-4c28-b799-4b19e10992d6" containerID="2efed19f1a2da86fd4bb0599729569930aacdfa8d9764912eff175de3d8222d6" exitCode=0 Jul 29 19:16:38.865381 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:38.865000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" event={"ID":"599add3b-5995-4c28-b799-4b19e10992d6","Type":"ContainerDied","Data":"2efed19f1a2da86fd4bb0599729569930aacdfa8d9764912eff175de3d8222d6"} Jul 29 19:16:38.865381 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:38.865336 2574 scope.go:117] "RemoveContainer" containerID="2efed19f1a2da86fd4bb0599729569930aacdfa8d9764912eff175de3d8222d6" Jul 29 19:16:38.866849 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:38.866822 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t" event={"ID":"1940e899-f629-405a-9765-aee5aeb94f1f","Type":"ContainerStarted","Data":"26e3fc0bedbcb5f46f2dbc088076c38a2a32d2014dcc5164a2d3b64a052581a8"} Jul 29 19:16:39.872670 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:39.872636 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kscw2" event={"ID":"599add3b-5995-4c28-b799-4b19e10992d6","Type":"ContainerStarted","Data":"89773aef6f3ec8c235576c3ce3c71c3015cae242056a62a1b6b614ec6f8168f7"} Jul 29 19:16:43.776711 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:43.776633 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-698bf56c74-9przp" podUID="3aed8102-ed3d-4232-8777-c2187cb701df" containerName="console" containerID="cri-o://0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468" gracePeriod=15 Jul 29 19:16:44.040394 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.040357 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" podUID="0622e6ea-39f7-490e-a205-cb92d450f100" containerName="registry" containerID="cri-o://e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694" gracePeriod=30 Jul 29 19:16:44.061527 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.061502 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:16:44.162296 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.162266 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-serving-cert\") pod \"3aed8102-ed3d-4232-8777-c2187cb701df\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " Jul 29 19:16:44.162462 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.162314 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx2p6\" (UniqueName: \"kubernetes.io/projected/3aed8102-ed3d-4232-8777-c2187cb701df-kube-api-access-xx2p6\") pod \"3aed8102-ed3d-4232-8777-c2187cb701df\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " Jul 29 19:16:44.162462 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.162396 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-service-ca\") pod \"3aed8102-ed3d-4232-8777-c2187cb701df\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " Jul 29 19:16:44.162462 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.162419 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-oauth-serving-cert\") pod \"3aed8102-ed3d-4232-8777-c2187cb701df\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " Jul 29 19:16:44.162462 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.162443 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-console-config\") pod \"3aed8102-ed3d-4232-8777-c2187cb701df\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " Jul 29 19:16:44.162462 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.162463 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-oauth-config\") pod \"3aed8102-ed3d-4232-8777-c2187cb701df\" (UID: \"3aed8102-ed3d-4232-8777-c2187cb701df\") " Jul 29 19:16:44.162845 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.162814 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3aed8102-ed3d-4232-8777-c2187cb701df" (UID: "3aed8102-ed3d-4232-8777-c2187cb701df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:16:44.162943 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.162831 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-service-ca" (OuterVolumeSpecName: "service-ca") pod "3aed8102-ed3d-4232-8777-c2187cb701df" (UID: "3aed8102-ed3d-4232-8777-c2187cb701df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:16:44.162943 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.162878 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-console-config" (OuterVolumeSpecName: "console-config") pod "3aed8102-ed3d-4232-8777-c2187cb701df" (UID: "3aed8102-ed3d-4232-8777-c2187cb701df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:16:44.164609 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.164580 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3aed8102-ed3d-4232-8777-c2187cb701df" (UID: "3aed8102-ed3d-4232-8777-c2187cb701df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 19:16:44.164705 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.164602 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3aed8102-ed3d-4232-8777-c2187cb701df" (UID: "3aed8102-ed3d-4232-8777-c2187cb701df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 19:16:44.164705 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.164620 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aed8102-ed3d-4232-8777-c2187cb701df-kube-api-access-xx2p6" (OuterVolumeSpecName: "kube-api-access-xx2p6") pod "3aed8102-ed3d-4232-8777-c2187cb701df" (UID: "3aed8102-ed3d-4232-8777-c2187cb701df"). InnerVolumeSpecName "kube-api-access-xx2p6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:16:44.263463 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.263431 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-service-ca\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.263463 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.263460 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-oauth-serving-cert\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.263463 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.263469 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aed8102-ed3d-4232-8777-c2187cb701df-console-config\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.263662 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.263477 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-oauth-config\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.263662 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.263488 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aed8102-ed3d-4232-8777-c2187cb701df-console-serving-cert\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.263662 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.263497 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx2p6\" (UniqueName: \"kubernetes.io/projected/3aed8102-ed3d-4232-8777-c2187cb701df-kube-api-access-xx2p6\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.328571 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.328544 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:16:44.465353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.465315 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-image-registry-private-configuration\") pod \"0622e6ea-39f7-490e-a205-cb92d450f100\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " Jul 29 19:16:44.465353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.465360 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-bound-sa-token\") pod \"0622e6ea-39f7-490e-a205-cb92d450f100\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " Jul 29 19:16:44.465599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.465387 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrhff\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-kube-api-access-jrhff\") pod \"0622e6ea-39f7-490e-a205-cb92d450f100\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " Jul 29 19:16:44.465599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.465419 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0622e6ea-39f7-490e-a205-cb92d450f100-ca-trust-extracted\") pod \"0622e6ea-39f7-490e-a205-cb92d450f100\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " Jul 29 19:16:44.465599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.465447 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") pod \"0622e6ea-39f7-490e-a205-cb92d450f100\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " Jul 29 19:16:44.465599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.465514 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-registry-certificates\") pod \"0622e6ea-39f7-490e-a205-cb92d450f100\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " Jul 29 19:16:44.465599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.465541 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-trusted-ca\") pod \"0622e6ea-39f7-490e-a205-cb92d450f100\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " Jul 29 19:16:44.465599 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.465569 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-installation-pull-secrets\") pod \"0622e6ea-39f7-490e-a205-cb92d450f100\" (UID: \"0622e6ea-39f7-490e-a205-cb92d450f100\") " Jul 29 19:16:44.466100 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.466069 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0622e6ea-39f7-490e-a205-cb92d450f100" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:16:44.466443 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.466413 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0622e6ea-39f7-490e-a205-cb92d450f100" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:16:44.468576 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.468530 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-kube-api-access-jrhff" (OuterVolumeSpecName: "kube-api-access-jrhff") pod "0622e6ea-39f7-490e-a205-cb92d450f100" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100"). InnerVolumeSpecName "kube-api-access-jrhff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:16:44.468576 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.468537 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0622e6ea-39f7-490e-a205-cb92d450f100" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 19:16:44.468738 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.468582 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0622e6ea-39f7-490e-a205-cb92d450f100" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:16:44.468738 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.468611 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0622e6ea-39f7-490e-a205-cb92d450f100" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 19:16:44.468738 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.468640 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0622e6ea-39f7-490e-a205-cb92d450f100" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:16:44.473983 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.473960 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0622e6ea-39f7-490e-a205-cb92d450f100-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0622e6ea-39f7-490e-a205-cb92d450f100" (UID: "0622e6ea-39f7-490e-a205-cb92d450f100"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:16:44.566240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.566157 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-image-registry-private-configuration\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.566240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.566188 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-bound-sa-token\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.566240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.566199 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrhff\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-kube-api-access-jrhff\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.566240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.566209 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0622e6ea-39f7-490e-a205-cb92d450f100-ca-trust-extracted\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.566240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.566217 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0622e6ea-39f7-490e-a205-cb92d450f100-registry-tls\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.566240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.566225 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-registry-certificates\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.566240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.566233 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0622e6ea-39f7-490e-a205-cb92d450f100-trusted-ca\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.566240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.566240 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0622e6ea-39f7-490e-a205-cb92d450f100-installation-pull-secrets\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:16:44.893270 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.893238 2574 generic.go:356] "Generic (PLEG): container finished" podID="0622e6ea-39f7-490e-a205-cb92d450f100" containerID="e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694" exitCode=0 Jul 29 19:16:44.893701 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.893284 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" Jul 29 19:16:44.893701 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.893326 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" event={"ID":"0622e6ea-39f7-490e-a205-cb92d450f100","Type":"ContainerDied","Data":"e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694"} Jul 29 19:16:44.893701 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.893376 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c4ff5bc9-fjkhf" event={"ID":"0622e6ea-39f7-490e-a205-cb92d450f100","Type":"ContainerDied","Data":"291d3d17c804396476464385d7195183ec99faff15392e0531a4a358ca02eda5"} Jul 29 19:16:44.893701 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.893403 2574 scope.go:117] "RemoveContainer" containerID="e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694" Jul 29 19:16:44.894717 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.894702 2574 generic.go:356] "Generic (PLEG): container finished" podID="3aed8102-ed3d-4232-8777-c2187cb701df" containerID="0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468" exitCode=0 Jul 29 19:16:44.894783 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.894732 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698bf56c74-9przp" event={"ID":"3aed8102-ed3d-4232-8777-c2187cb701df","Type":"ContainerDied","Data":"0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468"} Jul 29 19:16:44.894783 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.894763 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698bf56c74-9przp" Jul 29 19:16:44.894866 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.894780 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698bf56c74-9przp" event={"ID":"3aed8102-ed3d-4232-8777-c2187cb701df","Type":"ContainerDied","Data":"388f6bea32634e7a06cb19c7be6ea3edd75cbf7f94db2ab4226c6adf4dd39dab"} Jul 29 19:16:44.902263 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.902207 2574 scope.go:117] "RemoveContainer" containerID="e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694" Jul 29 19:16:44.902524 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:16:44.902503 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694\": container with ID starting with e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694 not found: ID does not exist" containerID="e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694" Jul 29 19:16:44.902608 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.902536 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694"} err="failed to get container status \"e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694\": rpc error: code = NotFound desc = could not find container \"e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694\": container with ID starting with e5c9d988b0e95005495b2c57cf6f9a78b49cc70eb31534c07aa47cb5ccc1a694 not found: ID does not exist" Jul 29 19:16:44.902608 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.902577 2574 scope.go:117] "RemoveContainer" containerID="0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468" Jul 29 19:16:44.909903 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.909868 2574 scope.go:117] "RemoveContainer" containerID="0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468" Jul 29 19:16:44.910171 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:16:44.910147 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468\": container with ID starting with 0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468 not found: ID does not exist" containerID="0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468" Jul 29 19:16:44.910243 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.910179 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468"} err="failed to get container status \"0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468\": rpc error: code = NotFound desc = could not find container \"0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468\": container with ID starting with 0ba861a8539cf96672b52fc484e1f8274163a56ad4910dd212a02fa6eb5c3468 not found: ID does not exist" Jul 29 19:16:44.919685 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.919663 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-698bf56c74-9przp"] Jul 29 19:16:44.924084 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.924066 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-698bf56c74-9przp"] Jul 29 19:16:44.937542 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.937522 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59c4ff5bc9-fjkhf"] Jul 29 19:16:44.946006 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:44.945986 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59c4ff5bc9-fjkhf"] Jul 29 19:16:46.210576 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:46.210544 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0622e6ea-39f7-490e-a205-cb92d450f100" path="/var/lib/kubelet/pods/0622e6ea-39f7-490e-a205-cb92d450f100/volumes" Jul 29 19:16:46.211040 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:46.210918 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aed8102-ed3d-4232-8777-c2187cb701df" path="/var/lib/kubelet/pods/3aed8102-ed3d-4232-8777-c2187cb701df/volumes" Jul 29 19:16:52.927480 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:52.927450 2574 generic.go:356] "Generic (PLEG): container finished" podID="0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e" containerID="c700f489dbf39a5c5e74a2e3b6c7f5a51dc2798a9b59678c682e0821dde7e322" exitCode=0 Jul 29 19:16:52.927905 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:52.927531 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-4fnpr" event={"ID":"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e","Type":"ContainerDied","Data":"c700f489dbf39a5c5e74a2e3b6c7f5a51dc2798a9b59678c682e0821dde7e322"} Jul 29 19:16:52.927905 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:52.927841 2574 scope.go:117] "RemoveContainer" containerID="c700f489dbf39a5c5e74a2e3b6c7f5a51dc2798a9b59678c682e0821dde7e322" Jul 29 19:16:53.933635 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:16:53.933597 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-4fnpr" event={"ID":"0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e","Type":"ContainerStarted","Data":"720e66504714c6a62844f7cc9d97c0df98b050c471ed9fa91c0541673f5d9ad7"} Jul 29 19:19:36.717796 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.717754 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s"] Jul 29 19:19:36.718353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.718222 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aed8102-ed3d-4232-8777-c2187cb701df" containerName="console" Jul 29 19:19:36.718353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.718240 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aed8102-ed3d-4232-8777-c2187cb701df" containerName="console" Jul 29 19:19:36.718353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.718255 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0622e6ea-39f7-490e-a205-cb92d450f100" containerName="registry" Jul 29 19:19:36.718353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.718263 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0622e6ea-39f7-490e-a205-cb92d450f100" containerName="registry" Jul 29 19:19:36.718353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.718342 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0622e6ea-39f7-490e-a205-cb92d450f100" containerName="registry" Jul 29 19:19:36.718353 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.718353 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aed8102-ed3d-4232-8777-c2187cb701df" containerName="console" Jul 29 19:19:36.720461 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.720440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.726025 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.725985 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-crltb\"" Jul 29 19:19:36.726025 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.726014 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 29 19:19:36.726208 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.726014 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 19:19:36.726298 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.726274 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 29 19:19:36.726413 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.726310 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 19:19:36.747740 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.747709 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s"] Jul 29 19:19:36.870273 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.870211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1164d0b1-13d7-47e9-a107-81b2724f2893-tmp\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.870450 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.870296 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1164d0b1-13d7-47e9-a107-81b2724f2893-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.870450 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.870327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1164d0b1-13d7-47e9-a107-81b2724f2893-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.870450 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.870351 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s79dv\" (UniqueName: \"kubernetes.io/projected/1164d0b1-13d7-47e9-a107-81b2724f2893-kube-api-access-s79dv\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.870450 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.870380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1164d0b1-13d7-47e9-a107-81b2724f2893-manifests\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.971654 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.971577 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1164d0b1-13d7-47e9-a107-81b2724f2893-tmp\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.971654 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.971616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1164d0b1-13d7-47e9-a107-81b2724f2893-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.971654 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.971644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1164d0b1-13d7-47e9-a107-81b2724f2893-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.971943 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.971761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s79dv\" (UniqueName: \"kubernetes.io/projected/1164d0b1-13d7-47e9-a107-81b2724f2893-kube-api-access-s79dv\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.971943 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.971802 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1164d0b1-13d7-47e9-a107-81b2724f2893-manifests\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.972191 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.972172 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1164d0b1-13d7-47e9-a107-81b2724f2893-manifests\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.974192 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.974163 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1164d0b1-13d7-47e9-a107-81b2724f2893-tmp\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.974302 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.974207 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1164d0b1-13d7-47e9-a107-81b2724f2893-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.974302 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.974286 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1164d0b1-13d7-47e9-a107-81b2724f2893-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:36.982728 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:36.982707 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s79dv\" (UniqueName: \"kubernetes.io/projected/1164d0b1-13d7-47e9-a107-81b2724f2893-kube-api-access-s79dv\") pod \"opendatahub-operator-controller-manager-6f775ff5c-q566s\" (UID: \"1164d0b1-13d7-47e9-a107-81b2724f2893\") " pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:37.030601 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:37.030572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:37.173267 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:37.173238 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s"] Jul 29 19:19:37.176789 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:19:37.176763 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1164d0b1_13d7_47e9_a107_81b2724f2893.slice/crio-f15e0237f3b5709fc9d3f3b35535cbf04c73cdd7cb5c7f1f44fb50082f948b13 WatchSource:0}: Error finding container f15e0237f3b5709fc9d3f3b35535cbf04c73cdd7cb5c7f1f44fb50082f948b13: Status 404 returned error can't find the container with id f15e0237f3b5709fc9d3f3b35535cbf04c73cdd7cb5c7f1f44fb50082f948b13 Jul 29 19:19:37.582852 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:37.582816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" event={"ID":"1164d0b1-13d7-47e9-a107-81b2724f2893","Type":"ContainerStarted","Data":"f15e0237f3b5709fc9d3f3b35535cbf04c73cdd7cb5c7f1f44fb50082f948b13"} Jul 29 19:19:41.605508 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:41.605475 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" event={"ID":"1164d0b1-13d7-47e9-a107-81b2724f2893","Type":"ContainerStarted","Data":"730c76718630aea06be396e57ff483c9d32ff5ec29ddeb8cecac6b1b28e1bf82"} Jul 29 19:19:42.027160 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:42.027082 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:19:42.030676 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:42.030649 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:19:42.039966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:42.039939 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 19:19:42.611229 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:42.611191 2574 generic.go:356] "Generic (PLEG): container finished" podID="1164d0b1-13d7-47e9-a107-81b2724f2893" containerID="730c76718630aea06be396e57ff483c9d32ff5ec29ddeb8cecac6b1b28e1bf82" exitCode=0 Jul 29 19:19:42.611649 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:42.611285 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" event={"ID":"1164d0b1-13d7-47e9-a107-81b2724f2893","Type":"ContainerDied","Data":"730c76718630aea06be396e57ff483c9d32ff5ec29ddeb8cecac6b1b28e1bf82"} Jul 29 19:19:43.617812 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:43.617774 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" event={"ID":"1164d0b1-13d7-47e9-a107-81b2724f2893","Type":"ContainerStarted","Data":"3139da0b9b2bf45267289a51ba59f7b047cdd7ca4da975df5bbdc3ce0f2599fa"} Jul 29 19:19:43.618220 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:43.617858 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:43.648570 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:43.648517 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" podStartSLOduration=2.110953953 podStartE2EDuration="7.648502013s" totalImagesPullingTime="4.501489338s" totalInitContainerRuntime="1.036058722s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:43.646199038 +0000 UTC m=+302.011281783" watchObservedRunningTime="2026-07-29 19:19:43.648502013 +0000 UTC m=+302.013584754" Jul 29 19:19:54.624219 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:54.624174 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f775ff5c-q566s" Jul 29 19:19:57.531365 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.531328 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ncs2w"] Jul 29 19:19:57.541840 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.541814 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:19:57.545478 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.545455 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-q9h8z\"" Jul 29 19:19:57.545734 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.545711 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 29 19:19:57.548776 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.548754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-872zd\" (UniqueName: \"kubernetes.io/projected/23b03241-94f8-485e-8a64-308224a06356-kube-api-access-872zd\") pod \"odh-model-controller-7998c67dc4-ncs2w\" (UID: \"23b03241-94f8-485e-8a64-308224a06356\") " pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:19:57.548964 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.548945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23b03241-94f8-485e-8a64-308224a06356-cert\") pod \"odh-model-controller-7998c67dc4-ncs2w\" (UID: \"23b03241-94f8-485e-8a64-308224a06356\") " pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:19:57.552328 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.552305 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ncs2w"] Jul 29 19:19:57.649928 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.649876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23b03241-94f8-485e-8a64-308224a06356-cert\") pod \"odh-model-controller-7998c67dc4-ncs2w\" (UID: \"23b03241-94f8-485e-8a64-308224a06356\") " pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:19:57.650105 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.649945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-872zd\" (UniqueName: \"kubernetes.io/projected/23b03241-94f8-485e-8a64-308224a06356-kube-api-access-872zd\") pod \"odh-model-controller-7998c67dc4-ncs2w\" (UID: \"23b03241-94f8-485e-8a64-308224a06356\") " pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:19:57.650105 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:19:57.650007 2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 29 19:19:57.650105 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:19:57.650101 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23b03241-94f8-485e-8a64-308224a06356-cert podName:23b03241-94f8-485e-8a64-308224a06356 nodeName:}" failed. No retries permitted until 2026-07-29 19:19:58.15007851 +0000 UTC m=+316.515161232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/23b03241-94f8-485e-8a64-308224a06356-cert") pod "odh-model-controller-7998c67dc4-ncs2w" (UID: "23b03241-94f8-485e-8a64-308224a06356") : secret "odh-model-controller-webhook-cert" not found Jul 29 19:19:57.663240 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:57.663215 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-872zd\" (UniqueName: \"kubernetes.io/projected/23b03241-94f8-485e-8a64-308224a06356-kube-api-access-872zd\") pod \"odh-model-controller-7998c67dc4-ncs2w\" (UID: \"23b03241-94f8-485e-8a64-308224a06356\") " pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:19:58.153348 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.153307 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23b03241-94f8-485e-8a64-308224a06356-cert\") pod \"odh-model-controller-7998c67dc4-ncs2w\" (UID: \"23b03241-94f8-485e-8a64-308224a06356\") " pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:19:58.155881 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.155863 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23b03241-94f8-485e-8a64-308224a06356-cert\") pod \"odh-model-controller-7998c67dc4-ncs2w\" (UID: \"23b03241-94f8-485e-8a64-308224a06356\") " pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:19:58.294712 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.294680 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8z9vd"] Jul 29 19:19:58.297207 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.297184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:19:58.299972 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.299952 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 29 19:19:58.311308 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.311284 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8z9vd"] Jul 29 19:19:58.355375 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.355341 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c1face-a159-420a-88fd-51d1ee50e841-tls-certs\") pod \"model-serving-api-54d89bd5fc-8z9vd\" (UID: \"b8c1face-a159-420a-88fd-51d1ee50e841\") " pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:19:58.355524 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.355429 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6smcb\" (UniqueName: \"kubernetes.io/projected/b8c1face-a159-420a-88fd-51d1ee50e841-kube-api-access-6smcb\") pod \"model-serving-api-54d89bd5fc-8z9vd\" (UID: \"b8c1face-a159-420a-88fd-51d1ee50e841\") " pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:19:58.453362 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.453278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:19:58.456433 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.456412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6smcb\" (UniqueName: \"kubernetes.io/projected/b8c1face-a159-420a-88fd-51d1ee50e841-kube-api-access-6smcb\") pod \"model-serving-api-54d89bd5fc-8z9vd\" (UID: \"b8c1face-a159-420a-88fd-51d1ee50e841\") " pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:19:58.456495 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.456479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c1face-a159-420a-88fd-51d1ee50e841-tls-certs\") pod \"model-serving-api-54d89bd5fc-8z9vd\" (UID: \"b8c1face-a159-420a-88fd-51d1ee50e841\") " pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:19:58.456620 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:19:58.456599 2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 29 19:19:58.456680 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:19:58.456669 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c1face-a159-420a-88fd-51d1ee50e841-tls-certs podName:b8c1face-a159-420a-88fd-51d1ee50e841 nodeName:}" failed. No retries permitted until 2026-07-29 19:19:58.956651655 +0000 UTC m=+317.321734389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b8c1face-a159-420a-88fd-51d1ee50e841-tls-certs") pod "model-serving-api-54d89bd5fc-8z9vd" (UID: "b8c1face-a159-420a-88fd-51d1ee50e841") : secret "model-serving-api-tls" not found Jul 29 19:19:58.468160 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.468128 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6smcb\" (UniqueName: \"kubernetes.io/projected/b8c1face-a159-420a-88fd-51d1ee50e841-kube-api-access-6smcb\") pod \"model-serving-api-54d89bd5fc-8z9vd\" (UID: \"b8c1face-a159-420a-88fd-51d1ee50e841\") " pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:19:58.594290 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.594256 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ncs2w"] Jul 29 19:19:58.597172 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:19:58.597133 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b03241_94f8_485e_8a64_308224a06356.slice/crio-830b0e1ce98e2e0d77c958249b727cecede39f58a872f7c5c932e67560b2eac5 WatchSource:0}: Error finding container 830b0e1ce98e2e0d77c958249b727cecede39f58a872f7c5c932e67560b2eac5: Status 404 returned error can't find the container with id 830b0e1ce98e2e0d77c958249b727cecede39f58a872f7c5c932e67560b2eac5 Jul 29 19:19:58.598477 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.598460 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 19:19:58.687794 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.687759 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" event={"ID":"23b03241-94f8-485e-8a64-308224a06356","Type":"ContainerStarted","Data":"830b0e1ce98e2e0d77c958249b727cecede39f58a872f7c5c932e67560b2eac5"} Jul 29 19:19:58.961256 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.961221 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c1face-a159-420a-88fd-51d1ee50e841-tls-certs\") pod \"model-serving-api-54d89bd5fc-8z9vd\" (UID: \"b8c1face-a159-420a-88fd-51d1ee50e841\") " pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:19:58.963764 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:58.963743 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c1face-a159-420a-88fd-51d1ee50e841-tls-certs\") pod \"model-serving-api-54d89bd5fc-8z9vd\" (UID: \"b8c1face-a159-420a-88fd-51d1ee50e841\") " pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:19:59.208198 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:59.208165 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:19:59.371160 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:59.371130 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8z9vd"] Jul 29 19:19:59.374188 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:19:59.374155 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c1face_a159_420a_88fd_51d1ee50e841.slice/crio-0cf7d928f8e40c8417c48a03458d835d857e00876f335011f9df091096f36fc2 WatchSource:0}: Error finding container 0cf7d928f8e40c8417c48a03458d835d857e00876f335011f9df091096f36fc2: Status 404 returned error can't find the container with id 0cf7d928f8e40c8417c48a03458d835d857e00876f335011f9df091096f36fc2 Jul 29 19:19:59.693964 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:19:59.693922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" event={"ID":"b8c1face-a159-420a-88fd-51d1ee50e841","Type":"ContainerStarted","Data":"0cf7d928f8e40c8417c48a03458d835d857e00876f335011f9df091096f36fc2"} Jul 29 19:20:01.705923 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:01.705803 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" event={"ID":"23b03241-94f8-485e-8a64-308224a06356","Type":"ContainerStarted","Data":"d9ec63b4370effb871f5142c2e8562d12d75c34da0aaa345e456e599fa271918"} Jul 29 19:20:01.706298 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:01.705956 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:20:01.726138 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:01.726050 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" podStartSLOduration=1.991201416 podStartE2EDuration="4.726029191s" totalImagesPullingTime="2.734827775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:01.725520763 +0000 UTC m=+320.090603495" watchObservedRunningTime="2026-07-29 19:20:01.726029191 +0000 UTC m=+320.091111935" Jul 29 19:20:03.717025 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:03.716986 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" event={"ID":"b8c1face-a159-420a-88fd-51d1ee50e841","Type":"ContainerStarted","Data":"54385c4c62d57586e52908c8110ec29e90ed490954c362ea9e41cec15e67765b"} Jul 29 19:20:03.717454 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:03.717139 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:20:03.745403 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:03.745348 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" podStartSLOduration=2.185107723 podStartE2EDuration="5.745330586s" totalImagesPullingTime="3.560222863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:03.743744652 +0000 UTC m=+322.108827393" watchObservedRunningTime="2026-07-29 19:20:03.745330586 +0000 UTC m=+322.110413369" Jul 29 19:20:07.588861 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.588821 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-85wk6"] Jul 29 19:20:07.592308 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.592277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:07.598735 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.597201 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dhbgj\"" Jul 29 19:20:07.598735 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.597440 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 29 19:20:07.615040 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.614999 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q"] Jul 29 19:20:07.625946 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.625883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scw86\" (UniqueName: \"kubernetes.io/projected/3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456-kube-api-access-scw86\") pod \"kserve-controller-manager-d6f4b65b8-85wk6\" (UID: \"3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:07.626199 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.626176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456-cert\") pod \"kserve-controller-manager-d6f4b65b8-85wk6\" (UID: \"3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:07.627198 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.627177 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-85wk6"] Jul 29 19:20:07.627282 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.627271 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:07.645728 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.645701 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 29 19:20:07.647490 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.647461 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dr98v\"" Jul 29 19:20:07.647732 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.647709 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q"] Jul 29 19:20:07.726690 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.726657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456-cert\") pod \"kserve-controller-manager-d6f4b65b8-85wk6\" (UID: \"3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:07.726928 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.726708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czgqm\" (UniqueName: \"kubernetes.io/projected/a05b81e6-834a-483d-b969-e58c0ed260b3-kube-api-access-czgqm\") pod \"llmisvc-controller-manager-777c6bd7d5-77t2q\" (UID: \"a05b81e6-834a-483d-b969-e58c0ed260b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:07.726928 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.726779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scw86\" (UniqueName: \"kubernetes.io/projected/3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456-kube-api-access-scw86\") pod \"kserve-controller-manager-d6f4b65b8-85wk6\" (UID: \"3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:07.726928 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.726809 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05b81e6-834a-483d-b969-e58c0ed260b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-77t2q\" (UID: \"a05b81e6-834a-483d-b969-e58c0ed260b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:07.729396 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.729362 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456-cert\") pod \"kserve-controller-manager-d6f4b65b8-85wk6\" (UID: \"3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:07.748011 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.747970 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scw86\" (UniqueName: \"kubernetes.io/projected/3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456-kube-api-access-scw86\") pod \"kserve-controller-manager-d6f4b65b8-85wk6\" (UID: \"3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:07.827868 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.827826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czgqm\" (UniqueName: \"kubernetes.io/projected/a05b81e6-834a-483d-b969-e58c0ed260b3-kube-api-access-czgqm\") pod \"llmisvc-controller-manager-777c6bd7d5-77t2q\" (UID: \"a05b81e6-834a-483d-b969-e58c0ed260b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:07.828091 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.827954 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05b81e6-834a-483d-b969-e58c0ed260b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-77t2q\" (UID: \"a05b81e6-834a-483d-b969-e58c0ed260b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:07.828091 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:20:07.828074 2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 29 19:20:07.828216 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:20:07.828169 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a05b81e6-834a-483d-b969-e58c0ed260b3-cert podName:a05b81e6-834a-483d-b969-e58c0ed260b3 nodeName:}" failed. No retries permitted until 2026-07-29 19:20:08.32813281 +0000 UTC m=+326.693215544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a05b81e6-834a-483d-b969-e58c0ed260b3-cert") pod "llmisvc-controller-manager-777c6bd7d5-77t2q" (UID: "a05b81e6-834a-483d-b969-e58c0ed260b3") : secret "llmisvc-webhook-server-cert" not found Jul 29 19:20:07.846814 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.846732 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czgqm\" (UniqueName: \"kubernetes.io/projected/a05b81e6-834a-483d-b969-e58c0ed260b3-kube-api-access-czgqm\") pod \"llmisvc-controller-manager-777c6bd7d5-77t2q\" (UID: \"a05b81e6-834a-483d-b969-e58c0ed260b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:07.920458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:07.920418 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:08.083517 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.083489 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-85wk6"] Jul 29 19:20:08.085622 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:20:08.085593 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6a5d3e_3dd3_4a9e_bd0f_f725a894f456.slice/crio-e2aaca564da569f32be671b7974cf62f348e062c7767c4834a99b865a354ebef WatchSource:0}: Error finding container e2aaca564da569f32be671b7974cf62f348e062c7767c4834a99b865a354ebef: Status 404 returned error can't find the container with id e2aaca564da569f32be671b7974cf62f348e062c7767c4834a99b865a354ebef Jul 29 19:20:08.119789 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.119718 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9"] Jul 29 19:20:08.123976 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.123961 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.127258 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.127230 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 29 19:20:08.127388 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.127273 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 29 19:20:08.127388 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.127285 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xrn5j\"" Jul 29 19:20:08.130034 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.130010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b511a429-44e4-488a-b099-0794290fbf98-tls-certs\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.130133 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.130066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b511a429-44e4-488a-b099-0794290fbf98-tmp\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.130133 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.130097 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9rck\" (UniqueName: \"kubernetes.io/projected/b511a429-44e4-488a-b099-0794290fbf98-kube-api-access-j9rck\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.141336 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.141314 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9"] Jul 29 19:20:08.231259 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.231213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b511a429-44e4-488a-b099-0794290fbf98-tls-certs\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.231432 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.231279 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b511a429-44e4-488a-b099-0794290fbf98-tmp\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.231432 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.231322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9rck\" (UniqueName: \"kubernetes.io/projected/b511a429-44e4-488a-b099-0794290fbf98-kube-api-access-j9rck\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.231570 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:20:08.231499 2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 29 19:20:08.231570 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:20:08.231569 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b511a429-44e4-488a-b099-0794290fbf98-tls-certs podName:b511a429-44e4-488a-b099-0794290fbf98 nodeName:}" failed. No retries permitted until 2026-07-29 19:20:08.731548135 +0000 UTC m=+327.096630873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b511a429-44e4-488a-b099-0794290fbf98-tls-certs") pod "kube-auth-proxy-5fb4d8769-k7rn9" (UID: "b511a429-44e4-488a-b099-0794290fbf98") : secret "kube-auth-proxy-tls" not found Jul 29 19:20:08.233795 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.233772 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b511a429-44e4-488a-b099-0794290fbf98-tmp\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.246966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.246942 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9rck\" (UniqueName: \"kubernetes.io/projected/b511a429-44e4-488a-b099-0794290fbf98-kube-api-access-j9rck\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.332312 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.332270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05b81e6-834a-483d-b969-e58c0ed260b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-77t2q\" (UID: \"a05b81e6-834a-483d-b969-e58c0ed260b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:08.334810 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.334791 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05b81e6-834a-483d-b969-e58c0ed260b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-77t2q\" (UID: \"a05b81e6-834a-483d-b969-e58c0ed260b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:08.538236 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.538142 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:08.685829 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.685806 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q"] Jul 29 19:20:08.688360 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:20:08.688334 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda05b81e6_834a_483d_b969_e58c0ed260b3.slice/crio-49e447b156acc3e4bc2e1da4f63ce5fbf3e0cbdeff15d6d9ad9b10df5ad41ff0 WatchSource:0}: Error finding container 49e447b156acc3e4bc2e1da4f63ce5fbf3e0cbdeff15d6d9ad9b10df5ad41ff0: Status 404 returned error can't find the container with id 49e447b156acc3e4bc2e1da4f63ce5fbf3e0cbdeff15d6d9ad9b10df5ad41ff0 Jul 29 19:20:08.735261 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.735226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b511a429-44e4-488a-b099-0794290fbf98-tls-certs\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.737919 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.737868 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b511a429-44e4-488a-b099-0794290fbf98-tls-certs\") pod \"kube-auth-proxy-5fb4d8769-k7rn9\" (UID: \"b511a429-44e4-488a-b099-0794290fbf98\") " pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:08.741289 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.741214 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" event={"ID":"3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456","Type":"ContainerStarted","Data":"e2aaca564da569f32be671b7974cf62f348e062c7767c4834a99b865a354ebef"} Jul 29 19:20:08.742595 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:08.742563 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" event={"ID":"a05b81e6-834a-483d-b969-e58c0ed260b3","Type":"ContainerStarted","Data":"49e447b156acc3e4bc2e1da4f63ce5fbf3e0cbdeff15d6d9ad9b10df5ad41ff0"} Jul 29 19:20:09.033983 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:09.033950 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" Jul 29 19:20:09.207875 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:09.207846 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9"] Jul 29 19:20:09.212420 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:20:09.212389 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb511a429_44e4_488a_b099_0794290fbf98.slice/crio-a39c7947b3aefad78e15eebc74986ed17d6afdd7c0d6560347c258eb01ab017d WatchSource:0}: Error finding container a39c7947b3aefad78e15eebc74986ed17d6afdd7c0d6560347c258eb01ab017d: Status 404 returned error can't find the container with id a39c7947b3aefad78e15eebc74986ed17d6afdd7c0d6560347c258eb01ab017d Jul 29 19:20:09.752348 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:09.752311 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" event={"ID":"b511a429-44e4-488a-b099-0794290fbf98","Type":"ContainerStarted","Data":"a39c7947b3aefad78e15eebc74986ed17d6afdd7c0d6560347c258eb01ab017d"} Jul 29 19:20:12.714112 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:12.714021 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ncs2w" Jul 29 19:20:12.770331 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:12.770288 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" event={"ID":"3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456","Type":"ContainerStarted","Data":"ea2b2fc25f76f98f319ff5d38917f22d1498137191fbe95ceebf23c336cadbbf"} Jul 29 19:20:12.770528 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:12.770364 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:12.772399 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:12.772271 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" event={"ID":"a05b81e6-834a-483d-b969-e58c0ed260b3","Type":"ContainerStarted","Data":"467fba06dddbc7e32ba580df40b6aeec07624d6de895ffebe7f788c212623e6b"} Jul 29 19:20:12.772399 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:12.772344 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:12.774611 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:12.774245 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" event={"ID":"b511a429-44e4-488a-b099-0794290fbf98","Type":"ContainerStarted","Data":"920d20bc1b43b6189ecd3d9ed8741a9831a467b64668c70484d0a72ea67c244a"} Jul 29 19:20:12.839552 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:12.839489 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" podStartSLOduration=2.130685707 podStartE2EDuration="5.839474471s" totalImagesPullingTime="3.708788764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:12.838394155 +0000 UTC m=+331.203476898" watchObservedRunningTime="2026-07-29 19:20:12.839474471 +0000 UTC m=+331.204557213" Jul 29 19:20:12.840299 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:12.840261 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" podStartSLOduration=1.534530475 podStartE2EDuration="5.840242373s" totalImagesPullingTime="4.305711898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:12.806523556 +0000 UTC m=+331.171606297" watchObservedRunningTime="2026-07-29 19:20:12.840242373 +0000 UTC m=+331.205325112" Jul 29 19:20:12.867821 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:12.867713 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fb4d8769-k7rn9" podStartSLOduration=1.6862367150000002 podStartE2EDuration="4.86769089s" totalImagesPullingTime="3.181454175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:12.865771517 +0000 UTC m=+331.230854258" watchObservedRunningTime="2026-07-29 19:20:12.86769089 +0000 UTC m=+331.232773632" Jul 29 19:20:14.726138 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:14.726108 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-8z9vd" Jul 29 19:20:17.085572 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.085527 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh"] Jul 29 19:20:17.089230 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.089207 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.093292 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.093257 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 29 19:20:17.093424 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.093405 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-69q7s\"" Jul 29 19:20:17.103733 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.103704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be450cce-7092-401d-8713-8e584dae4daa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.103823 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.103759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.103823 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.103787 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.103823 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.103812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.103947 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.103868 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brbwv\" (UniqueName: \"kubernetes.io/projected/be450cce-7092-401d-8713-8e584dae4daa-kube-api-access-brbwv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.103947 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.103920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be450cce-7092-401d-8713-8e584dae4daa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.104020 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.103971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.104020 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.104002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.104079 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.104044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be450cce-7092-401d-8713-8e584dae4daa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.117559 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.117533 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh"] Jul 29 19:20:17.204784 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.204733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be450cce-7092-401d-8713-8e584dae4daa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205015 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.204789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205015 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.204858 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205015 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.204929 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be450cce-7092-401d-8713-8e584dae4daa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205015 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.205002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be450cce-7092-401d-8713-8e584dae4daa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205257 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.205043 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205257 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.205072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205257 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.205098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205257 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.205142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brbwv\" (UniqueName: \"kubernetes.io/projected/be450cce-7092-401d-8713-8e584dae4daa-kube-api-access-brbwv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205478 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.205440 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205597 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.205467 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205720 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.205699 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.205960 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.205833 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.206282 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.206261 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be450cce-7092-401d-8713-8e584dae4daa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.207502 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.207480 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be450cce-7092-401d-8713-8e584dae4daa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.208025 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.208003 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be450cce-7092-401d-8713-8e584dae4daa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.217130 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.217110 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be450cce-7092-401d-8713-8e584dae4daa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.220463 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.220438 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brbwv\" (UniqueName: \"kubernetes.io/projected/be450cce-7092-401d-8713-8e584dae4daa-kube-api-access-brbwv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh\" (UID: \"be450cce-7092-401d-8713-8e584dae4daa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.400646 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.400560 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:17.559744 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.559297 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh"] Jul 29 19:20:17.562158 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:20:17.562099 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe450cce_7092_401d_8713_8e584dae4daa.slice/crio-d6818d3d71755cf19acdad0143866c311f5aea634269c155e17f69c88b328c7c WatchSource:0}: Error finding container d6818d3d71755cf19acdad0143866c311f5aea634269c155e17f69c88b328c7c: Status 404 returned error can't find the container with id d6818d3d71755cf19acdad0143866c311f5aea634269c155e17f69c88b328c7c Jul 29 19:20:17.799701 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:17.799607 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" event={"ID":"be450cce-7092-401d-8713-8e584dae4daa","Type":"ContainerStarted","Data":"d6818d3d71755cf19acdad0143866c311f5aea634269c155e17f69c88b328c7c"} Jul 29 19:20:20.023920 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:20.023866 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 19:20:20.024163 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:20.023960 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 19:20:20.024163 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:20.023993 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 19:20:20.814740 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:20.814702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" event={"ID":"be450cce-7092-401d-8713-8e584dae4daa","Type":"ContainerStarted","Data":"13302635b933a8ba112c4dd1693b9bd096e929b939c98e8ed79bb237b37faa30"} Jul 29 19:20:20.842743 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:20.842684 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" podStartSLOduration=1.383052345 podStartE2EDuration="3.842668264s" totalImagesPullingTime="2.459615919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:20.842536801 +0000 UTC m=+339.207619548" watchObservedRunningTime="2026-07-29 19:20:20.842668264 +0000 UTC m=+339.207751006" Jul 29 19:20:21.401659 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:21.401627 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:21.406387 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:21.406362 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:21.819468 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:21.819391 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:21.820273 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:21.820255 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh" Jul 29 19:20:43.781074 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:43.781001 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-77t2q" Jul 29 19:20:43.784164 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:43.784140 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85wk6" Jul 29 19:20:57.954342 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:57.954307 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-54fhp"] Jul 29 19:20:57.964574 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:57.964547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-54fhp" Jul 29 19:20:57.968166 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:57.968139 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 29 19:20:57.968361 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:57.968193 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-n6rdj\"" Jul 29 19:20:57.969419 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:57.969398 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 29 19:20:57.971787 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:57.971763 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-54fhp"] Jul 29 19:20:58.073291 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:58.073249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbtf6\" (UniqueName: \"kubernetes.io/projected/c3fc7250-c146-4804-a231-c51f9214d4ce-kube-api-access-wbtf6\") pod \"kuadrant-operator-catalog-54fhp\" (UID: \"c3fc7250-c146-4804-a231-c51f9214d4ce\") " pod="kuadrant-system/kuadrant-operator-catalog-54fhp" Jul 29 19:20:58.174460 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:58.174421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbtf6\" (UniqueName: \"kubernetes.io/projected/c3fc7250-c146-4804-a231-c51f9214d4ce-kube-api-access-wbtf6\") pod \"kuadrant-operator-catalog-54fhp\" (UID: \"c3fc7250-c146-4804-a231-c51f9214d4ce\") " pod="kuadrant-system/kuadrant-operator-catalog-54fhp" Jul 29 19:20:58.186642 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:58.186604 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbtf6\" (UniqueName: \"kubernetes.io/projected/c3fc7250-c146-4804-a231-c51f9214d4ce-kube-api-access-wbtf6\") pod \"kuadrant-operator-catalog-54fhp\" (UID: \"c3fc7250-c146-4804-a231-c51f9214d4ce\") " pod="kuadrant-system/kuadrant-operator-catalog-54fhp" Jul 29 19:20:58.275956 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:58.275838 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-54fhp" Jul 29 19:20:58.412038 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:58.412006 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-54fhp"] Jul 29 19:20:58.415439 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:20:58.415407 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3fc7250_c146_4804_a231_c51f9214d4ce.slice/crio-7df4bfe4fe69d1b970535ad7f3536a7d9da3db858575b838aa6cf925cb8e6615 WatchSource:0}: Error finding container 7df4bfe4fe69d1b970535ad7f3536a7d9da3db858575b838aa6cf925cb8e6615: Status 404 returned error can't find the container with id 7df4bfe4fe69d1b970535ad7f3536a7d9da3db858575b838aa6cf925cb8e6615 Jul 29 19:20:58.992524 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:20:58.992466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-54fhp" event={"ID":"c3fc7250-c146-4804-a231-c51f9214d4ce","Type":"ContainerStarted","Data":"7df4bfe4fe69d1b970535ad7f3536a7d9da3db858575b838aa6cf925cb8e6615"} Jul 29 19:21:01.004486 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:01.004383 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-54fhp" event={"ID":"c3fc7250-c146-4804-a231-c51f9214d4ce","Type":"ContainerStarted","Data":"e7b480c28e724d830497cf185d9461394cdbfcc9fdac25091ff534348cc7a42e"} Jul 29 19:21:01.023281 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:01.023226 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-54fhp" podStartSLOduration=1.785463501 podStartE2EDuration="4.023208554s" totalImagesPullingTime="2.237745053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:21:01.021437601 +0000 UTC m=+379.386520346" watchObservedRunningTime="2026-07-29 19:21:01.023208554 +0000 UTC m=+379.388291296" Jul 29 19:21:08.276931 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:08.276873 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-54fhp" Jul 29 19:21:08.277347 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:08.276952 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-54fhp" Jul 29 19:21:08.299338 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:08.299306 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-54fhp" Jul 29 19:21:09.062676 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:09.062646 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-54fhp" Jul 29 19:21:32.132239 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:32.132199 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j"] Jul 29 19:21:32.135992 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:32.135971 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:32.142021 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:32.141993 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-npsrs\"" Jul 29 19:21:32.165865 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:32.165838 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j"] Jul 29 19:21:32.257557 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:32.257517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt6kz\" (UniqueName: \"kubernetes.io/projected/467c29ba-04e4-44a8-80bf-cfcd078214ad-kube-api-access-lt6kz\") pod \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" (UID: \"467c29ba-04e4-44a8-80bf-cfcd078214ad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:32.358620 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:32.358580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt6kz\" (UniqueName: \"kubernetes.io/projected/467c29ba-04e4-44a8-80bf-cfcd078214ad-kube-api-access-lt6kz\") pod \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" (UID: \"467c29ba-04e4-44a8-80bf-cfcd078214ad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:32.380162 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:32.380126 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt6kz\" (UniqueName: \"kubernetes.io/projected/467c29ba-04e4-44a8-80bf-cfcd078214ad-kube-api-access-lt6kz\") pod \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" (UID: \"467c29ba-04e4-44a8-80bf-cfcd078214ad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:32.446466 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:32.446382 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:32.602536 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:32.602508 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j"] Jul 29 19:21:32.603853 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:21:32.603829 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467c29ba_04e4_44a8_80bf_cfcd078214ad.slice/crio-dfa086cf4eb0611c83ea77b466ed14e388ce0f7277a31219d56e45ca6c2db7f5 WatchSource:0}: Error finding container dfa086cf4eb0611c83ea77b466ed14e388ce0f7277a31219d56e45ca6c2db7f5: Status 404 returned error can't find the container with id dfa086cf4eb0611c83ea77b466ed14e388ce0f7277a31219d56e45ca6c2db7f5 Jul 29 19:21:33.119300 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.119264 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-569b885994-sdfdg"] Jul 29 19:21:33.122367 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.122342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.127657 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.127630 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hktpp\"" Jul 29 19:21:33.127956 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.127936 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 19:21:33.128135 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.128116 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 19:21:33.128974 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.128956 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 19:21:33.129078 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.128987 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 19:21:33.129292 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.129269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 19:21:33.143050 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.143003 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 19:21:33.153848 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.153818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" event={"ID":"467c29ba-04e4-44a8-80bf-cfcd078214ad","Type":"ContainerStarted","Data":"dfa086cf4eb0611c83ea77b466ed14e388ce0f7277a31219d56e45ca6c2db7f5"} Jul 29 19:21:33.161254 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.161220 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569b885994-sdfdg"] Jul 29 19:21:33.164717 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.164688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-console-config\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.164847 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.164736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/313c23e1-1b55-4446-9644-83fccb44ad0f-console-serving-cert\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.164954 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.164877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-service-ca\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.165020 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.164970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/313c23e1-1b55-4446-9644-83fccb44ad0f-console-oauth-config\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.165078 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.165021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-trusted-ca-bundle\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.165078 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.165052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv55m\" (UniqueName: \"kubernetes.io/projected/313c23e1-1b55-4446-9644-83fccb44ad0f-kube-api-access-gv55m\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.165168 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.165134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-oauth-serving-cert\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.266712 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.266669 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv55m\" (UniqueName: \"kubernetes.io/projected/313c23e1-1b55-4446-9644-83fccb44ad0f-kube-api-access-gv55m\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.266916 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.266738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-oauth-serving-cert\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.266916 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.266858 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-console-config\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.266916 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.266909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/313c23e1-1b55-4446-9644-83fccb44ad0f-console-serving-cert\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.267090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.266940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-service-ca\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.267090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.266982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/313c23e1-1b55-4446-9644-83fccb44ad0f-console-oauth-config\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.267090 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.267027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-trusted-ca-bundle\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.267625 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.267578 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-oauth-serving-cert\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.267743 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.267644 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-console-config\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.267831 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.267802 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-service-ca\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.268439 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.268413 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313c23e1-1b55-4446-9644-83fccb44ad0f-trusted-ca-bundle\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.270136 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.270104 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/313c23e1-1b55-4446-9644-83fccb44ad0f-console-oauth-config\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.270321 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.270301 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/313c23e1-1b55-4446-9644-83fccb44ad0f-console-serving-cert\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.284449 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.284424 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv55m\" (UniqueName: \"kubernetes.io/projected/313c23e1-1b55-4446-9644-83fccb44ad0f-kube-api-access-gv55m\") pod \"console-569b885994-sdfdg\" (UID: \"313c23e1-1b55-4446-9644-83fccb44ad0f\") " pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.435123 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.435041 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:33.645315 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:33.645286 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569b885994-sdfdg"] Jul 29 19:21:33.647850 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:21:33.647825 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313c23e1_1b55_4446_9644_83fccb44ad0f.slice/crio-c9795c9b874702c500a02cd4099acc5ff3263e78f80d472ef27d02116f27d625 WatchSource:0}: Error finding container c9795c9b874702c500a02cd4099acc5ff3263e78f80d472ef27d02116f27d625: Status 404 returned error can't find the container with id c9795c9b874702c500a02cd4099acc5ff3263e78f80d472ef27d02116f27d625 Jul 29 19:21:34.161493 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:34.161456 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569b885994-sdfdg" event={"ID":"313c23e1-1b55-4446-9644-83fccb44ad0f","Type":"ContainerStarted","Data":"69938512342f3700afc910dd3d6190ecaf6a4fa385b84df309f3e24d1ffcdbf9"} Jul 29 19:21:34.161965 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:34.161514 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569b885994-sdfdg" event={"ID":"313c23e1-1b55-4446-9644-83fccb44ad0f","Type":"ContainerStarted","Data":"c9795c9b874702c500a02cd4099acc5ff3263e78f80d472ef27d02116f27d625"} Jul 29 19:21:35.168596 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:35.168563 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" event={"ID":"467c29ba-04e4-44a8-80bf-cfcd078214ad","Type":"ContainerStarted","Data":"6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee"} Jul 29 19:21:35.169037 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:35.168837 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:35.191011 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:35.190956 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" podStartSLOduration=1.538579337 podStartE2EDuration="3.190940444s" totalImagesPullingTime="1.652361107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:21:35.190047582 +0000 UTC m=+413.555130324" watchObservedRunningTime="2026-07-29 19:21:35.190940444 +0000 UTC m=+413.556023177" Jul 29 19:21:35.191326 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:35.191304 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-569b885994-sdfdg" podStartSLOduration=2.191296977 podStartE2EDuration="2.191296977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:21:34.189248483 +0000 UTC m=+412.554331248" watchObservedRunningTime="2026-07-29 19:21:35.191296977 +0000 UTC m=+413.556379719" Jul 29 19:21:38.059140 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.059102 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp"] Jul 29 19:21:38.065988 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.065966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:38.068863 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.068844 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8kvmh\"" Jul 29 19:21:38.088523 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.088497 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp"] Jul 29 19:21:38.210575 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.210546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc3631ca-f5aa-4812-9935-3aade8e18946-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2j2jp\" (UID: \"dc3631ca-f5aa-4812-9935-3aade8e18946\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:38.210711 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.210597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v69ww\" (UniqueName: \"kubernetes.io/projected/dc3631ca-f5aa-4812-9935-3aade8e18946-kube-api-access-v69ww\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2j2jp\" (UID: \"dc3631ca-f5aa-4812-9935-3aade8e18946\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:38.311288 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.311205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v69ww\" (UniqueName: \"kubernetes.io/projected/dc3631ca-f5aa-4812-9935-3aade8e18946-kube-api-access-v69ww\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2j2jp\" (UID: \"dc3631ca-f5aa-4812-9935-3aade8e18946\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:38.311508 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.311485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc3631ca-f5aa-4812-9935-3aade8e18946-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2j2jp\" (UID: \"dc3631ca-f5aa-4812-9935-3aade8e18946\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:38.311922 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.311876 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc3631ca-f5aa-4812-9935-3aade8e18946-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2j2jp\" (UID: \"dc3631ca-f5aa-4812-9935-3aade8e18946\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:38.332615 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.332589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v69ww\" (UniqueName: \"kubernetes.io/projected/dc3631ca-f5aa-4812-9935-3aade8e18946-kube-api-access-v69ww\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2j2jp\" (UID: \"dc3631ca-f5aa-4812-9935-3aade8e18946\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:38.376590 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.376549 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:38.523562 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:38.523535 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp"] Jul 29 19:21:38.525762 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:21:38.525708 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3631ca_f5aa_4812_9935_3aade8e18946.slice/crio-e43f695bf366acf274a10d36ec7d34c16d623f8c6201c3636fa929c9ba170291 WatchSource:0}: Error finding container e43f695bf366acf274a10d36ec7d34c16d623f8c6201c3636fa929c9ba170291: Status 404 returned error can't find the container with id e43f695bf366acf274a10d36ec7d34c16d623f8c6201c3636fa929c9ba170291 Jul 29 19:21:39.188683 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:39.188646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" event={"ID":"dc3631ca-f5aa-4812-9935-3aade8e18946","Type":"ContainerStarted","Data":"e43f695bf366acf274a10d36ec7d34c16d623f8c6201c3636fa929c9ba170291"} Jul 29 19:21:43.436048 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:43.436003 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:43.436552 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:43.436084 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:43.442204 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:43.442176 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:44.220946 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:44.220879 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-569b885994-sdfdg" Jul 29 19:21:45.222428 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:45.222387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" event={"ID":"dc3631ca-f5aa-4812-9935-3aade8e18946","Type":"ContainerStarted","Data":"25afb2f2964456ea14b00ee893320aecad9d42c860c46764cb7a618531ebae79"} Jul 29 19:21:45.222928 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:45.222681 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:45.271783 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:45.271705 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" podStartSLOduration=1.298521203 podStartE2EDuration="7.271681745s" totalImagesPullingTime="5.973160542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:21:45.269028141 +0000 UTC m=+423.634110883" watchObservedRunningTime="2026-07-29 19:21:45.271681745 +0000 UTC m=+423.636764489" Jul 29 19:21:46.176051 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:46.176018 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:56.238736 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:56.238708 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:58.051986 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.051940 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf"] Jul 29 19:21:58.055827 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.055801 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.070527 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.070499 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf"] Jul 29 19:21:58.128663 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.128625 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp"] Jul 29 19:21:58.128934 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.128881 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" podUID="dc3631ca-f5aa-4812-9935-3aade8e18946" containerName="manager" containerID="cri-o://25afb2f2964456ea14b00ee893320aecad9d42c860c46764cb7a618531ebae79" gracePeriod=2 Jul 29 19:21:58.130923 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.130878 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp"] Jul 29 19:21:58.131408 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.131375 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2j2jp\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="dc3631ca-f5aa-4812-9935-3aade8e18946" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:58.150951 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.150920 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf"] Jul 29 19:21:58.151369 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.151339 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-7z8l4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" podUID="59fcc8bc-c4dd-417d-9ee8-c094febd4692" Jul 29 19:21:58.166195 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.166167 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt"] Jul 29 19:21:58.166552 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.166540 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3631ca-f5aa-4812-9935-3aade8e18946" containerName="manager" Jul 29 19:21:58.166604 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.166554 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3631ca-f5aa-4812-9935-3aade8e18946" containerName="manager" Jul 29 19:21:58.166662 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.166646 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3631ca-f5aa-4812-9935-3aade8e18946" containerName="manager" Jul 29 19:21:58.169760 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.169738 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:21:58.175779 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.175751 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf"] Jul 29 19:21:58.183642 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.183616 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb"] Jul 29 19:21:58.187195 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.187171 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt"] Jul 29 19:21:58.187335 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.187315 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:21:58.188878 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.188856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59fcc8bc-c4dd-417d-9ee8-c094febd4692-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" (UID: \"59fcc8bc-c4dd-417d-9ee8-c094febd4692\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.189001 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.188909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z8l4\" (UniqueName: \"kubernetes.io/projected/59fcc8bc-c4dd-417d-9ee8-c094febd4692-kube-api-access-7z8l4\") pod \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" (UID: \"59fcc8bc-c4dd-417d-9ee8-c094febd4692\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.193249 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.193227 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j"] Jul 29 19:21:58.193442 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.193421 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" containerName="manager" containerID="cri-o://6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee" gracePeriod=2 Jul 29 19:21:58.215395 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.215091 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2j2jp\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="dc3631ca-f5aa-4812-9935-3aade8e18946" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:58.220764 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.220722 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2j2jp\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="dc3631ca-f5aa-4812-9935-3aade8e18946" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:58.225162 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.225136 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59fcc8bc-c4dd-417d-9ee8-c094febd4692" path="/var/lib/kubelet/pods/59fcc8bc-c4dd-417d-9ee8-c094febd4692/volumes" Jul 29 19:21:58.225327 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.225312 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb"] Jul 29 19:21:58.225395 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.225367 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j"] Jul 29 19:21:58.250087 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.250048 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:58.289817 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.289785 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2720aa50-e623-4eb7-b8e4-54e99f036434-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xjpdb\" (UID: \"2720aa50-e623-4eb7-b8e4-54e99f036434\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:21:58.289984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.289836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rs8qt\" (UID: \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:21:58.289984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.289861 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59fcc8bc-c4dd-417d-9ee8-c094febd4692-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" (UID: \"59fcc8bc-c4dd-417d-9ee8-c094febd4692\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.289984 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.289882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z8l4\" (UniqueName: \"kubernetes.io/projected/59fcc8bc-c4dd-417d-9ee8-c094febd4692-kube-api-access-7z8l4\") pod \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" (UID: \"59fcc8bc-c4dd-417d-9ee8-c094febd4692\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.290118 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.289982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tstfx\" (UniqueName: \"kubernetes.io/projected/2720aa50-e623-4eb7-b8e4-54e99f036434-kube-api-access-tstfx\") pod \"kuadrant-operator-controller-manager-86878c769f-xjpdb\" (UID: \"2720aa50-e623-4eb7-b8e4-54e99f036434\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:21:58.290118 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.290038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k6n6\" (UniqueName: \"kubernetes.io/projected/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-kube-api-access-2k6n6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rs8qt\" (UID: \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:21:58.290293 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.290273 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59fcc8bc-c4dd-417d-9ee8-c094febd4692-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" (UID: \"59fcc8bc-c4dd-417d-9ee8-c094febd4692\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.298079 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.298051 2574 projected.go:196] Error preparing data for projected volume kube-api-access-7z8l4 for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-ctrnf" not found Jul 29 19:21:58.298207 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.298144 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59fcc8bc-c4dd-417d-9ee8-c094febd4692-kube-api-access-7z8l4 podName:59fcc8bc-c4dd-417d-9ee8-c094febd4692 nodeName:}" failed. No retries permitted until 2026-07-29 19:21:58.79811979 +0000 UTC m=+437.163202527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7z8l4" (UniqueName: "kubernetes.io/projected/59fcc8bc-c4dd-417d-9ee8-c094febd4692-kube-api-access-7z8l4") pod "kuadrant-operator-controller-manager-86878c769f-ctrnf" (UID: "59fcc8bc-c4dd-417d-9ee8-c094febd4692") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-ctrnf" not found Jul 29 19:21:58.304000 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.303940 2574 generic.go:356] "Generic (PLEG): container finished" podID="dc3631ca-f5aa-4812-9935-3aade8e18946" containerID="25afb2f2964456ea14b00ee893320aecad9d42c860c46764cb7a618531ebae79" exitCode=0 Jul 29 19:21:58.304141 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.304126 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.306981 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.306954 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:58.311069 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.311041 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.313654 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.313628 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="59fcc8bc-c4dd-417d-9ee8-c094febd4692" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.316811 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.316781 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:58.391505 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.391471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tstfx\" (UniqueName: \"kubernetes.io/projected/2720aa50-e623-4eb7-b8e4-54e99f036434-kube-api-access-tstfx\") pod \"kuadrant-operator-controller-manager-86878c769f-xjpdb\" (UID: \"2720aa50-e623-4eb7-b8e4-54e99f036434\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:21:58.391709 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.391567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k6n6\" (UniqueName: \"kubernetes.io/projected/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-kube-api-access-2k6n6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rs8qt\" (UID: \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:21:58.391709 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.391601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2720aa50-e623-4eb7-b8e4-54e99f036434-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xjpdb\" (UID: \"2720aa50-e623-4eb7-b8e4-54e99f036434\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:21:58.391709 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.391654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rs8qt\" (UID: \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:21:58.392273 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.392244 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2720aa50-e623-4eb7-b8e4-54e99f036434-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xjpdb\" (UID: \"2720aa50-e623-4eb7-b8e4-54e99f036434\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:21:58.392382 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.392324 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rs8qt\" (UID: \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:21:58.404442 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.404417 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k6n6\" (UniqueName: \"kubernetes.io/projected/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-kube-api-access-2k6n6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rs8qt\" (UID: \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:21:58.413218 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.413188 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tstfx\" (UniqueName: \"kubernetes.io/projected/2720aa50-e623-4eb7-b8e4-54e99f036434-kube-api-access-tstfx\") pod \"kuadrant-operator-controller-manager-86878c769f-xjpdb\" (UID: \"2720aa50-e623-4eb7-b8e4-54e99f036434\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:21:58.448134 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.448111 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:58.450122 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.450104 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:58.451039 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.451017 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="59fcc8bc-c4dd-417d-9ee8-c094febd4692" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.453365 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.453343 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:58.455449 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.455425 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="59fcc8bc-c4dd-417d-9ee8-c094febd4692" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:58.458016 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:58.457993 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:58.492518 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.492491 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59fcc8bc-c4dd-417d-9ee8-c094febd4692-extensions-socket-volume\") pod \"59fcc8bc-c4dd-417d-9ee8-c094febd4692\" (UID: \"59fcc8bc-c4dd-417d-9ee8-c094febd4692\") " Jul 29 19:21:58.492725 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.492712 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z8l4\" (UniqueName: \"kubernetes.io/projected/59fcc8bc-c4dd-417d-9ee8-c094febd4692-kube-api-access-7z8l4\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:21:58.492767 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.492736 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fcc8bc-c4dd-417d-9ee8-c094febd4692-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "59fcc8bc-c4dd-417d-9ee8-c094febd4692" (UID: "59fcc8bc-c4dd-417d-9ee8-c094febd4692"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:21:58.570212 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.570126 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:21:58.575047 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.575026 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:21:58.593680 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.593654 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc3631ca-f5aa-4812-9935-3aade8e18946-extensions-socket-volume\") pod \"dc3631ca-f5aa-4812-9935-3aade8e18946\" (UID: \"dc3631ca-f5aa-4812-9935-3aade8e18946\") " Jul 29 19:21:58.593816 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.593745 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt6kz\" (UniqueName: \"kubernetes.io/projected/467c29ba-04e4-44a8-80bf-cfcd078214ad-kube-api-access-lt6kz\") pod \"467c29ba-04e4-44a8-80bf-cfcd078214ad\" (UID: \"467c29ba-04e4-44a8-80bf-cfcd078214ad\") " Jul 29 19:21:58.593903 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.593865 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v69ww\" (UniqueName: \"kubernetes.io/projected/dc3631ca-f5aa-4812-9935-3aade8e18946-kube-api-access-v69ww\") pod \"dc3631ca-f5aa-4812-9935-3aade8e18946\" (UID: \"dc3631ca-f5aa-4812-9935-3aade8e18946\") " Jul 29 19:21:58.594161 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.594143 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59fcc8bc-c4dd-417d-9ee8-c094febd4692-extensions-socket-volume\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:21:58.594243 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.594217 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3631ca-f5aa-4812-9935-3aade8e18946-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dc3631ca-f5aa-4812-9935-3aade8e18946" (UID: "dc3631ca-f5aa-4812-9935-3aade8e18946"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:21:58.596271 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.596243 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/467c29ba-04e4-44a8-80bf-cfcd078214ad-kube-api-access-lt6kz" (OuterVolumeSpecName: "kube-api-access-lt6kz") pod "467c29ba-04e4-44a8-80bf-cfcd078214ad" (UID: "467c29ba-04e4-44a8-80bf-cfcd078214ad"). InnerVolumeSpecName "kube-api-access-lt6kz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:21:58.596655 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.596629 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc3631ca-f5aa-4812-9935-3aade8e18946-kube-api-access-v69ww" (OuterVolumeSpecName: "kube-api-access-v69ww") pod "dc3631ca-f5aa-4812-9935-3aade8e18946" (UID: "dc3631ca-f5aa-4812-9935-3aade8e18946"). InnerVolumeSpecName "kube-api-access-v69ww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:21:58.695597 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.695492 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v69ww\" (UniqueName: \"kubernetes.io/projected/dc3631ca-f5aa-4812-9935-3aade8e18946-kube-api-access-v69ww\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:21:58.695597 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.695521 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc3631ca-f5aa-4812-9935-3aade8e18946-extensions-socket-volume\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:21:58.695597 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.695534 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt6kz\" (UniqueName: \"kubernetes.io/projected/467c29ba-04e4-44a8-80bf-cfcd078214ad-kube-api-access-lt6kz\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:21:58.755312 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.755289 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt"] Jul 29 19:21:58.757512 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:21:58.757487 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f4acd7_39e3_4dc4_94a7_fcb94df3c202.slice/crio-491bb96abaf8a463dca291adba10fb3c8cee901412de670e1d6a03d42618f371 WatchSource:0}: Error finding container 491bb96abaf8a463dca291adba10fb3c8cee901412de670e1d6a03d42618f371: Status 404 returned error can't find the container with id 491bb96abaf8a463dca291adba10fb3c8cee901412de670e1d6a03d42618f371 Jul 29 19:21:58.770193 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:58.770170 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb"] Jul 29 19:21:58.772961 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:21:58.772936 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2720aa50_e623_4eb7_b8e4_54e99f036434.slice/crio-ee4d2ecc8401ad89b2119041f6f1cb951bd8f5c7fc00c1f3b045186b76861034 WatchSource:0}: Error finding container ee4d2ecc8401ad89b2119041f6f1cb951bd8f5c7fc00c1f3b045186b76861034: Status 404 returned error can't find the container with id ee4d2ecc8401ad89b2119041f6f1cb951bd8f5c7fc00c1f3b045186b76861034 Jul 29 19:21:59.310677 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.310649 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2j2jp" Jul 29 19:21:59.310677 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.310672 2574 scope.go:117] "RemoveContainer" containerID="25afb2f2964456ea14b00ee893320aecad9d42c860c46764cb7a618531ebae79" Jul 29 19:21:59.312276 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.312200 2574 generic.go:356] "Generic (PLEG): container finished" podID="467c29ba-04e4-44a8-80bf-cfcd078214ad" containerID="6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee" exitCode=0 Jul 29 19:21:59.312429 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.312321 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:59.313703 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:59.313671 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="59fcc8bc-c4dd-417d-9ee8-c094febd4692" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:59.314287 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.314261 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" event={"ID":"2720aa50-e623-4eb7-b8e4-54e99f036434","Type":"ContainerStarted","Data":"6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4"} Jul 29 19:21:59.314392 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.314312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" event={"ID":"2720aa50-e623-4eb7-b8e4-54e99f036434","Type":"ContainerStarted","Data":"ee4d2ecc8401ad89b2119041f6f1cb951bd8f5c7fc00c1f3b045186b76861034"} Jul 29 19:21:59.314392 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.314342 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:21:59.315795 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:59.315772 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:59.316298 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.316269 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:59.316384 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.316300 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" event={"ID":"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202","Type":"ContainerStarted","Data":"f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13"} Jul 29 19:21:59.316384 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.316343 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" event={"ID":"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202","Type":"ContainerStarted","Data":"491bb96abaf8a463dca291adba10fb3c8cee901412de670e1d6a03d42618f371"} Jul 29 19:21:59.316499 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.316407 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:21:59.318191 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:59.318164 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="59fcc8bc-c4dd-417d-9ee8-c094febd4692" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:59.321506 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.321489 2574 scope.go:117] "RemoveContainer" containerID="6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee" Jul 29 19:21:59.329933 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.329914 2574 scope.go:117] "RemoveContainer" containerID="6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee" Jul 29 19:21:59.330181 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:59.330163 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee\": container with ID starting with 6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee not found: ID does not exist" containerID="6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee" Jul 29 19:21:59.330238 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.330189 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee"} err="failed to get container status \"6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee\": rpc error: code = NotFound desc = could not find container \"6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee\": container with ID starting with 6b88dffaaabb371093c6ec5ff9704433ad87db8554a29dcb3f7d74f876bdeeee not found: ID does not exist" Jul 29 19:21:59.353883 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:59.353844 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:59.354172 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.354137 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" podStartSLOduration=1.35412379 podStartE2EDuration="1.35412379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:21:59.351031803 +0000 UTC m=+437.716114545" watchObservedRunningTime="2026-07-29 19:21:59.35412379 +0000 UTC m=+437.719206531" Jul 29 19:21:59.355997 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:59.355976 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vlw4j\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlw4j" Jul 29 19:21:59.358980 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:21:59.358942 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-ctrnf\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="59fcc8bc-c4dd-417d-9ee8-c094febd4692" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctrnf" Jul 29 19:21:59.386713 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:21:59.386661 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" podStartSLOduration=1.386645761 podStartE2EDuration="1.386645761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:21:59.386245784 +0000 UTC m=+437.751328525" watchObservedRunningTime="2026-07-29 19:21:59.386645761 +0000 UTC m=+437.751728502" Jul 29 19:22:00.212132 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:00.212098 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" path="/var/lib/kubelet/pods/467c29ba-04e4-44a8-80bf-cfcd078214ad/volumes" Jul 29 19:22:00.212425 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:00.212413 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59fcc8bc-c4dd-417d-9ee8-c094febd4692" path="/var/lib/kubelet/pods/59fcc8bc-c4dd-417d-9ee8-c094febd4692/volumes" Jul 29 19:22:00.212636 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:00.212625 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc3631ca-f5aa-4812-9935-3aade8e18946" path="/var/lib/kubelet/pods/dc3631ca-f5aa-4812-9935-3aade8e18946/volumes" Jul 29 19:22:10.325280 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.325196 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:22:10.325280 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.325277 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:22:10.410482 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.410449 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt"] Jul 29 19:22:10.410686 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.410665 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" podUID="f6f4acd7-39e3-4dc4-94a7-fcb94df3c202" containerName="manager" containerID="cri-o://f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13" gracePeriod=10 Jul 29 19:22:10.669334 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.669307 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:22:10.708955 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.708922 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-extensions-socket-volume\") pod \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\" (UID: \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\") " Jul 29 19:22:10.709141 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.709072 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k6n6\" (UniqueName: \"kubernetes.io/projected/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-kube-api-access-2k6n6\") pod \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\" (UID: \"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202\") " Jul 29 19:22:10.709365 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.709338 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f6f4acd7-39e3-4dc4-94a7-fcb94df3c202" (UID: "f6f4acd7-39e3-4dc4-94a7-fcb94df3c202"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:22:10.711725 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.711696 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-kube-api-access-2k6n6" (OuterVolumeSpecName: "kube-api-access-2k6n6") pod "f6f4acd7-39e3-4dc4-94a7-fcb94df3c202" (UID: "f6f4acd7-39e3-4dc4-94a7-fcb94df3c202"). InnerVolumeSpecName "kube-api-access-2k6n6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:22:10.810514 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.810466 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k6n6\" (UniqueName: \"kubernetes.io/projected/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-kube-api-access-2k6n6\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:22:10.810514 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:10.810496 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202-extensions-socket-volume\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:22:11.382720 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:11.382689 2574 generic.go:356] "Generic (PLEG): container finished" podID="f6f4acd7-39e3-4dc4-94a7-fcb94df3c202" containerID="f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13" exitCode=0 Jul 29 19:22:11.383280 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:11.382731 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" Jul 29 19:22:11.383280 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:11.382773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" event={"ID":"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202","Type":"ContainerDied","Data":"f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13"} Jul 29 19:22:11.383280 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:11.382820 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt" event={"ID":"f6f4acd7-39e3-4dc4-94a7-fcb94df3c202","Type":"ContainerDied","Data":"491bb96abaf8a463dca291adba10fb3c8cee901412de670e1d6a03d42618f371"} Jul 29 19:22:11.383280 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:11.382842 2574 scope.go:117] "RemoveContainer" containerID="f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13" Jul 29 19:22:11.392406 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:11.392389 2574 scope.go:117] "RemoveContainer" containerID="f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13" Jul 29 19:22:11.392678 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:22:11.392659 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13\": container with ID starting with f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13 not found: ID does not exist" containerID="f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13" Jul 29 19:22:11.392723 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:11.392686 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13"} err="failed to get container status \"f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13\": rpc error: code = NotFound desc = could not find container \"f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13\": container with ID starting with f1d986b2b45705b9ed3bce7f80a75b11c3c7e6886db01b66a10473e03a5c2d13 not found: ID does not exist" Jul 29 19:22:11.437689 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:11.437646 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt"] Jul 29 19:22:11.441304 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:11.441277 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rs8qt"] Jul 29 19:22:12.213770 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:12.213735 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f4acd7-39e3-4dc4-94a7-fcb94df3c202" path="/var/lib/kubelet/pods/f6f4acd7-39e3-4dc4-94a7-fcb94df3c202/volumes" Jul 29 19:22:26.874197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.874150 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb"] Jul 29 19:22:26.874724 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.874709 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" containerName="manager" Jul 29 19:22:26.874771 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.874727 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" containerName="manager" Jul 29 19:22:26.874771 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.874750 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f4acd7-39e3-4dc4-94a7-fcb94df3c202" containerName="manager" Jul 29 19:22:26.874771 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.874759 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f4acd7-39e3-4dc4-94a7-fcb94df3c202" containerName="manager" Jul 29 19:22:26.874856 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.874841 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f4acd7-39e3-4dc4-94a7-fcb94df3c202" containerName="manager" Jul 29 19:22:26.874856 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.874851 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="467c29ba-04e4-44a8-80bf-cfcd078214ad" containerName="manager" Jul 29 19:22:26.878309 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.878291 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:26.885603 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.885588 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pvwnc\"" Jul 29 19:22:26.902232 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.902204 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb"] Jul 29 19:22:26.954999 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.954963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:26.955197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.955056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:26.955197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.955105 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:26.955197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.955160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:26.955197 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.955183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2jwz\" (UniqueName: \"kubernetes.io/projected/86dc81f5-9b81-414c-959c-7131d782fa51-kube-api-access-s2jwz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:26.955369 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.955209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86dc81f5-9b81-414c-959c-7131d782fa51-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:26.955369 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.955264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:26.955369 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.955301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86dc81f5-9b81-414c-959c-7131d782fa51-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:26.955369 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:26.955325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86dc81f5-9b81-414c-959c-7131d782fa51-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.055905 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.055849 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.055905 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.055915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2jwz\" (UniqueName: \"kubernetes.io/projected/86dc81f5-9b81-414c-959c-7131d782fa51-kube-api-access-s2jwz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056136 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.055945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86dc81f5-9b81-414c-959c-7131d782fa51-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056136 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.055970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056136 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.056005 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86dc81f5-9b81-414c-959c-7131d782fa51-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056136 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.056069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86dc81f5-9b81-414c-959c-7131d782fa51-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056343 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.056147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056343 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.056220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056343 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.056277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056343 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.056302 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056573 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.056546 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056646 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.056601 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.056646 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.056621 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.057220 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.057195 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86dc81f5-9b81-414c-959c-7131d782fa51-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.058336 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.058316 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86dc81f5-9b81-414c-959c-7131d782fa51-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.058578 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.058562 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86dc81f5-9b81-414c-959c-7131d782fa51-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.068200 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.068171 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86dc81f5-9b81-414c-959c-7131d782fa51-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.069285 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.069267 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2jwz\" (UniqueName: \"kubernetes.io/projected/86dc81f5-9b81-414c-959c-7131d782fa51-kube-api-access-s2jwz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tpkbb\" (UID: \"86dc81f5-9b81-414c-959c-7131d782fa51\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.189441 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.189354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:27.336125 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.336102 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb"] Jul 29 19:22:27.337985 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:22:27.337957 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86dc81f5_9b81_414c_959c_7131d782fa51.slice/crio-1616d62ec4f6a4d536c2694be44daba73e186b39fc3633bb21f203aa31dd333b WatchSource:0}: Error finding container 1616d62ec4f6a4d536c2694be44daba73e186b39fc3633bb21f203aa31dd333b: Status 404 returned error can't find the container with id 1616d62ec4f6a4d536c2694be44daba73e186b39fc3633bb21f203aa31dd333b Jul 29 19:22:27.339882 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.339854 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 19:22:27.339975 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.339936 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 19:22:27.339975 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.339965 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 19:22:27.463017 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.462920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" event={"ID":"86dc81f5-9b81-414c-959c-7131d782fa51","Type":"ContainerStarted","Data":"f4fac4720dcf5e08588bfa2ea10a26909c076ada5f149f5136b635f8bf609ea1"} Jul 29 19:22:27.463017 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.462990 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" event={"ID":"86dc81f5-9b81-414c-959c-7131d782fa51","Type":"ContainerStarted","Data":"1616d62ec4f6a4d536c2694be44daba73e186b39fc3633bb21f203aa31dd333b"} Jul 29 19:22:27.496919 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:27.496634 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" podStartSLOduration=1.496616736 podStartE2EDuration="1.496616736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:27.496432139 +0000 UTC m=+465.861514884" watchObservedRunningTime="2026-07-29 19:22:27.496616736 +0000 UTC m=+465.861699478" Jul 29 19:22:28.190530 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.190491 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:28.196128 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.196105 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:28.468381 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.468293 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:28.469384 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.469362 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:22:28.659667 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.659635 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jcg7"] Jul 29 19:22:28.662251 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.662234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:28.665844 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.665825 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2wfx7\"" Jul 29 19:22:28.666196 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.666181 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 29 19:22:28.680876 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.680851 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jcg7"] Jul 29 19:22:28.760635 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.760562 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jcg7"] Jul 29 19:22:28.770050 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.770019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjs8p\" (UniqueName: \"kubernetes.io/projected/b6a106cc-ad82-4096-9fc4-78f7e8421a85-kube-api-access-fjs8p\") pod \"limitador-limitador-64c94fd64f-8jcg7\" (UID: \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:28.770234 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.770112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a106cc-ad82-4096-9fc4-78f7e8421a85-config-file\") pod \"limitador-limitador-64c94fd64f-8jcg7\" (UID: \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:28.870725 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.870693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a106cc-ad82-4096-9fc4-78f7e8421a85-config-file\") pod \"limitador-limitador-64c94fd64f-8jcg7\" (UID: \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:28.870948 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.870782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjs8p\" (UniqueName: \"kubernetes.io/projected/b6a106cc-ad82-4096-9fc4-78f7e8421a85-kube-api-access-fjs8p\") pod \"limitador-limitador-64c94fd64f-8jcg7\" (UID: \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:28.871323 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.871306 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a106cc-ad82-4096-9fc4-78f7e8421a85-config-file\") pod \"limitador-limitador-64c94fd64f-8jcg7\" (UID: \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:28.887597 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.887570 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjs8p\" (UniqueName: \"kubernetes.io/projected/b6a106cc-ad82-4096-9fc4-78f7e8421a85-kube-api-access-fjs8p\") pod \"limitador-limitador-64c94fd64f-8jcg7\" (UID: \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:28.972624 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:28.972587 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:29.088456 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.088425 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:22:29.091422 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.091399 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:29.110653 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.110628 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:22:29.128670 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.128641 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jcg7"] Jul 29 19:22:29.129609 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:22:29.129579 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a106cc_ad82_4096_9fc4_78f7e8421a85.slice/crio-9a570da89e52446d6eefa30b65de69aef4ee920bf44a3da6efd6ba7706bcd7e6 WatchSource:0}: Error finding container 9a570da89e52446d6eefa30b65de69aef4ee920bf44a3da6efd6ba7706bcd7e6: Status 404 returned error can't find the container with id 9a570da89e52446d6eefa30b65de69aef4ee920bf44a3da6efd6ba7706bcd7e6 Jul 29 19:22:29.145589 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.145559 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:22:29.173797 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.173767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpj9d\" (UniqueName: \"kubernetes.io/projected/72834334-6a22-4340-8487-0c46efc0c764-kube-api-access-dpj9d\") pod \"limitador-limitador-54d6d988d5-cbvnk\" (UID: \"72834334-6a22-4340-8487-0c46efc0c764\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:29.174005 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.173805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72834334-6a22-4340-8487-0c46efc0c764-config-file\") pod \"limitador-limitador-54d6d988d5-cbvnk\" (UID: \"72834334-6a22-4340-8487-0c46efc0c764\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:29.275407 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.275311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpj9d\" (UniqueName: \"kubernetes.io/projected/72834334-6a22-4340-8487-0c46efc0c764-kube-api-access-dpj9d\") pod \"limitador-limitador-54d6d988d5-cbvnk\" (UID: \"72834334-6a22-4340-8487-0c46efc0c764\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:29.275407 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.275348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72834334-6a22-4340-8487-0c46efc0c764-config-file\") pod \"limitador-limitador-54d6d988d5-cbvnk\" (UID: \"72834334-6a22-4340-8487-0c46efc0c764\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:29.276024 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.276002 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72834334-6a22-4340-8487-0c46efc0c764-config-file\") pod \"limitador-limitador-54d6d988d5-cbvnk\" (UID: \"72834334-6a22-4340-8487-0c46efc0c764\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:29.285041 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.285014 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpj9d\" (UniqueName: \"kubernetes.io/projected/72834334-6a22-4340-8487-0c46efc0c764-kube-api-access-dpj9d\") pod \"limitador-limitador-54d6d988d5-cbvnk\" (UID: \"72834334-6a22-4340-8487-0c46efc0c764\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:29.402287 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.402249 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:29.474419 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.474388 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" event={"ID":"b6a106cc-ad82-4096-9fc4-78f7e8421a85","Type":"ContainerStarted","Data":"9a570da89e52446d6eefa30b65de69aef4ee920bf44a3da6efd6ba7706bcd7e6"} Jul 29 19:22:29.550151 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:29.550123 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:22:29.553100 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:22:29.553074 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72834334_6a22_4340_8487_0c46efc0c764.slice/crio-612471fe3df3249741d32acee14dbd29eb0feac375154440cdde786cc984d02e WatchSource:0}: Error finding container 612471fe3df3249741d32acee14dbd29eb0feac375154440cdde786cc984d02e: Status 404 returned error can't find the container with id 612471fe3df3249741d32acee14dbd29eb0feac375154440cdde786cc984d02e Jul 29 19:22:30.507961 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:30.507920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" event={"ID":"72834334-6a22-4340-8487-0c46efc0c764","Type":"ContainerStarted","Data":"612471fe3df3249741d32acee14dbd29eb0feac375154440cdde786cc984d02e"} Jul 29 19:22:32.520880 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:32.520784 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" event={"ID":"72834334-6a22-4340-8487-0c46efc0c764","Type":"ContainerStarted","Data":"63b4061f92308f6934a90809a9c104f92d8894f2d7326e28d60c088a8e89863d"} Jul 29 19:22:32.521336 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:32.521022 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:32.522512 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:32.522484 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" event={"ID":"b6a106cc-ad82-4096-9fc4-78f7e8421a85","Type":"ContainerStarted","Data":"ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9"} Jul 29 19:22:32.522625 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:32.522580 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:32.560302 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:32.560245 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" podStartSLOduration=0.94400033 podStartE2EDuration="3.560230409s" totalImagesPullingTime="2.616230079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:32.5597413 +0000 UTC m=+470.924824043" watchObservedRunningTime="2026-07-29 19:22:32.560230409 +0000 UTC m=+470.925313151" Jul 29 19:22:32.602639 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:32.602582 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" podStartSLOduration=1.569654394 podStartE2EDuration="4.602564506s" totalImagesPullingTime="3.032910112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:32.60132325 +0000 UTC m=+470.966405991" watchObservedRunningTime="2026-07-29 19:22:32.602564506 +0000 UTC m=+470.967647249" Jul 29 19:22:43.529669 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:43.529641 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cbvnk" Jul 29 19:22:43.530111 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:43.529705 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:43.624103 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:43.624070 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jcg7"] Jul 29 19:22:43.624265 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:43.624237 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" podUID="b6a106cc-ad82-4096-9fc4-78f7e8421a85" containerName="limitador" containerID="cri-o://ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9" gracePeriod=30 Jul 29 19:22:44.575373 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.575350 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:44.581097 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.581066 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6a106cc-ad82-4096-9fc4-78f7e8421a85" containerID="ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9" exitCode=0 Jul 29 19:22:44.581210 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.581102 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" Jul 29 19:22:44.581210 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.581142 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" event={"ID":"b6a106cc-ad82-4096-9fc4-78f7e8421a85","Type":"ContainerDied","Data":"ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9"} Jul 29 19:22:44.581210 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.581205 2574 scope.go:117] "RemoveContainer" containerID="ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9" Jul 29 19:22:44.581447 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.581193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jcg7" event={"ID":"b6a106cc-ad82-4096-9fc4-78f7e8421a85","Type":"ContainerDied","Data":"9a570da89e52446d6eefa30b65de69aef4ee920bf44a3da6efd6ba7706bcd7e6"} Jul 29 19:22:44.593334 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.593303 2574 scope.go:117] "RemoveContainer" containerID="ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9" Jul 29 19:22:44.593620 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:22:44.593600 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9\": container with ID starting with ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9 not found: ID does not exist" containerID="ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9" Jul 29 19:22:44.593671 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.593630 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9"} err="failed to get container status \"ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9\": rpc error: code = NotFound desc = could not find container \"ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9\": container with ID starting with ed7255b6b7d8750d285f9d8846cd451aee3dbd2baf248f70575a115037aeb6d9 not found: ID does not exist" Jul 29 19:22:44.610567 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.610539 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a106cc-ad82-4096-9fc4-78f7e8421a85-config-file\") pod \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\" (UID: \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\") " Jul 29 19:22:44.610705 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.610604 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjs8p\" (UniqueName: \"kubernetes.io/projected/b6a106cc-ad82-4096-9fc4-78f7e8421a85-kube-api-access-fjs8p\") pod \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\" (UID: \"b6a106cc-ad82-4096-9fc4-78f7e8421a85\") " Jul 29 19:22:44.610946 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.610926 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6a106cc-ad82-4096-9fc4-78f7e8421a85-config-file" (OuterVolumeSpecName: "config-file") pod "b6a106cc-ad82-4096-9fc4-78f7e8421a85" (UID: "b6a106cc-ad82-4096-9fc4-78f7e8421a85"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:22:44.612945 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.612914 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a106cc-ad82-4096-9fc4-78f7e8421a85-kube-api-access-fjs8p" (OuterVolumeSpecName: "kube-api-access-fjs8p") pod "b6a106cc-ad82-4096-9fc4-78f7e8421a85" (UID: "b6a106cc-ad82-4096-9fc4-78f7e8421a85"). InnerVolumeSpecName "kube-api-access-fjs8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:22:44.711357 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.711270 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a106cc-ad82-4096-9fc4-78f7e8421a85-config-file\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:22:44.711357 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.711302 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjs8p\" (UniqueName: \"kubernetes.io/projected/b6a106cc-ad82-4096-9fc4-78f7e8421a85-kube-api-access-fjs8p\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:22:44.904640 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.904615 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jcg7"] Jul 29 19:22:44.909667 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:44.909645 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jcg7"] Jul 29 19:22:46.212272 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:46.212239 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a106cc-ad82-4096-9fc4-78f7e8421a85" path="/var/lib/kubelet/pods/b6a106cc-ad82-4096-9fc4-78f7e8421a85/volumes" Jul 29 19:22:50.269061 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.269029 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt"] Jul 29 19:22:50.269515 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.269499 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a106cc-ad82-4096-9fc4-78f7e8421a85" containerName="limitador" Jul 29 19:22:50.269559 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.269520 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a106cc-ad82-4096-9fc4-78f7e8421a85" containerName="limitador" Jul 29 19:22:50.269655 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.269642 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a106cc-ad82-4096-9fc4-78f7e8421a85" containerName="limitador" Jul 29 19:22:50.274498 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.274480 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:22:50.277128 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.277108 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-smktn\"" Jul 29 19:22:50.278035 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.278011 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 29 19:22:50.278149 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.278127 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 29 19:22:50.278556 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.278539 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 29 19:22:50.287910 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.286773 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt"] Jul 29 19:22:50.352844 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.352810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/859bb2ce-5475-4e76-af06-1c8cd67f47b1-data\") pod \"postgres-69fb4594cf-cbsmt\" (UID: \"859bb2ce-5475-4e76-af06-1c8cd67f47b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:22:50.353039 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.352861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gwxk\" (UniqueName: \"kubernetes.io/projected/859bb2ce-5475-4e76-af06-1c8cd67f47b1-kube-api-access-2gwxk\") pod \"postgres-69fb4594cf-cbsmt\" (UID: \"859bb2ce-5475-4e76-af06-1c8cd67f47b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:22:50.454122 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.454080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/859bb2ce-5475-4e76-af06-1c8cd67f47b1-data\") pod \"postgres-69fb4594cf-cbsmt\" (UID: \"859bb2ce-5475-4e76-af06-1c8cd67f47b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:22:50.454295 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.454140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gwxk\" (UniqueName: \"kubernetes.io/projected/859bb2ce-5475-4e76-af06-1c8cd67f47b1-kube-api-access-2gwxk\") pod \"postgres-69fb4594cf-cbsmt\" (UID: \"859bb2ce-5475-4e76-af06-1c8cd67f47b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:22:50.454491 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.454470 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/859bb2ce-5475-4e76-af06-1c8cd67f47b1-data\") pod \"postgres-69fb4594cf-cbsmt\" (UID: \"859bb2ce-5475-4e76-af06-1c8cd67f47b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:22:50.463278 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.463246 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gwxk\" (UniqueName: \"kubernetes.io/projected/859bb2ce-5475-4e76-af06-1c8cd67f47b1-kube-api-access-2gwxk\") pod \"postgres-69fb4594cf-cbsmt\" (UID: \"859bb2ce-5475-4e76-af06-1c8cd67f47b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:22:50.586712 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.586681 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:22:50.730369 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:50.730338 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt"] Jul 29 19:22:50.733510 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:22:50.733484 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859bb2ce_5475_4e76_af06_1c8cd67f47b1.slice/crio-35beff44083035faf4346900ee351b16574d81aadd5e795e4aea505be4c71fd9 WatchSource:0}: Error finding container 35beff44083035faf4346900ee351b16574d81aadd5e795e4aea505be4c71fd9: Status 404 returned error can't find the container with id 35beff44083035faf4346900ee351b16574d81aadd5e795e4aea505be4c71fd9 Jul 29 19:22:51.616417 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:51.616379 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" event={"ID":"859bb2ce-5475-4e76-af06-1c8cd67f47b1","Type":"ContainerStarted","Data":"35beff44083035faf4346900ee351b16574d81aadd5e795e4aea505be4c71fd9"} Jul 29 19:22:57.651209 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:57.651173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" event={"ID":"859bb2ce-5475-4e76-af06-1c8cd67f47b1","Type":"ContainerStarted","Data":"bf90c34be50b86cc8ccae42971d6f3a9b1b3eebe34952c2acb27593b835afaae"} Jul 29 19:22:57.651606 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:57.651321 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:22:57.670581 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:22:57.670531 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" podStartSLOduration=1.544643031 podStartE2EDuration="7.670515268s" totalImagesPullingTime="6.125872237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:57.668300784 +0000 UTC m=+496.033383526" watchObservedRunningTime="2026-07-29 19:22:57.670515268 +0000 UTC m=+496.035598007" Jul 29 19:23:03.688767 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:03.688738 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cbsmt" Jul 29 19:23:45.754624 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.754586 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-rm4bg"] Jul 29 19:23:45.757711 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.757694 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:23:45.760706 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.760682 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kjk5b\"" Jul 29 19:23:45.760706 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.760700 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 29 19:23:45.773394 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.773354 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-rm4bg"] Jul 29 19:23:45.861584 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.861550 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ghlk\" (UniqueName: \"kubernetes.io/projected/2d8f9976-a10f-494a-af70-c4dd33007cc0-kube-api-access-2ghlk\") pod \"payload-processing-5cc6cd444b-rm4bg\" (UID: \"2d8f9976-a10f-494a-af70-c4dd33007cc0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:23:45.861746 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.861596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d8f9976-a10f-494a-af70-c4dd33007cc0-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-rm4bg\" (UID: \"2d8f9976-a10f-494a-af70-c4dd33007cc0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:23:45.868352 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.868325 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:23:45.962375 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.962340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ghlk\" (UniqueName: \"kubernetes.io/projected/2d8f9976-a10f-494a-af70-c4dd33007cc0-kube-api-access-2ghlk\") pod \"payload-processing-5cc6cd444b-rm4bg\" (UID: \"2d8f9976-a10f-494a-af70-c4dd33007cc0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:23:45.962569 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.962405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d8f9976-a10f-494a-af70-c4dd33007cc0-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-rm4bg\" (UID: \"2d8f9976-a10f-494a-af70-c4dd33007cc0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:23:45.963184 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.963163 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d8f9976-a10f-494a-af70-c4dd33007cc0-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-rm4bg\" (UID: \"2d8f9976-a10f-494a-af70-c4dd33007cc0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:23:45.973302 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:45.973281 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ghlk\" (UniqueName: \"kubernetes.io/projected/2d8f9976-a10f-494a-af70-c4dd33007cc0-kube-api-access-2ghlk\") pod \"payload-processing-5cc6cd444b-rm4bg\" (UID: \"2d8f9976-a10f-494a-af70-c4dd33007cc0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:23:46.069229 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:46.069148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:23:46.233940 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:46.233915 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-rm4bg"] Jul 29 19:23:46.236281 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:23:46.236246 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8f9976_a10f_494a_af70_c4dd33007cc0.slice/crio-404ee20e3debafaae005a3868a62c50abaad4feb9e343a79abd3301f337ffee3 WatchSource:0}: Error finding container 404ee20e3debafaae005a3868a62c50abaad4feb9e343a79abd3301f337ffee3: Status 404 returned error can't find the container with id 404ee20e3debafaae005a3868a62c50abaad4feb9e343a79abd3301f337ffee3 Jul 29 19:23:46.901139 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:46.901100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" event={"ID":"2d8f9976-a10f-494a-af70-c4dd33007cc0","Type":"ContainerStarted","Data":"404ee20e3debafaae005a3868a62c50abaad4feb9e343a79abd3301f337ffee3"} Jul 29 19:23:49.920756 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:49.920724 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" event={"ID":"2d8f9976-a10f-494a-af70-c4dd33007cc0","Type":"ContainerStarted","Data":"66a53acfa7bbf0e985d9e892cd94e3d3d6f8d41c0f7e65b933f898ab501c99c5"} Jul 29 19:23:49.921160 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:49.920853 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:23:49.939964 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:49.939910 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" podStartSLOduration=2.139632388 podStartE2EDuration="4.939871383s" totalImagesPullingTime="2.800238995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:49.938532431 +0000 UTC m=+548.303615174" watchObservedRunningTime="2026-07-29 19:23:49.939871383 +0000 UTC m=+548.304954128" Jul 29 19:23:53.944380 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:53.944347 2574 generic.go:356] "Generic (PLEG): container finished" podID="86dc81f5-9b81-414c-959c-7131d782fa51" containerID="f4fac4720dcf5e08588bfa2ea10a26909c076ada5f149f5136b635f8bf609ea1" exitCode=0 Jul 29 19:23:53.944773 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:53.944410 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" event={"ID":"86dc81f5-9b81-414c-959c-7131d782fa51","Type":"ContainerDied","Data":"f4fac4720dcf5e08588bfa2ea10a26909c076ada5f149f5136b635f8bf609ea1"} Jul 29 19:23:53.944827 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:53.944783 2574 scope.go:117] "RemoveContainer" containerID="f4fac4720dcf5e08588bfa2ea10a26909c076ada5f149f5136b635f8bf609ea1" Jul 29 19:23:53.945855 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:53.945829 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 19:23:53.945938 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:53.945922 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 19:23:53.946002 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:53.945955 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 19:23:54.950909 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:54.950866 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" event={"ID":"86dc81f5-9b81-414c-959c-7131d782fa51","Type":"ContainerStarted","Data":"c3105dd9929a93ccf528d6f5e965692055b325e16c0bdba8701d25e7860bd86f"} Jul 29 19:23:55.191114 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:55.191069 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:23:55.191326 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:55.191298 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tpkbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 29 19:23:55.191401 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:55.191360 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" podUID="86dc81f5-9b81-414c-959c-7131d782fa51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 29 19:23:56.190289 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:56.190251 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tpkbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 29 19:23:56.190913 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:56.190851 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" podUID="86dc81f5-9b81-414c-959c-7131d782fa51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 29 19:23:57.190243 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:57.190196 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tpkbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 29 19:23:57.190456 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:57.190268 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" podUID="86dc81f5-9b81-414c-959c-7131d782fa51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 29 19:23:58.190501 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:58.190461 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tpkbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 29 19:23:58.191532 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:58.191118 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" podUID="86dc81f5-9b81-414c-959c-7131d782fa51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 29 19:23:58.469266 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:58.469183 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:23:59.194041 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:59.194006 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:23:59.195032 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:23:59.195011 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tpkbb" Jul 29 19:24:00.929503 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:00.929472 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-rm4bg" Jul 29 19:24:07.450052 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:07.450017 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:24:25.034211 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.034170 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86"] Jul 29 19:24:25.036794 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.036772 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.041580 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.041557 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 29 19:24:25.041982 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.041958 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 29 19:24:25.042801 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.042783 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 29 19:24:25.043129 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.043107 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pm4b4\"" Jul 29 19:24:25.056296 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.056275 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86"] Jul 29 19:24:25.159241 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.159210 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n88b8\" (UniqueName: \"kubernetes.io/projected/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-kube-api-access-n88b8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.159241 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.159250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.159460 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.159277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.159460 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.159334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.159460 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.159381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.159460 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.159399 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.260130 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.260092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.260130 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.260130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.260386 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.260179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n88b8\" (UniqueName: \"kubernetes.io/projected/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-kube-api-access-n88b8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.260386 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.260200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.260386 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.260220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.260386 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.260248 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.260611 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.260588 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.260656 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.260635 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.260693 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.260653 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.262525 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.262504 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.262774 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.262755 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.269712 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.269688 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n88b8\" (UniqueName: \"kubernetes.io/projected/565e7c8c-3e74-42e3-b2fa-3b34bed2740a-kube-api-access-n88b8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hwp86\" (UID: \"565e7c8c-3e74-42e3-b2fa-3b34bed2740a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.348813 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.348760 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:25.505650 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.501727 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86"] Jul 29 19:24:25.507482 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:24:25.507452 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565e7c8c_3e74_42e3_b2fa_3b34bed2740a.slice/crio-bf563ddcaa2171a6926a2aaea09247e00775e3edd6cd1a2df4fe8e850708528b WatchSource:0}: Error finding container bf563ddcaa2171a6926a2aaea09247e00775e3edd6cd1a2df4fe8e850708528b: Status 404 returned error can't find the container with id bf563ddcaa2171a6926a2aaea09247e00775e3edd6cd1a2df4fe8e850708528b Jul 29 19:24:25.559979 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:25.559940 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:24:26.115352 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:26.115315 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" event={"ID":"565e7c8c-3e74-42e3-b2fa-3b34bed2740a","Type":"ContainerStarted","Data":"bf563ddcaa2171a6926a2aaea09247e00775e3edd6cd1a2df4fe8e850708528b"} Jul 29 19:24:27.122086 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:27.122043 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" event={"ID":"565e7c8c-3e74-42e3-b2fa-3b34bed2740a","Type":"ContainerStarted","Data":"bbfaa570402b664f5efdfcdf5736adce73f6639af3901f1e6c3b0543ce73a92a"} Jul 29 19:24:27.143405 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:27.143359 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" podStartSLOduration=1.163656394 podStartE2EDuration="2.143342816s" totalImagesPullingTime="979.686422ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:27.140968394 +0000 UTC m=+585.506051138" watchObservedRunningTime="2026-07-29 19:24:27.143342816 +0000 UTC m=+585.508425557" Jul 29 19:24:31.049027 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:31.048990 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:24:35.349294 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:35.349257 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:35.349703 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:35.349325 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:35.362054 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:35.362033 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:36.177456 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:36.177415 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hwp86" Jul 29 19:24:41.142045 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:41.142009 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:24:42.060805 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:42.060774 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:24:42.063034 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:42.063009 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:24:47.092769 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.092724 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns"] Jul 29 19:24:47.095507 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.095482 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.098449 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.098428 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 29 19:24:47.120618 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.120589 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns"] Jul 29 19:24:47.167278 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.167241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.167278 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.167278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d01ab86-9f17-4dd5-8851-703bf8028f8f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.167498 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.167357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.167498 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.167385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qlrf\" (UniqueName: \"kubernetes.io/projected/9d01ab86-9f17-4dd5-8851-703bf8028f8f-kube-api-access-8qlrf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.167498 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.167405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.167498 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.167422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.268105 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.268064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.268105 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.268103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qlrf\" (UniqueName: \"kubernetes.io/projected/9d01ab86-9f17-4dd5-8851-703bf8028f8f-kube-api-access-8qlrf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.268379 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.268132 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.268379 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.268195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.268488 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.268402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.268488 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.268467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d01ab86-9f17-4dd5-8851-703bf8028f8f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.268595 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.268541 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.268595 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.268583 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.268701 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.268607 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.271211 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.271186 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d01ab86-9f17-4dd5-8851-703bf8028f8f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.271925 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.271875 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d01ab86-9f17-4dd5-8851-703bf8028f8f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.280944 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.280879 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qlrf\" (UniqueName: \"kubernetes.io/projected/9d01ab86-9f17-4dd5-8851-703bf8028f8f-kube-api-access-8qlrf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-69mns\" (UID: \"9d01ab86-9f17-4dd5-8851-703bf8028f8f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.405439 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.405351 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:47.551770 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:47.551744 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns"] Jul 29 19:24:47.554097 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:24:47.554068 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d01ab86_9f17_4dd5_8851_703bf8028f8f.slice/crio-199dd9a03fd9b32fe11e6ffb24aec76b2e3ce3025eda471d0d2b9436de66baac WatchSource:0}: Error finding container 199dd9a03fd9b32fe11e6ffb24aec76b2e3ce3025eda471d0d2b9436de66baac: Status 404 returned error can't find the container with id 199dd9a03fd9b32fe11e6ffb24aec76b2e3ce3025eda471d0d2b9436de66baac Jul 29 19:24:48.238019 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:48.237980 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" event={"ID":"9d01ab86-9f17-4dd5-8851-703bf8028f8f","Type":"ContainerStarted","Data":"7873f6880f89a9960fd4ff7dc929b2556047fed0a3ce985e744539fa642db7c6"} Jul 29 19:24:48.238019 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:48.238025 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" event={"ID":"9d01ab86-9f17-4dd5-8851-703bf8028f8f","Type":"ContainerStarted","Data":"199dd9a03fd9b32fe11e6ffb24aec76b2e3ce3025eda471d0d2b9436de66baac"} Jul 29 19:24:48.258284 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:48.258238 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" podStartSLOduration=1.040582379 podStartE2EDuration="1.258222461s" totalImagesPullingTime="217.640082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:48.256633372 +0000 UTC m=+606.621716115" watchObservedRunningTime="2026-07-29 19:24:48.258222461 +0000 UTC m=+606.623305204" Jul 29 19:24:51.243472 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:51.243433 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:24:57.406070 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:57.406020 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:57.406070 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:57.406080 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:57.418554 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:57.418522 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:24:58.306786 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:24:58.306757 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-69mns" Jul 29 19:26:41.835300 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:26:41.835219 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:26:52.033763 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:26:52.033723 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:27:03.038022 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:27:03.037989 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:28:44.343770 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:28:44.343736 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:28:52.638628 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:28:52.638594 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:29:23.040668 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:29:23.040633 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:29:32.150400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:29:32.150362 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:29:39.938808 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:29:39.938718 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:29:42.097191 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:29:42.097161 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:29:42.097623 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:29:42.097541 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:29:47.645758 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:29:47.645718 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:29:58.935317 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:29:58.935278 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:30:09.128799 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:30:09.128758 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:30:19.640496 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:30:19.640463 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:30:29.835040 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:30:29.835001 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:30:50.840241 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:30:50.840208 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:31:00.534483 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:31:00.534446 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:31:24.334720 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:31:24.334681 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:31:40.133403 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:31:40.133372 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:31:49.134203 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:31:49.134164 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:32:00.146848 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:32:00.146809 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:32:10.033413 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:32:10.033369 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:32:19.348555 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:32:19.348512 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:32:28.642269 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:32:28.642231 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:32:37.636648 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:32:37.636561 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:33:12.742443 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:12.742404 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb"] Jul 29 19:33:12.742994 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:12.742588 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" podUID="2720aa50-e623-4eb7-b8e4-54e99f036434" containerName="manager" containerID="cri-o://6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4" gracePeriod=10 Jul 29 19:33:16.310441 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.310410 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:33:16.372257 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.372171 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tstfx\" (UniqueName: \"kubernetes.io/projected/2720aa50-e623-4eb7-b8e4-54e99f036434-kube-api-access-tstfx\") pod \"2720aa50-e623-4eb7-b8e4-54e99f036434\" (UID: \"2720aa50-e623-4eb7-b8e4-54e99f036434\") " Jul 29 19:33:16.372400 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.372275 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2720aa50-e623-4eb7-b8e4-54e99f036434-extensions-socket-volume\") pod \"2720aa50-e623-4eb7-b8e4-54e99f036434\" (UID: \"2720aa50-e623-4eb7-b8e4-54e99f036434\") " Jul 29 19:33:16.372728 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.372694 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2720aa50-e623-4eb7-b8e4-54e99f036434-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2720aa50-e623-4eb7-b8e4-54e99f036434" (UID: "2720aa50-e623-4eb7-b8e4-54e99f036434"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:33:16.374572 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.374536 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2720aa50-e623-4eb7-b8e4-54e99f036434-kube-api-access-tstfx" (OuterVolumeSpecName: "kube-api-access-tstfx") pod "2720aa50-e623-4eb7-b8e4-54e99f036434" (UID: "2720aa50-e623-4eb7-b8e4-54e99f036434"). InnerVolumeSpecName "kube-api-access-tstfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:33:16.473574 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.473522 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2720aa50-e623-4eb7-b8e4-54e99f036434-extensions-socket-volume\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:33:16.473574 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.473568 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tstfx\" (UniqueName: \"kubernetes.io/projected/2720aa50-e623-4eb7-b8e4-54e99f036434-kube-api-access-tstfx\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 19:33:16.886276 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.886241 2574 generic.go:356] "Generic (PLEG): container finished" podID="2720aa50-e623-4eb7-b8e4-54e99f036434" containerID="6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4" exitCode=0 Jul 29 19:33:16.886447 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.886290 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" Jul 29 19:33:16.886447 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.886333 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" event={"ID":"2720aa50-e623-4eb7-b8e4-54e99f036434","Type":"ContainerDied","Data":"6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4"} Jul 29 19:33:16.886447 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.886392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb" event={"ID":"2720aa50-e623-4eb7-b8e4-54e99f036434","Type":"ContainerDied","Data":"ee4d2ecc8401ad89b2119041f6f1cb951bd8f5c7fc00c1f3b045186b76861034"} Jul 29 19:33:16.886447 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.886420 2574 scope.go:117] "RemoveContainer" containerID="6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4" Jul 29 19:33:16.896720 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.896699 2574 scope.go:117] "RemoveContainer" containerID="6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4" Jul 29 19:33:16.897064 ip-10-0-132-216 kubenswrapper[2574]: E0729 19:33:16.897044 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4\": container with ID starting with 6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4 not found: ID does not exist" containerID="6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4" Jul 29 19:33:16.897127 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.897074 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4"} err="failed to get container status \"6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4\": rpc error: code = NotFound desc = could not find container \"6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4\": container with ID starting with 6be24feb9fda9df3ccf68c87e110ade1dcae652ca4ad63aa9a913bc4d72299c4 not found: ID does not exist" Jul 29 19:33:16.919542 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.919508 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb"] Jul 29 19:33:16.926324 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:16.926298 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xjpdb"] Jul 29 19:33:18.213412 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:33:18.213377 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2720aa50-e623-4eb7-b8e4-54e99f036434" path="/var/lib/kubelet/pods/2720aa50-e623-4eb7-b8e4-54e99f036434/volumes" Jul 29 19:34:13.862053 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.862016 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w"] Jul 29 19:34:13.864393 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.862463 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2720aa50-e623-4eb7-b8e4-54e99f036434" containerName="manager" Jul 29 19:34:13.864393 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.862475 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2720aa50-e623-4eb7-b8e4-54e99f036434" containerName="manager" Jul 29 19:34:13.864393 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.862554 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2720aa50-e623-4eb7-b8e4-54e99f036434" containerName="manager" Jul 29 19:34:13.865702 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.865687 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:13.868960 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.868926 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8kvmh\"" Jul 29 19:34:13.879977 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.879954 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w"] Jul 29 19:34:13.888195 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.888174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27997f2e-7b2d-40ac-ad06-672996329742-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rc97w\" (UID: \"27997f2e-7b2d-40ac-ad06-672996329742\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:13.888277 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.888217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkp2s\" (UniqueName: \"kubernetes.io/projected/27997f2e-7b2d-40ac-ad06-672996329742-kube-api-access-qkp2s\") pod \"kuadrant-operator-controller-manager-86878c769f-rc97w\" (UID: \"27997f2e-7b2d-40ac-ad06-672996329742\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:13.989478 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.989442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27997f2e-7b2d-40ac-ad06-672996329742-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rc97w\" (UID: \"27997f2e-7b2d-40ac-ad06-672996329742\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:13.989665 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.989489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkp2s\" (UniqueName: \"kubernetes.io/projected/27997f2e-7b2d-40ac-ad06-672996329742-kube-api-access-qkp2s\") pod \"kuadrant-operator-controller-manager-86878c769f-rc97w\" (UID: \"27997f2e-7b2d-40ac-ad06-672996329742\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:13.989864 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.989843 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27997f2e-7b2d-40ac-ad06-672996329742-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rc97w\" (UID: \"27997f2e-7b2d-40ac-ad06-672996329742\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:13.998812 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:13.998786 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkp2s\" (UniqueName: \"kubernetes.io/projected/27997f2e-7b2d-40ac-ad06-672996329742-kube-api-access-qkp2s\") pod \"kuadrant-operator-controller-manager-86878c769f-rc97w\" (UID: \"27997f2e-7b2d-40ac-ad06-672996329742\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:14.176018 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:14.175934 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:14.322192 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:14.322154 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w"] Jul 29 19:34:14.334492 ip-10-0-132-216 kubenswrapper[2574]: W0729 19:34:14.334466 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27997f2e_7b2d_40ac_ad06_672996329742.slice/crio-d9ab887171d7fc3a92ec3aedad3b8a94ed89c01678eb226378dbe7e34b49e7e5 WatchSource:0}: Error finding container d9ab887171d7fc3a92ec3aedad3b8a94ed89c01678eb226378dbe7e34b49e7e5: Status 404 returned error can't find the container with id d9ab887171d7fc3a92ec3aedad3b8a94ed89c01678eb226378dbe7e34b49e7e5 Jul 29 19:34:15.181125 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:15.181082 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" event={"ID":"27997f2e-7b2d-40ac-ad06-672996329742","Type":"ContainerStarted","Data":"f5f4e1f15441472064696f59d57453932336866718d8c303ac167c502d14205e"} Jul 29 19:34:15.181622 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:15.181149 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" event={"ID":"27997f2e-7b2d-40ac-ad06-672996329742","Type":"ContainerStarted","Data":"d9ab887171d7fc3a92ec3aedad3b8a94ed89c01678eb226378dbe7e34b49e7e5"} Jul 29 19:34:15.181622 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:15.181188 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:15.203265 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:15.203223 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" podStartSLOduration=2.203209821 podStartE2EDuration="2.203209821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:34:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:34:15.201596194 +0000 UTC m=+1173.566678936" watchObservedRunningTime="2026-07-29 19:34:15.203209821 +0000 UTC m=+1173.568292560" Jul 29 19:34:26.188828 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:26.188790 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc97w" Jul 29 19:34:34.662739 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:34.662705 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:34:42.128087 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:42.128059 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:34:42.129764 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:42.129738 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:34:45.448945 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:34:45.448906 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:35:00.238279 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:35:00.238241 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:35:11.045144 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:35:11.045106 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:35:23.239765 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:35:23.239725 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:35:31.448724 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:35:31.448682 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:35:40.941855 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:35:40.941773 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:35:53.146975 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:35:53.146939 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:36:00.935808 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:36:00.935772 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:36:12.245136 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:36:12.245099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:36:23.640289 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:36:23.640251 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:36:31.642128 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:36:31.642089 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:36:51.532876 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:36:51.532836 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:36:59.142966 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:36:59.142928 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:37:13.336492 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:37:13.336459 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:37:26.053878 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:37:26.053845 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:37:43.750145 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:37:43.750096 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:37:57.857916 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:37:57.857867 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:38:04.637806 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:38:04.637768 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:38:21.041679 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:38:21.041645 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:38:32.545094 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:38:32.545059 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:38:40.930454 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:38:40.930372 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:38:50.141179 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:38:50.141140 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:39:01.049118 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:39:01.049076 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:39:09.633301 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:39:09.633263 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:39:22.949952 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:39:22.949920 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:39:32.236951 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:39:32.236905 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:39:42.160669 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:39:42.160634 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:39:42.163419 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:39:42.163397 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:39:42.238142 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:39:42.238105 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:39:53.043745 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:39:53.043712 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:40:04.256579 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:40:04.256495 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:40:14.456458 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:40:14.456414 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:40:27.147229 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:40:27.147193 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:40:39.045912 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:40:39.045866 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:40:50.637169 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:40:50.637129 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:41:03.659495 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:41:03.659465 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:41:18.244762 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:41:18.244728 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:41:33.337024 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:41:33.336932 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:42:14.832963 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:42:14.832921 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:42:25.545276 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:42:25.545240 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:42:49.890195 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:42:49.890155 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:42:59.639519 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:42:59.639482 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:43:24.152727 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:43:24.152688 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:43:34.041219 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:43:34.041187 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:43:59.285658 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:43:59.285621 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:44:10.434367 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:44:10.434333 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:44:42.194074 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:44:42.194044 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:44:42.197879 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:44:42.197854 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:45:22.142142 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:45:22.142098 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:45:38.356234 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:45:38.356196 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:45:47.831513 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:45:47.831469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:45:58.734026 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:45:58.733987 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:46:38.940361 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:46:38.940322 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:47:11.341345 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:47:11.341306 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:47:38.161542 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:47:38.161503 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:47:50.933956 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:47:50.933919 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:48:08.029191 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:48:08.029151 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:48:20.263933 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:48:20.263903 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:49:12.241757 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:49:12.241679 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:49:22.133039 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:49:22.133003 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:49:42.225803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:49:42.225773 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:49:42.230207 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:49:42.230180 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:50:14.131633 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:50:14.131595 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:50:43.730483 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:50:43.730443 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:51:11.337771 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:51:11.337732 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:51:21.731131 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:51:21.731095 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:51:51.835470 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:51:51.835434 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:52:30.932208 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:52:30.932172 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:52:46.629120 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:52:46.629082 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:52:59.336467 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:52:59.336431 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:53:10.726046 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:53:10.726008 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:53:41.337947 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:53:41.337907 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:54:21.326126 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:54:21.326078 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:54:42.255856 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:54:42.255827 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:54:42.262058 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:54:42.262029 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:54:45.936069 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:54:45.936031 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:54:57.132198 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:54:57.132158 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:55:27.140739 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:55:27.140697 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:55:59.929803 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:55:59.929767 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:56:28.452211 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:56:28.452173 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:56:56.127078 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:56:56.127040 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:57:17.432738 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:57:17.432700 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:57:36.636455 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:57:36.636412 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:58:03.176918 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:58:03.176863 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:58:19.335042 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:58:19.335003 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:58:42.537456 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:58:42.537419 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:59:00.841760 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:59:00.841724 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:59:25.630671 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:59:25.630629 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:59:41.631480 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:59:41.631447 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 19:59:42.287432 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:59:42.287315 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 19:59:42.295327 ip-10-0-132-216 kubenswrapper[2574]: I0729 19:59:42.295303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 20:00:01.825883 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:00:01.825840 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:00:20.536342 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:00:20.536301 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:00:47.337392 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:00:47.337355 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:01:04.537185 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:01:04.537101 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:01:39.132169 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:01:39.132130 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:02:09.828133 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:02:09.828096 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:02:28.330194 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:02:28.330158 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:02:43.139218 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:02:43.139115 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:03:00.333835 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:03:00.333793 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:03:49.230303 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:03:49.230261 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:04:21.528802 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:21.528752 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:04:37.633571 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:37.633529 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:04:42.318142 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:42.318026 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 20:04:42.326343 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:42.326317 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 20:04:51.836021 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:51.835986 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:04:58.331029 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.330998 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-140700325804464"] Jul 29 20:04:58.334609 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.334587 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325804464" Jul 29 20:04:58.337270 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.337248 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qlf9s\"" Jul 29 20:04:58.340148 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.340127 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325804464"] Jul 29 20:04:58.523675 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.523633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8zvz\" (UniqueName: \"kubernetes.io/projected/b71bbd52-f32a-4489-9dbe-98868f14ab80-kube-api-access-c8zvz\") pod \"test-curl-7476-140700325804464\" (UID: \"b71bbd52-f32a-4489-9dbe-98868f14ab80\") " pod="opendatahub/test-curl-7476-140700325804464" Jul 29 20:04:58.624804 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.624710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zvz\" (UniqueName: \"kubernetes.io/projected/b71bbd52-f32a-4489-9dbe-98868f14ab80-kube-api-access-c8zvz\") pod \"test-curl-7476-140700325804464\" (UID: \"b71bbd52-f32a-4489-9dbe-98868f14ab80\") " pod="opendatahub/test-curl-7476-140700325804464" Jul 29 20:04:58.633429 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.633397 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8zvz\" (UniqueName: \"kubernetes.io/projected/b71bbd52-f32a-4489-9dbe-98868f14ab80-kube-api-access-c8zvz\") pod \"test-curl-7476-140700325804464\" (UID: \"b71bbd52-f32a-4489-9dbe-98868f14ab80\") " pod="opendatahub/test-curl-7476-140700325804464" Jul 29 20:04:58.645374 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.645348 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325804464" Jul 29 20:04:58.784945 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.784917 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325804464"] Jul 29 20:04:58.786234 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:04:58.786204 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb71bbd52_f32a_4489_9dbe_98868f14ab80.slice/crio-fefd0dcb1044faff0065392886cec18ccdeb18a060ca7472ce1dd211353c003a WatchSource:0}: Error finding container fefd0dcb1044faff0065392886cec18ccdeb18a060ca7472ce1dd211353c003a: Status 404 returned error can't find the container with id fefd0dcb1044faff0065392886cec18ccdeb18a060ca7472ce1dd211353c003a Jul 29 20:04:58.787774 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:58.787758 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 20:04:59.667394 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:04:59.667363 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325804464" event={"ID":"b71bbd52-f32a-4489-9dbe-98868f14ab80","Type":"ContainerStarted","Data":"fefd0dcb1044faff0065392886cec18ccdeb18a060ca7472ce1dd211353c003a"} Jul 29 20:05:00.674538 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:00.674497 2574 generic.go:356] "Generic (PLEG): container finished" podID="b71bbd52-f32a-4489-9dbe-98868f14ab80" containerID="3a2033a039f9bdfd198e305696b1da97c98420a90561dbc9292a57cafd7c6d53" exitCode=0 Jul 29 20:05:00.675032 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:00.674584 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325804464" event={"ID":"b71bbd52-f32a-4489-9dbe-98868f14ab80","Type":"ContainerDied","Data":"3a2033a039f9bdfd198e305696b1da97c98420a90561dbc9292a57cafd7c6d53"} Jul 29 20:05:01.833447 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:01.833414 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325804464" Jul 29 20:05:01.856881 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:01.856840 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8zvz\" (UniqueName: \"kubernetes.io/projected/b71bbd52-f32a-4489-9dbe-98868f14ab80-kube-api-access-c8zvz\") pod \"b71bbd52-f32a-4489-9dbe-98868f14ab80\" (UID: \"b71bbd52-f32a-4489-9dbe-98868f14ab80\") " Jul 29 20:05:01.859317 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:01.859284 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b71bbd52-f32a-4489-9dbe-98868f14ab80-kube-api-access-c8zvz" (OuterVolumeSpecName: "kube-api-access-c8zvz") pod "b71bbd52-f32a-4489-9dbe-98868f14ab80" (UID: "b71bbd52-f32a-4489-9dbe-98868f14ab80"). InnerVolumeSpecName "kube-api-access-c8zvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:05:01.870578 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:01.870546 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7476-140700325804464_b71bbd52-f32a-4489-9dbe-98868f14ab80/test-curl-7476-140700325804464/0.log" Jul 29 20:05:01.895375 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:01.895340 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-140700325804464"] Jul 29 20:05:01.897240 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:01.897212 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-140700325804464"] Jul 29 20:05:01.958745 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:01.958646 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8zvz\" (UniqueName: \"kubernetes.io/projected/b71bbd52-f32a-4489-9dbe-98868f14ab80-kube-api-access-c8zvz\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:05:02.018907 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.018850 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-140700325860784"] Jul 29 20:05:02.019338 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.019323 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71bbd52-f32a-4489-9dbe-98868f14ab80" containerName="test-curl-7476-140700325804464" Jul 29 20:05:02.019383 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.019340 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71bbd52-f32a-4489-9dbe-98868f14ab80" containerName="test-curl-7476-140700325804464" Jul 29 20:05:02.019418 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.019403 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71bbd52-f32a-4489-9dbe-98868f14ab80" containerName="test-curl-7476-140700325804464" Jul 29 20:05:02.022801 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.022771 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325860784" Jul 29 20:05:02.026367 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.026336 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325860784"] Jul 29 20:05:02.059686 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.059646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g54wk\" (UniqueName: \"kubernetes.io/projected/a9d8fbff-e086-4ea4-9bb3-20fec27be932-kube-api-access-g54wk\") pod \"test-curl-7476-140700325860784\" (UID: \"a9d8fbff-e086-4ea4-9bb3-20fec27be932\") " pod="opendatahub/test-curl-7476-140700325860784" Jul 29 20:05:02.161284 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.161228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g54wk\" (UniqueName: \"kubernetes.io/projected/a9d8fbff-e086-4ea4-9bb3-20fec27be932-kube-api-access-g54wk\") pod \"test-curl-7476-140700325860784\" (UID: \"a9d8fbff-e086-4ea4-9bb3-20fec27be932\") " pod="opendatahub/test-curl-7476-140700325860784" Jul 29 20:05:02.170584 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.170550 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g54wk\" (UniqueName: \"kubernetes.io/projected/a9d8fbff-e086-4ea4-9bb3-20fec27be932-kube-api-access-g54wk\") pod \"test-curl-7476-140700325860784\" (UID: \"a9d8fbff-e086-4ea4-9bb3-20fec27be932\") " pod="opendatahub/test-curl-7476-140700325860784" Jul 29 20:05:02.212615 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.212531 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b71bbd52-f32a-4489-9dbe-98868f14ab80" path="/var/lib/kubelet/pods/b71bbd52-f32a-4489-9dbe-98868f14ab80/volumes" Jul 29 20:05:02.334601 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.334565 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325860784" Jul 29 20:05:02.480535 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.480498 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325860784"] Jul 29 20:05:02.481632 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:05:02.481597 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9d8fbff_e086_4ea4_9bb3_20fec27be932.slice/crio-ab1075a4dab2528f0fb957acc89795aa4f1f41ec5fc05717fd3e35a859fa5280 WatchSource:0}: Error finding container ab1075a4dab2528f0fb957acc89795aa4f1f41ec5fc05717fd3e35a859fa5280: Status 404 returned error can't find the container with id ab1075a4dab2528f0fb957acc89795aa4f1f41ec5fc05717fd3e35a859fa5280 Jul 29 20:05:02.686317 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.686287 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325804464" Jul 29 20:05:02.686511 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.686348 2574 scope.go:117] "RemoveContainer" containerID="3a2033a039f9bdfd198e305696b1da97c98420a90561dbc9292a57cafd7c6d53" Jul 29 20:05:02.687683 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:02.687655 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325860784" event={"ID":"a9d8fbff-e086-4ea4-9bb3-20fec27be932","Type":"ContainerStarted","Data":"ab1075a4dab2528f0fb957acc89795aa4f1f41ec5fc05717fd3e35a859fa5280"} Jul 29 20:05:03.695401 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:03.695368 2574 generic.go:356] "Generic (PLEG): container finished" podID="a9d8fbff-e086-4ea4-9bb3-20fec27be932" containerID="eb16d68cfc587153faf9fd6161de0741f32e978bcce702651d854fde18ee3524" exitCode=0 Jul 29 20:05:03.695800 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:03.695414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325860784" event={"ID":"a9d8fbff-e086-4ea4-9bb3-20fec27be932","Type":"ContainerDied","Data":"eb16d68cfc587153faf9fd6161de0741f32e978bcce702651d854fde18ee3524"} Jul 29 20:05:04.846079 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:04.846051 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325860784" Jul 29 20:05:04.865527 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:04.865486 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7476-140700325860784_a9d8fbff-e086-4ea4-9bb3-20fec27be932/test-curl-7476-140700325860784/0.log" Jul 29 20:05:04.886841 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:04.886792 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-140700325860784"] Jul 29 20:05:04.888199 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:04.888173 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g54wk\" (UniqueName: \"kubernetes.io/projected/a9d8fbff-e086-4ea4-9bb3-20fec27be932-kube-api-access-g54wk\") pod \"a9d8fbff-e086-4ea4-9bb3-20fec27be932\" (UID: \"a9d8fbff-e086-4ea4-9bb3-20fec27be932\") " Jul 29 20:05:04.890579 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:04.890555 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-140700325860784"] Jul 29 20:05:04.890804 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:04.890775 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9d8fbff-e086-4ea4-9bb3-20fec27be932-kube-api-access-g54wk" (OuterVolumeSpecName: "kube-api-access-g54wk") pod "a9d8fbff-e086-4ea4-9bb3-20fec27be932" (UID: "a9d8fbff-e086-4ea4-9bb3-20fec27be932"). InnerVolumeSpecName "kube-api-access-g54wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:05:04.990216 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:04.990125 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g54wk\" (UniqueName: \"kubernetes.io/projected/a9d8fbff-e086-4ea4-9bb3-20fec27be932-kube-api-access-g54wk\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:05:05.053942 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.053905 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:05.054324 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.054309 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9d8fbff-e086-4ea4-9bb3-20fec27be932" containerName="test-curl-7476-140700325860784" Jul 29 20:05:05.054375 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.054325 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9d8fbff-e086-4ea4-9bb3-20fec27be932" containerName="test-curl-7476-140700325860784" Jul 29 20:05:05.054420 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.054382 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9d8fbff-e086-4ea4-9bb3-20fec27be932" containerName="test-curl-7476-140700325860784" Jul 29 20:05:05.057294 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.057279 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:05.064608 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.064584 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:05.091524 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.091480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxzf7\" (UniqueName: \"kubernetes.io/projected/7ffcf76a-e383-43b4-a67c-54bbcba5891a-kube-api-access-wxzf7\") pod \"test-curl-7476-140700325857296\" (UID: \"7ffcf76a-e383-43b4-a67c-54bbcba5891a\") " pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:05.192924 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.192871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxzf7\" (UniqueName: \"kubernetes.io/projected/7ffcf76a-e383-43b4-a67c-54bbcba5891a-kube-api-access-wxzf7\") pod \"test-curl-7476-140700325857296\" (UID: \"7ffcf76a-e383-43b4-a67c-54bbcba5891a\") " pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:05.203237 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.203200 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxzf7\" (UniqueName: \"kubernetes.io/projected/7ffcf76a-e383-43b4-a67c-54bbcba5891a-kube-api-access-wxzf7\") pod \"test-curl-7476-140700325857296\" (UID: \"7ffcf76a-e383-43b4-a67c-54bbcba5891a\") " pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:05.367280 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.367252 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:05.509725 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.509612 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:05.511861 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:05:05.511836 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ffcf76a_e383_43b4_a67c_54bbcba5891a.slice/crio-b8ee08d620ac1760922455fd70ed0d60bd7fe3b22f1bcfb480ef45175e3e642a WatchSource:0}: Error finding container b8ee08d620ac1760922455fd70ed0d60bd7fe3b22f1bcfb480ef45175e3e642a: Status 404 returned error can't find the container with id b8ee08d620ac1760922455fd70ed0d60bd7fe3b22f1bcfb480ef45175e3e642a Jul 29 20:05:05.706042 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.705949 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325857296" event={"ID":"7ffcf76a-e383-43b4-a67c-54bbcba5891a","Type":"ContainerStarted","Data":"b8ee08d620ac1760922455fd70ed0d60bd7fe3b22f1bcfb480ef45175e3e642a"} Jul 29 20:05:05.707187 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.707159 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab1075a4dab2528f0fb957acc89795aa4f1f41ec5fc05717fd3e35a859fa5280" Jul 29 20:05:05.707305 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:05.707188 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325860784" Jul 29 20:05:05.718487 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:05:05.718461 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7476-140700325860784\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="a9d8fbff-e086-4ea4-9bb3-20fec27be932" pod="opendatahub/test-curl-7476-140700325860784" Jul 29 20:05:06.212590 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:06.212499 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9d8fbff-e086-4ea4-9bb3-20fec27be932" path="/var/lib/kubelet/pods/a9d8fbff-e086-4ea4-9bb3-20fec27be932/volumes" Jul 29 20:05:06.713701 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:06.713670 2574 generic.go:356] "Generic (PLEG): container finished" podID="7ffcf76a-e383-43b4-a67c-54bbcba5891a" containerID="8e120082217587fe217419fccf43715212359276a3531fe2bf5195ff6393dede" exitCode=0 Jul 29 20:05:06.713928 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:06.713757 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325857296" event={"ID":"7ffcf76a-e383-43b4-a67c-54bbcba5891a","Type":"ContainerDied","Data":"8e120082217587fe217419fccf43715212359276a3531fe2bf5195ff6393dede"} Jul 29 20:05:07.724882 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:07.724854 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:05:07.866245 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:07.866216 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:07.886002 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:07.885970 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7476-140700325857296_7ffcf76a-e383-43b4-a67c-54bbcba5891a/test-curl-7476-140700325857296/0.log" Jul 29 20:05:07.908507 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:07.908466 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:07.914408 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:07.914375 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:07.914682 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:07.914661 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxzf7\" (UniqueName: \"kubernetes.io/projected/7ffcf76a-e383-43b4-a67c-54bbcba5891a-kube-api-access-wxzf7\") pod \"7ffcf76a-e383-43b4-a67c-54bbcba5891a\" (UID: \"7ffcf76a-e383-43b4-a67c-54bbcba5891a\") " Jul 29 20:05:07.916934 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:07.916908 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ffcf76a-e383-43b4-a67c-54bbcba5891a-kube-api-access-wxzf7" (OuterVolumeSpecName: "kube-api-access-wxzf7") pod "7ffcf76a-e383-43b4-a67c-54bbcba5891a" (UID: "7ffcf76a-e383-43b4-a67c-54bbcba5891a"). InnerVolumeSpecName "kube-api-access-wxzf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:05:08.015612 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.015512 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxzf7\" (UniqueName: \"kubernetes.io/projected/7ffcf76a-e383-43b4-a67c-54bbcba5891a-kube-api-access-wxzf7\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:05:08.029997 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.029956 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:08.030457 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.030438 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ffcf76a-e383-43b4-a67c-54bbcba5891a" containerName="test-curl-7476-140700325857296" Jul 29 20:05:08.030545 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.030460 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ffcf76a-e383-43b4-a67c-54bbcba5891a" containerName="test-curl-7476-140700325857296" Jul 29 20:05:08.030604 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.030574 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ffcf76a-e383-43b4-a67c-54bbcba5891a" containerName="test-curl-7476-140700325857296" Jul 29 20:05:08.033567 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.033548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:08.038050 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.038029 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:08.116463 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.116394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcs2p\" (UniqueName: \"kubernetes.io/projected/f06ce3c1-577f-49be-ac09-0a7b5a982512-kube-api-access-jcs2p\") pod \"test-curl-7476-140700325857296\" (UID: \"f06ce3c1-577f-49be-ac09-0a7b5a982512\") " pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:08.212832 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.212796 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ffcf76a-e383-43b4-a67c-54bbcba5891a" path="/var/lib/kubelet/pods/7ffcf76a-e383-43b4-a67c-54bbcba5891a/volumes" Jul 29 20:05:08.217130 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.217097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcs2p\" (UniqueName: \"kubernetes.io/projected/f06ce3c1-577f-49be-ac09-0a7b5a982512-kube-api-access-jcs2p\") pod \"test-curl-7476-140700325857296\" (UID: \"f06ce3c1-577f-49be-ac09-0a7b5a982512\") " pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:08.226220 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.226194 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcs2p\" (UniqueName: \"kubernetes.io/projected/f06ce3c1-577f-49be-ac09-0a7b5a982512-kube-api-access-jcs2p\") pod \"test-curl-7476-140700325857296\" (UID: \"f06ce3c1-577f-49be-ac09-0a7b5a982512\") " pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:08.344020 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.343988 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:08.489175 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.489139 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:08.491110 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:05:08.491086 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf06ce3c1_577f_49be_ac09_0a7b5a982512.slice/crio-34aaf29936864d79b748a501c674d85cc2cd8b486334514ca21cc6c6a1cf8d08 WatchSource:0}: Error finding container 34aaf29936864d79b748a501c674d85cc2cd8b486334514ca21cc6c6a1cf8d08: Status 404 returned error can't find the container with id 34aaf29936864d79b748a501c674d85cc2cd8b486334514ca21cc6c6a1cf8d08 Jul 29 20:05:08.724693 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.724664 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:08.724919 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.724721 2574 scope.go:117] "RemoveContainer" containerID="8e120082217587fe217419fccf43715212359276a3531fe2bf5195ff6393dede" Jul 29 20:05:08.726154 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:08.725996 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325857296" event={"ID":"f06ce3c1-577f-49be-ac09-0a7b5a982512","Type":"ContainerStarted","Data":"34aaf29936864d79b748a501c674d85cc2cd8b486334514ca21cc6c6a1cf8d08"} Jul 29 20:05:09.734196 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:09.734160 2574 generic.go:356] "Generic (PLEG): container finished" podID="f06ce3c1-577f-49be-ac09-0a7b5a982512" containerID="eccc6d3bd84af7bb2a6e226ad1b291ebeec221a2b3163eaa9efb5da546055881" exitCode=0 Jul 29 20:05:09.734694 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:09.734223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325857296" event={"ID":"f06ce3c1-577f-49be-ac09-0a7b5a982512","Type":"ContainerDied","Data":"eccc6d3bd84af7bb2a6e226ad1b291ebeec221a2b3163eaa9efb5da546055881"} Jul 29 20:05:10.888462 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:10.888431 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:10.908665 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:10.908633 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7476-140700325857296_f06ce3c1-577f-49be-ac09-0a7b5a982512/test-curl-7476-140700325857296/0.log" Jul 29 20:05:10.935031 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:10.934997 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:10.939865 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:10.939827 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-140700325857296"] Jul 29 20:05:10.944614 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:10.944585 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcs2p\" (UniqueName: \"kubernetes.io/projected/f06ce3c1-577f-49be-ac09-0a7b5a982512-kube-api-access-jcs2p\") pod \"f06ce3c1-577f-49be-ac09-0a7b5a982512\" (UID: \"f06ce3c1-577f-49be-ac09-0a7b5a982512\") " Jul 29 20:05:10.946852 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:10.946825 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f06ce3c1-577f-49be-ac09-0a7b5a982512-kube-api-access-jcs2p" (OuterVolumeSpecName: "kube-api-access-jcs2p") pod "f06ce3c1-577f-49be-ac09-0a7b5a982512" (UID: "f06ce3c1-577f-49be-ac09-0a7b5a982512"). InnerVolumeSpecName "kube-api-access-jcs2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:05:11.045856 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.045753 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcs2p\" (UniqueName: \"kubernetes.io/projected/f06ce3c1-577f-49be-ac09-0a7b5a982512-kube-api-access-jcs2p\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:05:11.061199 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.061160 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:11.061592 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.061578 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06ce3c1-577f-49be-ac09-0a7b5a982512" containerName="test-curl-7476-140700325857296" Jul 29 20:05:11.061637 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.061594 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06ce3c1-577f-49be-ac09-0a7b5a982512" containerName="test-curl-7476-140700325857296" Jul 29 20:05:11.061692 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.061682 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06ce3c1-577f-49be-ac09-0a7b5a982512" containerName="test-curl-7476-140700325857296" Jul 29 20:05:11.064597 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.064580 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:11.071102 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.071072 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:11.146919 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.146844 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/e49f6ea9-511b-49b5-a0f5-c25489862c0b-kube-api-access-6fld8\") pod \"test-curl-7476-140700325858304\" (UID: \"e49f6ea9-511b-49b5-a0f5-c25489862c0b\") " pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:11.247610 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.247573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/e49f6ea9-511b-49b5-a0f5-c25489862c0b-kube-api-access-6fld8\") pod \"test-curl-7476-140700325858304\" (UID: \"e49f6ea9-511b-49b5-a0f5-c25489862c0b\") " pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:11.256699 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.256667 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/e49f6ea9-511b-49b5-a0f5-c25489862c0b-kube-api-access-6fld8\") pod \"test-curl-7476-140700325858304\" (UID: \"e49f6ea9-511b-49b5-a0f5-c25489862c0b\") " pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:11.375789 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.375751 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:11.523102 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.523076 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:11.525446 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:05:11.525424 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode49f6ea9_511b_49b5_a0f5_c25489862c0b.slice/crio-58d35ec7e2950cfbba6dba69786c8c600f2cdc0d4f29dd294de4231af38fe764 WatchSource:0}: Error finding container 58d35ec7e2950cfbba6dba69786c8c600f2cdc0d4f29dd294de4231af38fe764: Status 404 returned error can't find the container with id 58d35ec7e2950cfbba6dba69786c8c600f2cdc0d4f29dd294de4231af38fe764 Jul 29 20:05:11.745056 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.745013 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34aaf29936864d79b748a501c674d85cc2cd8b486334514ca21cc6c6a1cf8d08" Jul 29 20:05:11.745056 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.745033 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:11.746330 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:11.746297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325858304" event={"ID":"e49f6ea9-511b-49b5-a0f5-c25489862c0b","Type":"ContainerStarted","Data":"58d35ec7e2950cfbba6dba69786c8c600f2cdc0d4f29dd294de4231af38fe764"} Jul 29 20:05:11.756654 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:05:11.756624 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7476-140700325857296\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="f06ce3c1-577f-49be-ac09-0a7b5a982512" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:12.210470 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:05:12.210428 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7476-140700325857296\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="f06ce3c1-577f-49be-ac09-0a7b5a982512" pod="opendatahub/test-curl-7476-140700325857296" Jul 29 20:05:12.212739 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:12.212713 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f06ce3c1-577f-49be-ac09-0a7b5a982512" path="/var/lib/kubelet/pods/f06ce3c1-577f-49be-ac09-0a7b5a982512/volumes" Jul 29 20:05:12.753178 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:12.753139 2574 generic.go:356] "Generic (PLEG): container finished" podID="e49f6ea9-511b-49b5-a0f5-c25489862c0b" containerID="d389dbfd3c342dd18e190ba535af38ddc385a3e44a49b53376dd294bb2dd41b8" exitCode=0 Jul 29 20:05:12.753369 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:12.753194 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325858304" event={"ID":"e49f6ea9-511b-49b5-a0f5-c25489862c0b","Type":"ContainerDied","Data":"d389dbfd3c342dd18e190ba535af38ddc385a3e44a49b53376dd294bb2dd41b8"} Jul 29 20:05:13.902774 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:13.902749 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:13.922392 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:13.922364 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7476-140700325858304_e49f6ea9-511b-49b5-a0f5-c25489862c0b/test-curl-7476-140700325858304/0.log" Jul 29 20:05:13.945950 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:13.945914 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:13.949168 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:13.949143 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:13.973614 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:13.973585 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/e49f6ea9-511b-49b5-a0f5-c25489862c0b-kube-api-access-6fld8\") pod \"e49f6ea9-511b-49b5-a0f5-c25489862c0b\" (UID: \"e49f6ea9-511b-49b5-a0f5-c25489862c0b\") " Jul 29 20:05:13.975981 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:13.975948 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49f6ea9-511b-49b5-a0f5-c25489862c0b-kube-api-access-6fld8" (OuterVolumeSpecName: "kube-api-access-6fld8") pod "e49f6ea9-511b-49b5-a0f5-c25489862c0b" (UID: "e49f6ea9-511b-49b5-a0f5-c25489862c0b"). InnerVolumeSpecName "kube-api-access-6fld8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:05:14.065903 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.065805 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:14.066270 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.066254 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e49f6ea9-511b-49b5-a0f5-c25489862c0b" containerName="test-curl-7476-140700325858304" Jul 29 20:05:14.066313 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.066272 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e49f6ea9-511b-49b5-a0f5-c25489862c0b" containerName="test-curl-7476-140700325858304" Jul 29 20:05:14.066351 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.066331 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e49f6ea9-511b-49b5-a0f5-c25489862c0b" containerName="test-curl-7476-140700325858304" Jul 29 20:05:14.069125 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.069110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:14.074938 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.074402 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/e49f6ea9-511b-49b5-a0f5-c25489862c0b-kube-api-access-6fld8\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:05:14.076753 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.076399 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:14.175304 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.175261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zmtj\" (UniqueName: \"kubernetes.io/projected/6f64763a-bb33-462d-8462-e23d361b3bcd-kube-api-access-9zmtj\") pod \"test-curl-7476-140700325858304\" (UID: \"6f64763a-bb33-462d-8462-e23d361b3bcd\") " pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:14.212612 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.212576 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e49f6ea9-511b-49b5-a0f5-c25489862c0b" path="/var/lib/kubelet/pods/e49f6ea9-511b-49b5-a0f5-c25489862c0b/volumes" Jul 29 20:05:14.276456 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.276408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zmtj\" (UniqueName: \"kubernetes.io/projected/6f64763a-bb33-462d-8462-e23d361b3bcd-kube-api-access-9zmtj\") pod \"test-curl-7476-140700325858304\" (UID: \"6f64763a-bb33-462d-8462-e23d361b3bcd\") " pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:14.284692 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.284666 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zmtj\" (UniqueName: \"kubernetes.io/projected/6f64763a-bb33-462d-8462-e23d361b3bcd-kube-api-access-9zmtj\") pod \"test-curl-7476-140700325858304\" (UID: \"6f64763a-bb33-462d-8462-e23d361b3bcd\") " pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:14.380358 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.380324 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:14.520268 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.520233 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:14.522682 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:05:14.522640 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f64763a_bb33_462d_8462_e23d361b3bcd.slice/crio-bbb1a5762d3c6f37278051ca13d541c828e85449c233d9f5463ce53f3bfb6572 WatchSource:0}: Error finding container bbb1a5762d3c6f37278051ca13d541c828e85449c233d9f5463ce53f3bfb6572: Status 404 returned error can't find the container with id bbb1a5762d3c6f37278051ca13d541c828e85449c233d9f5463ce53f3bfb6572 Jul 29 20:05:14.765599 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.765564 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:14.765599 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.765591 2574 scope.go:117] "RemoveContainer" containerID="d389dbfd3c342dd18e190ba535af38ddc385a3e44a49b53376dd294bb2dd41b8" Jul 29 20:05:14.766967 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:14.766825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325858304" event={"ID":"6f64763a-bb33-462d-8462-e23d361b3bcd","Type":"ContainerStarted","Data":"bbb1a5762d3c6f37278051ca13d541c828e85449c233d9f5463ce53f3bfb6572"} Jul 29 20:05:15.775589 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:15.775545 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f64763a-bb33-462d-8462-e23d361b3bcd" containerID="0405bbc4d70f6f083401c84b3c71a346090b9ff8a90997891c186ea86ece8886" exitCode=0 Jul 29 20:05:15.776236 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:15.775585 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7476-140700325858304" event={"ID":"6f64763a-bb33-462d-8462-e23d361b3bcd","Type":"ContainerDied","Data":"0405bbc4d70f6f083401c84b3c71a346090b9ff8a90997891c186ea86ece8886"} Jul 29 20:05:16.929318 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:16.929290 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:16.947945 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:16.947912 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7476-140700325858304_6f64763a-bb33-462d-8462-e23d361b3bcd/test-curl-7476-140700325858304/0.log" Jul 29 20:05:16.969132 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:16.969098 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:16.972676 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:16.972648 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7476-140700325858304"] Jul 29 20:05:17.002105 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:17.002068 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zmtj\" (UniqueName: \"kubernetes.io/projected/6f64763a-bb33-462d-8462-e23d361b3bcd-kube-api-access-9zmtj\") pod \"6f64763a-bb33-462d-8462-e23d361b3bcd\" (UID: \"6f64763a-bb33-462d-8462-e23d361b3bcd\") " Jul 29 20:05:17.004294 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:17.004263 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f64763a-bb33-462d-8462-e23d361b3bcd-kube-api-access-9zmtj" (OuterVolumeSpecName: "kube-api-access-9zmtj") pod "6f64763a-bb33-462d-8462-e23d361b3bcd" (UID: "6f64763a-bb33-462d-8462-e23d361b3bcd"). InnerVolumeSpecName "kube-api-access-9zmtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:05:17.102742 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:17.102705 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zmtj\" (UniqueName: \"kubernetes.io/projected/6f64763a-bb33-462d-8462-e23d361b3bcd-kube-api-access-9zmtj\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:05:17.787437 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:17.787408 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:17.787437 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:17.787424 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbb1a5762d3c6f37278051ca13d541c828e85449c233d9f5463ce53f3bfb6572" Jul 29 20:05:17.799041 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:05:17.799005 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7476-140700325858304\" is forbidden: User \"system:node:ip-10-0-132-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-216.ec2.internal' and this object" podUID="6f64763a-bb33-462d-8462-e23d361b3bcd" pod="opendatahub/test-curl-7476-140700325858304" Jul 29 20:05:18.212253 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:18.212219 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f64763a-bb33-462d-8462-e23d361b3bcd" path="/var/lib/kubelet/pods/6f64763a-bb33-462d-8462-e23d361b3bcd/volumes" Jul 29 20:05:21.176620 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.176580 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s"] Jul 29 20:05:21.177347 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.177291 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f64763a-bb33-462d-8462-e23d361b3bcd" containerName="test-curl-7476-140700325858304" Jul 29 20:05:21.177347 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.177317 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f64763a-bb33-462d-8462-e23d361b3bcd" containerName="test-curl-7476-140700325858304" Jul 29 20:05:21.177576 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.177418 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f64763a-bb33-462d-8462-e23d361b3bcd" containerName="test-curl-7476-140700325858304" Jul 29 20:05:21.180865 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.180843 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.183631 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.183608 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-d722d0-serving-cert\"" Jul 29 20:05:21.183772 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.183702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bjg7f\"" Jul 29 20:05:21.191013 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.190985 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s"] Jul 29 20:05:21.241694 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.241648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/580dcb4f-3dab-4726-81fd-4bae3e928565-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.241879 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.241778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/580dcb4f-3dab-4726-81fd-4bae3e928565-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.241953 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.241914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s956f\" (UniqueName: \"kubernetes.io/projected/580dcb4f-3dab-4726-81fd-4bae3e928565-kube-api-access-s956f\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.342594 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.342556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/580dcb4f-3dab-4726-81fd-4bae3e928565-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.342802 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.342643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s956f\" (UniqueName: \"kubernetes.io/projected/580dcb4f-3dab-4726-81fd-4bae3e928565-kube-api-access-s956f\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.342802 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.342670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/580dcb4f-3dab-4726-81fd-4bae3e928565-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.342802 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:05:21.342737 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-serving-cert: secret "maas-api-e2e-ipp-a-d722d0-serving-cert" not found Jul 29 20:05:21.343035 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:05:21.342810 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/580dcb4f-3dab-4726-81fd-4bae3e928565-maas-api-tls podName:580dcb4f-3dab-4726-81fd-4bae3e928565 nodeName:}" failed. No retries permitted until 2026-07-29 20:05:21.842790332 +0000 UTC m=+3040.207873069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/580dcb4f-3dab-4726-81fd-4bae3e928565-maas-api-tls") pod "maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" (UID: "580dcb4f-3dab-4726-81fd-4bae3e928565") : secret "maas-api-e2e-ipp-a-d722d0-serving-cert" not found Jul 29 20:05:21.343560 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.343537 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/580dcb4f-3dab-4726-81fd-4bae3e928565-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.354446 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.354421 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s956f\" (UniqueName: \"kubernetes.io/projected/580dcb4f-3dab-4726-81fd-4bae3e928565-kube-api-access-s956f\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.852831 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.852792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/580dcb4f-3dab-4726-81fd-4bae3e928565-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:21.855517 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:21.855492 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/580dcb4f-3dab-4726-81fd-4bae3e928565-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:22.093827 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:22.093788 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:22.240423 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:22.240398 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s"] Jul 29 20:05:22.242594 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:05:22.242566 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580dcb4f_3dab_4726_81fd_4bae3e928565.slice/crio-2e41693a7f135031b339b9413db29944c469259246889c1e0479b21fb7502815 WatchSource:0}: Error finding container 2e41693a7f135031b339b9413db29944c469259246889c1e0479b21fb7502815: Status 404 returned error can't find the container with id 2e41693a7f135031b339b9413db29944c469259246889c1e0479b21fb7502815 Jul 29 20:05:22.816975 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:22.816936 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" event={"ID":"580dcb4f-3dab-4726-81fd-4bae3e928565","Type":"ContainerStarted","Data":"2e41693a7f135031b339b9413db29944c469259246889c1e0479b21fb7502815"} Jul 29 20:05:24.830444 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:24.830412 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" event={"ID":"580dcb4f-3dab-4726-81fd-4bae3e928565","Type":"ContainerStarted","Data":"72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18"} Jul 29 20:05:24.830850 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:24.830482 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:24.849299 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:24.849242 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" podStartSLOduration=1.463013631 podStartE2EDuration="3.849226792s" totalImagesPullingTime="2.386213161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:05:24.847222697 +0000 UTC m=+3043.212305439" watchObservedRunningTime="2026-07-29 20:05:24.849226792 +0000 UTC m=+3043.214309537" Jul 29 20:05:29.835826 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:29.835787 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:05:30.841849 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:30.841817 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:05:47.105998 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.105960 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr"] Jul 29 20:05:47.111279 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.111259 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.114902 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.114864 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5560c5-openshift-default-dockercfg-txzn2\"" Jul 29 20:05:47.132381 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.132348 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr"] Jul 29 20:05:47.187363 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.187324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-credential-socket\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.187557 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.187377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-envoy\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.187557 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.187451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-certs\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.187557 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.187506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istiod-ca-cert\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.187557 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.187545 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-data\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.187781 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.187563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-socket\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.187781 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.187582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-token\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.187781 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.187633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-podinfo\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.187781 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.187689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87lp9\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-kube-api-access-87lp9\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.288471 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.288419 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-podinfo\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.288643 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.288485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87lp9\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-kube-api-access-87lp9\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.288643 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.288540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-credential-socket\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.288919 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.288857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-envoy\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289006 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.288988 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-certs\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289073 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.289057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istiod-ca-cert\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289156 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.289055 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-credential-socket\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289242 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.289143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-data\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289428 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.289337 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-certs\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289512 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.289348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-socket\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289512 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.289503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-token\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289691 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.289552 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-data\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289816 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.289732 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-socket\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.289907 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.289874 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istiod-ca-cert\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.291302 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.291282 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-envoy\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.291383 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.291310 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-podinfo\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.299250 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.299219 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-token\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.299373 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.299332 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87lp9\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-kube-api-access-87lp9\") pod \"e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.432847 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.432763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:47.577838 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.577802 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr"] Jul 29 20:05:47.578957 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:05:47.578932 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4385feed_ba9c_4c56_a1d1_7dc1dd7ed1a5.slice/crio-2980e5f2c1142efa9bb8e14ae2e4e543863dce81c22c61d67e0e4c252b6cea84 WatchSource:0}: Error finding container 2980e5f2c1142efa9bb8e14ae2e4e543863dce81c22c61d67e0e4c252b6cea84: Status 404 returned error can't find the container with id 2980e5f2c1142efa9bb8e14ae2e4e543863dce81c22c61d67e0e4c252b6cea84 Jul 29 20:05:47.581607 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.581571 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 20:05:47.581692 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.581657 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 20:05:47.581741 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.581697 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 20:05:47.952848 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.952803 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" event={"ID":"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5","Type":"ContainerStarted","Data":"2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c"} Jul 29 20:05:47.953082 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.952863 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" event={"ID":"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5","Type":"ContainerStarted","Data":"2980e5f2c1142efa9bb8e14ae2e4e543863dce81c22c61d67e0e4c252b6cea84"} Jul 29 20:05:47.974724 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:47.974663 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" podStartSLOduration=0.974643754 podStartE2EDuration="974.643754ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:05:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:05:47.974229945 +0000 UTC m=+3066.339312717" watchObservedRunningTime="2026-07-29 20:05:47.974643754 +0000 UTC m=+3066.339726498" Jul 29 20:05:48.433167 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:48.433125 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:48.438496 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:48.438471 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:48.959251 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:48.959221 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:48.960298 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:48.960280 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:05:50.126130 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.126080 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l"] Jul 29 20:05:50.130165 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.130143 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.133825 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.133803 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-5560c5-serving-cert\"" Jul 29 20:05:50.141734 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.141667 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l"] Jul 29 20:05:50.216958 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.216930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.217108 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.217020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btk2c\" (UniqueName: \"kubernetes.io/projected/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-kube-api-access-btk2c\") pod \"maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.217172 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.217141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.318582 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.318542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btk2c\" (UniqueName: \"kubernetes.io/projected/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-kube-api-access-btk2c\") pod \"maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.318783 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.318606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.318783 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.318637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.319333 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.319305 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.321253 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.321229 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.330339 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.330310 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btk2c\" (UniqueName: \"kubernetes.io/projected/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-kube-api-access-btk2c\") pod \"maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.445963 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.445864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:50.601811 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.601780 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l"] Jul 29 20:05:50.603856 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:05:50.603820 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f72bab_7ee2_489f_b3b9_f58d5a6ed887.slice/crio-94c8915526346125a699b2de0d16ff040828d9ebfabfddb685c5c48444e8f9e3 WatchSource:0}: Error finding container 94c8915526346125a699b2de0d16ff040828d9ebfabfddb685c5c48444e8f9e3: Status 404 returned error can't find the container with id 94c8915526346125a699b2de0d16ff040828d9ebfabfddb685c5c48444e8f9e3 Jul 29 20:05:50.972116 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:50.972068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" event={"ID":"66f72bab-7ee2-489f-b3b9-f58d5a6ed887","Type":"ContainerStarted","Data":"94c8915526346125a699b2de0d16ff040828d9ebfabfddb685c5c48444e8f9e3"} Jul 29 20:05:51.979364 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:51.979329 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" event={"ID":"66f72bab-7ee2-489f-b3b9-f58d5a6ed887","Type":"ContainerStarted","Data":"931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f"} Jul 29 20:05:51.979794 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:51.979485 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:51.998605 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:51.998551 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" podStartSLOduration=1.4202864370000001 podStartE2EDuration="1.998535191s" totalImagesPullingTime="578.248754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:05:51.996995578 +0000 UTC m=+3070.362078319" watchObservedRunningTime="2026-07-29 20:05:51.998535191 +0000 UTC m=+3070.363617932" Jul 29 20:05:57.990346 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:57.990314 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:05:58.513362 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:58.513330 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rmkxg"] Jul 29 20:05:58.521629 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:58.521604 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:05:58.526040 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:58.526016 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rmkxg"] Jul 29 20:05:58.608491 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:58.608452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ztmd\" (UniqueName: \"kubernetes.io/projected/7bde3ca1-b67c-4e43-95b9-544918141407-kube-api-access-6ztmd\") pod \"kuadrant-operator-catalog-rmkxg\" (UID: \"7bde3ca1-b67c-4e43-95b9-544918141407\") " pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:05:58.709778 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:58.709744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ztmd\" (UniqueName: \"kubernetes.io/projected/7bde3ca1-b67c-4e43-95b9-544918141407-kube-api-access-6ztmd\") pod \"kuadrant-operator-catalog-rmkxg\" (UID: \"7bde3ca1-b67c-4e43-95b9-544918141407\") " pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:05:58.717761 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:58.717733 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ztmd\" (UniqueName: \"kubernetes.io/projected/7bde3ca1-b67c-4e43-95b9-544918141407-kube-api-access-6ztmd\") pod \"kuadrant-operator-catalog-rmkxg\" (UID: \"7bde3ca1-b67c-4e43-95b9-544918141407\") " pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:05:58.834310 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:58.834277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:05:58.978645 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:58.978619 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rmkxg"] Jul 29 20:05:58.981252 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:05:58.981221 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bde3ca1_b67c_4e43_95b9_544918141407.slice/crio-3b82bb64a3d7b2d26ef33d3bb0feb1a612b589d2db0db76733f96d60e808b34b WatchSource:0}: Error finding container 3b82bb64a3d7b2d26ef33d3bb0feb1a612b589d2db0db76733f96d60e808b34b: Status 404 returned error can't find the container with id 3b82bb64a3d7b2d26ef33d3bb0feb1a612b589d2db0db76733f96d60e808b34b Jul 29 20:05:59.018072 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:59.018037 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" event={"ID":"7bde3ca1-b67c-4e43-95b9-544918141407","Type":"ContainerStarted","Data":"3b82bb64a3d7b2d26ef33d3bb0feb1a612b589d2db0db76733f96d60e808b34b"} Jul 29 20:05:59.128369 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:05:59.128276 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:06:00.024743 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:00.024628 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" event={"ID":"7bde3ca1-b67c-4e43-95b9-544918141407","Type":"ContainerStarted","Data":"f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3"} Jul 29 20:06:00.042519 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:00.042466 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" podStartSLOduration=1.402176693 podStartE2EDuration="2.042450918s" totalImagesPullingTime="640.274225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:06:00.040593342 +0000 UTC m=+3078.405676087" watchObservedRunningTime="2026-07-29 20:06:00.042450918 +0000 UTC m=+3078.407533659" Jul 29 20:06:08.071246 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:08.071214 2574 generic.go:356] "Generic (PLEG): container finished" podID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerID="2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c" exitCode=0 Jul 29 20:06:08.071747 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:08.071295 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" event={"ID":"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5","Type":"ContainerDied","Data":"2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c"} Jul 29 20:06:08.071822 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:08.071743 2574 scope.go:117] "RemoveContainer" containerID="2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c" Jul 29 20:06:08.073046 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:08.073011 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 20:06:08.073123 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:08.073112 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 20:06:08.073165 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:08.073156 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 29 20:06:08.834807 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:08.834773 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:06:08.835062 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:08.834831 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:06:08.857534 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:08.857506 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:06:09.079279 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:09.079249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" event={"ID":"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5","Type":"ContainerStarted","Data":"ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd"} Jul 29 20:06:09.102295 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:09.102215 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:06:09.136431 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:09.136395 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rmkxg"] Jul 29 20:06:09.433617 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:09.433515 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:06:09.433775 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:09.433742 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 20:06:09.433826 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:09.433805 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 20:06:10.433296 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:10.433204 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 20:06:10.433296 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:10.433263 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 20:06:11.097802 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:11.097753 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" podUID="7bde3ca1-b67c-4e43-95b9-544918141407" containerName="registry-server" containerID="cri-o://f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3" gracePeriod=2 Jul 29 20:06:11.395393 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:11.395097 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:06:11.433593 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:11.433559 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 20:06:11.434098 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:11.433616 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 20:06:11.464864 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:11.464827 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rm4bg_2d8f9976-a10f-494a-af70-c4dd33007cc0/payload-processing/0.log" Jul 29 20:06:11.544450 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:11.544408 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ztmd\" (UniqueName: \"kubernetes.io/projected/7bde3ca1-b67c-4e43-95b9-544918141407-kube-api-access-6ztmd\") pod \"7bde3ca1-b67c-4e43-95b9-544918141407\" (UID: \"7bde3ca1-b67c-4e43-95b9-544918141407\") " Jul 29 20:06:11.546836 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:11.546811 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bde3ca1-b67c-4e43-95b9-544918141407-kube-api-access-6ztmd" (OuterVolumeSpecName: "kube-api-access-6ztmd") pod "7bde3ca1-b67c-4e43-95b9-544918141407" (UID: "7bde3ca1-b67c-4e43-95b9-544918141407"). InnerVolumeSpecName "kube-api-access-6ztmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:06:11.646251 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:11.646161 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ztmd\" (UniqueName: \"kubernetes.io/projected/7bde3ca1-b67c-4e43-95b9-544918141407-kube-api-access-6ztmd\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:06:12.105936 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.105883 2574 generic.go:356] "Generic (PLEG): container finished" podID="7bde3ca1-b67c-4e43-95b9-544918141407" containerID="f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3" exitCode=0 Jul 29 20:06:12.106134 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.105940 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" event={"ID":"7bde3ca1-b67c-4e43-95b9-544918141407","Type":"ContainerDied","Data":"f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3"} Jul 29 20:06:12.106134 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.105997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" event={"ID":"7bde3ca1-b67c-4e43-95b9-544918141407","Type":"ContainerDied","Data":"3b82bb64a3d7b2d26ef33d3bb0feb1a612b589d2db0db76733f96d60e808b34b"} Jul 29 20:06:12.106134 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.105957 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rmkxg" Jul 29 20:06:12.106134 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.106018 2574 scope.go:117] "RemoveContainer" containerID="f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3" Jul 29 20:06:12.117205 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.117187 2574 scope.go:117] "RemoveContainer" containerID="f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3" Jul 29 20:06:12.117498 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:06:12.117476 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3\": container with ID starting with f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3 not found: ID does not exist" containerID="f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3" Jul 29 20:06:12.117591 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.117505 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3"} err="failed to get container status \"f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3\": rpc error: code = NotFound desc = could not find container \"f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3\": container with ID starting with f11c1b2ee5c8d392574ae01a9839ccfd144c8b2c32e5d22a42c381b9514630d3 not found: ID does not exist" Jul 29 20:06:12.134783 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.134727 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rmkxg"] Jul 29 20:06:12.136612 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.136584 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rmkxg"] Jul 29 20:06:12.213052 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.213016 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bde3ca1-b67c-4e43-95b9-544918141407" path="/var/lib/kubelet/pods/7bde3ca1-b67c-4e43-95b9-544918141407/volumes" Jul 29 20:06:12.433493 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.433404 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 20:06:12.433493 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:12.433467 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 20:06:13.433400 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:13.433360 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 20:06:13.433590 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:13.433419 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 20:06:14.436856 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:14.436827 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:06:14.437325 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:14.437151 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:06:14.438008 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:14.437988 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:06:30.029952 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:30.029916 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:06:56.831582 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:06:56.831542 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:07:06.814274 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:06.814187 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rm4bg_2d8f9976-a10f-494a-af70-c4dd33007cc0/payload-processing/0.log" Jul 29 20:07:15.250536 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:15.250497 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:07:26.099599 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.099565 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx"] Jul 29 20:07:26.100238 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.100221 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bde3ca1-b67c-4e43-95b9-544918141407" containerName="registry-server" Jul 29 20:07:26.100293 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.100241 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bde3ca1-b67c-4e43-95b9-544918141407" containerName="registry-server" Jul 29 20:07:26.100339 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.100316 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bde3ca1-b67c-4e43-95b9-544918141407" containerName="registry-server" Jul 29 20:07:26.103468 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.103451 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" Jul 29 20:07:26.105989 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.105969 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jczw9\"" Jul 29 20:07:26.110545 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.110519 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx"] Jul 29 20:07:26.178072 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.178036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3d0073-3bc8-4f3c-aca2-903823a08842-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx\" (UID: \"ea3d0073-3bc8-4f3c-aca2-903823a08842\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" Jul 29 20:07:26.279329 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.279284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3d0073-3bc8-4f3c-aca2-903823a08842-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx\" (UID: \"ea3d0073-3bc8-4f3c-aca2-903823a08842\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" Jul 29 20:07:26.280104 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.280082 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3d0073-3bc8-4f3c-aca2-903823a08842-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx\" (UID: \"ea3d0073-3bc8-4f3c-aca2-903823a08842\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" Jul 29 20:07:26.417087 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.416995 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" Jul 29 20:07:26.558323 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:26.558297 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx"] Jul 29 20:07:26.561254 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:07:26.561218 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3d0073_3bc8_4f3c_aca2_903823a08842.slice/crio-134ad36298fe2b7f918dcf3587e87990b41c9da883032bee07e8ac8c7a5caf98 WatchSource:0}: Error finding container 134ad36298fe2b7f918dcf3587e87990b41c9da883032bee07e8ac8c7a5caf98: Status 404 returned error can't find the container with id 134ad36298fe2b7f918dcf3587e87990b41c9da883032bee07e8ac8c7a5caf98 Jul 29 20:07:27.514224 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:27.514190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" event={"ID":"ea3d0073-3bc8-4f3c-aca2-903823a08842","Type":"ContainerStarted","Data":"134ad36298fe2b7f918dcf3587e87990b41c9da883032bee07e8ac8c7a5caf98"} Jul 29 20:07:29.533219 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:29.533138 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" event={"ID":"ea3d0073-3bc8-4f3c-aca2-903823a08842","Type":"ContainerStarted","Data":"e490057b6a621f7edc4028c34c47b311db3c08df2c0b02cfc30a1482ccdb0c75"} Jul 29 20:07:29.552461 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:29.552388 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" podStartSLOduration=1.000556518 podStartE2EDuration="3.552366181s" totalImagesPullingTime="2.551809663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:07:29.550168056 +0000 UTC m=+3167.915250801" watchObservedRunningTime="2026-07-29 20:07:29.552366181 +0000 UTC m=+3167.917448928" Jul 29 20:07:30.540743 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:30.540707 2574 generic.go:356] "Generic (PLEG): container finished" podID="ea3d0073-3bc8-4f3c-aca2-903823a08842" containerID="e490057b6a621f7edc4028c34c47b311db3c08df2c0b02cfc30a1482ccdb0c75" exitCode=0 Jul 29 20:07:30.541163 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:30.540756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" event={"ID":"ea3d0073-3bc8-4f3c-aca2-903823a08842","Type":"ContainerDied","Data":"e490057b6a621f7edc4028c34c47b311db3c08df2c0b02cfc30a1482ccdb0c75"} Jul 29 20:07:31.691367 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:31.691340 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" Jul 29 20:07:31.835074 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:31.835044 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3d0073-3bc8-4f3c-aca2-903823a08842-maas-api-service-ca\") pod \"ea3d0073-3bc8-4f3c-aca2-903823a08842\" (UID: \"ea3d0073-3bc8-4f3c-aca2-903823a08842\") " Jul 29 20:07:31.835422 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:31.835396 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3d0073-3bc8-4f3c-aca2-903823a08842-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ea3d0073-3bc8-4f3c-aca2-903823a08842" (UID: "ea3d0073-3bc8-4f3c-aca2-903823a08842"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 20:07:31.936157 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:31.936124 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3d0073-3bc8-4f3c-aca2-903823a08842-maas-api-service-ca\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:07:32.552134 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:32.552052 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" Jul 29 20:07:32.552134 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:32.552088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx" event={"ID":"ea3d0073-3bc8-4f3c-aca2-903823a08842","Type":"ContainerDied","Data":"134ad36298fe2b7f918dcf3587e87990b41c9da883032bee07e8ac8c7a5caf98"} Jul 29 20:07:32.552332 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:32.552139 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="134ad36298fe2b7f918dcf3587e87990b41c9da883032bee07e8ac8c7a5caf98" Jul 29 20:07:35.890025 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:35.889993 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx"] Jul 29 20:07:35.894943 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:35.894911 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ebceb0-559cx"] Jul 29 20:07:36.213329 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:36.213251 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea3d0073-3bc8-4f3c-aca2-903823a08842" path="/var/lib/kubelet/pods/ea3d0073-3bc8-4f3c-aca2-903823a08842/volumes" Jul 29 20:07:42.444744 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:42.444711 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:07:56.131953 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:56.131907 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:07:58.784492 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:58.784459 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s"] Jul 29 20:07:58.785134 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:58.784658 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" podUID="580dcb4f-3dab-4726-81fd-4bae3e928565" containerName="maas-api" containerID="cri-o://72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18" gracePeriod=30 Jul 29 20:07:59.056268 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.056241 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:07:59.109750 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.109719 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s956f\" (UniqueName: \"kubernetes.io/projected/580dcb4f-3dab-4726-81fd-4bae3e928565-kube-api-access-s956f\") pod \"580dcb4f-3dab-4726-81fd-4bae3e928565\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " Jul 29 20:07:59.109935 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.109768 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/580dcb4f-3dab-4726-81fd-4bae3e928565-openshift-service-ca\") pod \"580dcb4f-3dab-4726-81fd-4bae3e928565\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " Jul 29 20:07:59.109935 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.109797 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/580dcb4f-3dab-4726-81fd-4bae3e928565-maas-api-tls\") pod \"580dcb4f-3dab-4726-81fd-4bae3e928565\" (UID: \"580dcb4f-3dab-4726-81fd-4bae3e928565\") " Jul 29 20:07:59.110215 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.110187 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/580dcb4f-3dab-4726-81fd-4bae3e928565-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "580dcb4f-3dab-4726-81fd-4bae3e928565" (UID: "580dcb4f-3dab-4726-81fd-4bae3e928565"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 20:07:59.112248 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.112219 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580dcb4f-3dab-4726-81fd-4bae3e928565-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "580dcb4f-3dab-4726-81fd-4bae3e928565" (UID: "580dcb4f-3dab-4726-81fd-4bae3e928565"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 20:07:59.112351 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.112265 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580dcb4f-3dab-4726-81fd-4bae3e928565-kube-api-access-s956f" (OuterVolumeSpecName: "kube-api-access-s956f") pod "580dcb4f-3dab-4726-81fd-4bae3e928565" (UID: "580dcb4f-3dab-4726-81fd-4bae3e928565"). InnerVolumeSpecName "kube-api-access-s956f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:07:59.210708 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.210673 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s956f\" (UniqueName: \"kubernetes.io/projected/580dcb4f-3dab-4726-81fd-4bae3e928565-kube-api-access-s956f\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:07:59.210708 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.210702 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/580dcb4f-3dab-4726-81fd-4bae3e928565-openshift-service-ca\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:07:59.210708 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.210713 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/580dcb4f-3dab-4726-81fd-4bae3e928565-maas-api-tls\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:07:59.704820 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.704785 2574 generic.go:356] "Generic (PLEG): container finished" podID="580dcb4f-3dab-4726-81fd-4bae3e928565" containerID="72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18" exitCode=0 Jul 29 20:07:59.705024 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.704829 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" Jul 29 20:07:59.705024 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.704881 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" event={"ID":"580dcb4f-3dab-4726-81fd-4bae3e928565","Type":"ContainerDied","Data":"72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18"} Jul 29 20:07:59.705024 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.704955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s" event={"ID":"580dcb4f-3dab-4726-81fd-4bae3e928565","Type":"ContainerDied","Data":"2e41693a7f135031b339b9413db29944c469259246889c1e0479b21fb7502815"} Jul 29 20:07:59.705024 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.704981 2574 scope.go:117] "RemoveContainer" containerID="72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18" Jul 29 20:07:59.717820 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.717805 2574 scope.go:117] "RemoveContainer" containerID="72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18" Jul 29 20:07:59.718260 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:07:59.718237 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18\": container with ID starting with 72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18 not found: ID does not exist" containerID="72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18" Jul 29 20:07:59.718329 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.718273 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18"} err="failed to get container status \"72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18\": rpc error: code = NotFound desc = could not find container \"72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18\": container with ID starting with 72394d3707559ca725edb32fcd7d79376d4bc17c07a1922852e31ea59ea4be18 not found: ID does not exist" Jul 29 20:07:59.728297 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.728275 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s"] Jul 29 20:07:59.731975 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:07:59.731957 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d0-767b7447c5-9vp4s"] Jul 29 20:08:00.212688 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:00.212653 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="580dcb4f-3dab-4726-81fd-4bae3e928565" path="/var/lib/kubelet/pods/580dcb4f-3dab-4726-81fd-4bae3e928565/volumes" Jul 29 20:08:10.541416 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:10.541323 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:08:54.246501 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.246464 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l"] Jul 29 20:08:54.246993 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.246730 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" podUID="66f72bab-7ee2-489f-b3b9-f58d5a6ed887" containerName="maas-api" containerID="cri-o://931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f" gracePeriod=30 Jul 29 20:08:54.522150 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.522122 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:08:54.663257 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.663219 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btk2c\" (UniqueName: \"kubernetes.io/projected/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-kube-api-access-btk2c\") pod \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " Jul 29 20:08:54.663446 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.663268 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-maas-api-tls\") pod \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " Jul 29 20:08:54.663446 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.663287 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-openshift-service-ca\") pod \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\" (UID: \"66f72bab-7ee2-489f-b3b9-f58d5a6ed887\") " Jul 29 20:08:54.663707 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.663681 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "66f72bab-7ee2-489f-b3b9-f58d5a6ed887" (UID: "66f72bab-7ee2-489f-b3b9-f58d5a6ed887"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 20:08:54.665582 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.665559 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "66f72bab-7ee2-489f-b3b9-f58d5a6ed887" (UID: "66f72bab-7ee2-489f-b3b9-f58d5a6ed887"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 20:08:54.665686 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.665613 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-kube-api-access-btk2c" (OuterVolumeSpecName: "kube-api-access-btk2c") pod "66f72bab-7ee2-489f-b3b9-f58d5a6ed887" (UID: "66f72bab-7ee2-489f-b3b9-f58d5a6ed887"). InnerVolumeSpecName "kube-api-access-btk2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:08:54.764727 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.764640 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btk2c\" (UniqueName: \"kubernetes.io/projected/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-kube-api-access-btk2c\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:08:54.764727 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.764670 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-maas-api-tls\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:08:54.764727 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.764679 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66f72bab-7ee2-489f-b3b9-f58d5a6ed887-openshift-service-ca\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:08:54.994899 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.994862 2574 generic.go:356] "Generic (PLEG): container finished" podID="66f72bab-7ee2-489f-b3b9-f58d5a6ed887" containerID="931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f" exitCode=0 Jul 29 20:08:54.995090 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.994934 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" Jul 29 20:08:54.995090 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.994949 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" event={"ID":"66f72bab-7ee2-489f-b3b9-f58d5a6ed887","Type":"ContainerDied","Data":"931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f"} Jul 29 20:08:54.995090 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.995006 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l" event={"ID":"66f72bab-7ee2-489f-b3b9-f58d5a6ed887","Type":"ContainerDied","Data":"94c8915526346125a699b2de0d16ff040828d9ebfabfddb685c5c48444e8f9e3"} Jul 29 20:08:54.995090 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:54.995033 2574 scope.go:117] "RemoveContainer" containerID="931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f" Jul 29 20:08:55.011648 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:55.011627 2574 scope.go:117] "RemoveContainer" containerID="931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f" Jul 29 20:08:55.012004 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:08:55.011976 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f\": container with ID starting with 931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f not found: ID does not exist" containerID="931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f" Jul 29 20:08:55.012061 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:55.012018 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f"} err="failed to get container status \"931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f\": rpc error: code = NotFound desc = could not find container \"931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f\": container with ID starting with 931cf5a049dbffbe805859e6985d27b8a2ec25aecd635ac21735179970f3cb7f not found: ID does not exist" Jul 29 20:08:55.020067 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:55.020006 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l"] Jul 29 20:08:55.023684 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:55.023655 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5560c5-58b64bb5b9-4rf9l"] Jul 29 20:08:56.213094 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:56.213057 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66f72bab-7ee2-489f-b3b9-f58d5a6ed887" path="/var/lib/kubelet/pods/66f72bab-7ee2-489f-b3b9-f58d5a6ed887/volumes" Jul 29 20:08:57.930248 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:08:57.930207 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:09:01.206171 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:01.206133 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr"] Jul 29 20:09:01.206923 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:01.206871 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" containerID="cri-o://ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd" gracePeriod=30 Jul 29 20:09:06.484304 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.484227 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:09:06.486216 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486156 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istiod-ca-cert\") pod \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " Jul 29 20:09:06.486342 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486282 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87lp9\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-kube-api-access-87lp9\") pod \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " Jul 29 20:09:06.486342 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486333 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-credential-socket\") pod \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " Jul 29 20:09:06.486440 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486357 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-podinfo\") pod \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " Jul 29 20:09:06.486552 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486531 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" (UID: "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 20:09:06.486666 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486643 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-certs\") pod \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " Jul 29 20:09:06.486666 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486634 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" (UID: "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:09:06.486779 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486669 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-token\") pod \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " Jul 29 20:09:06.486779 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486744 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-socket\") pod \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " Jul 29 20:09:06.486884 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486777 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-envoy\") pod \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " Jul 29 20:09:06.486884 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486803 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-data\") pod \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\" (UID: \"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5\") " Jul 29 20:09:06.486884 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.486823 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" (UID: "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:09:06.487058 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.487011 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" (UID: "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:09:06.487345 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.487168 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-certs\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:09:06.487345 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.487185 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-workload-socket\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:09:06.487345 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.487198 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istiod-ca-cert\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:09:06.487345 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.487211 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-credential-socket\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:09:06.487656 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.487569 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" (UID: "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:09:06.489110 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.489084 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-kube-api-access-87lp9" (OuterVolumeSpecName: "kube-api-access-87lp9") pod "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" (UID: "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5"). InnerVolumeSpecName "kube-api-access-87lp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:09:06.489333 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.489315 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" (UID: "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:09:06.489514 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.489491 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" (UID: "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:09:06.489514 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.489505 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" (UID: "4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 20:09:06.588302 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.588269 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87lp9\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-kube-api-access-87lp9\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:09:06.588302 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.588298 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-podinfo\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:09:06.588302 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.588309 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-token\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:09:06.588543 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.588319 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-envoy\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:09:06.588543 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:06.588327 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5-istio-data\") on node \"ip-10-0-132-216.ec2.internal\" DevicePath \"\"" Jul 29 20:09:07.062397 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.062354 2574 generic.go:356] "Generic (PLEG): container finished" podID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerID="ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd" exitCode=0 Jul 29 20:09:07.062605 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.062409 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" Jul 29 20:09:07.062605 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.062430 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" event={"ID":"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5","Type":"ContainerDied","Data":"ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd"} Jul 29 20:09:07.062605 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.062488 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr" event={"ID":"4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5","Type":"ContainerDied","Data":"2980e5f2c1142efa9bb8e14ae2e4e543863dce81c22c61d67e0e4c252b6cea84"} Jul 29 20:09:07.062605 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.062512 2574 scope.go:117] "RemoveContainer" containerID="ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd" Jul 29 20:09:07.074469 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.074451 2574 scope.go:117] "RemoveContainer" containerID="2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c" Jul 29 20:09:07.084861 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.084839 2574 scope.go:117] "RemoveContainer" containerID="ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd" Jul 29 20:09:07.085216 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:09:07.085186 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd\": container with ID starting with ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd not found: ID does not exist" containerID="ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd" Jul 29 20:09:07.085337 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.085228 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd"} err="failed to get container status \"ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd\": rpc error: code = NotFound desc = could not find container \"ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd\": container with ID starting with ae74a89473136b4566a08b209c3a3e11f964efdc9cbaad444d40bd848d5b33cd not found: ID does not exist" Jul 29 20:09:07.085337 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.085264 2574 scope.go:117] "RemoveContainer" containerID="2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c" Jul 29 20:09:07.085592 ip-10-0-132-216 kubenswrapper[2574]: E0729 20:09:07.085571 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c\": container with ID starting with 2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c not found: ID does not exist" containerID="2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c" Jul 29 20:09:07.085679 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.085604 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c"} err="failed to get container status \"2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c\": rpc error: code = NotFound desc = could not find container \"2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c\": container with ID starting with 2e3219445dc41c9582056334dec5b095320d080631f347464d86e626dd2c2c2c not found: ID does not exist" Jul 29 20:09:07.088079 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.088054 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr"] Jul 29 20:09:07.093520 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:07.093497 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5560c5-openshift-default-7c5dfd6d96-wmqdr"] Jul 29 20:09:08.212262 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:08.212232 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" path="/var/lib/kubelet/pods/4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5/volumes" Jul 29 20:09:12.028143 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:12.028101 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:09:23.923942 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:23.923883 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cbvnk"] Jul 29 20:09:33.422513 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:33.422482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-85wk6_3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456/manager/0.log" Jul 29 20:09:33.550361 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:33.550328 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-77t2q_a05b81e6-834a-483d-b969-e58c0ed260b3/manager/0.log" Jul 29 20:09:33.785500 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:33.785405 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8z9vd_b8c1face-a159-420a-88fd-51d1ee50e841/server/0.log" Jul 29 20:09:33.912647 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:33.912615 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ncs2w_23b03241-94f8-485e-8a64-308224a06356/manager/0.log" Jul 29 20:09:34.023332 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:34.023291 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-q566s_1164d0b1-13d7-47e9-a107-81b2724f2893/manager/0.log" Jul 29 20:09:34.028670 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:34.028648 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-q566s_1164d0b1-13d7-47e9-a107-81b2724f2893/copy-manifests/0.log" Jul 29 20:09:35.074369 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:35.074337 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-cbsmt_859bb2ce-5475-4e76-af06-1c8cd67f47b1/postgres/0.log" Jul 29 20:09:36.822320 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:36.822282 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-54fhp_c3fc7250-c146-4804-a231-c51f9214d4ce/registry-server/0.log" Jul 29 20:09:36.953801 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:36.953766 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rc97w_27997f2e-7b2d-40ac-ad06-672996329742/manager/0.log" Jul 29 20:09:37.072664 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:37.072585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cbvnk_72834334-6a22-4340-8487-0c46efc0c764/limitador/0.log" Jul 29 20:09:37.537640 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:37.537468 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh_be450cce-7092-401d-8713-8e584dae4daa/istio-proxy/0.log" Jul 29 20:09:37.760644 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:37.760607 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb4d8769-k7rn9_b511a429-44e4-488a-b099-0794290fbf98/kube-auth-proxy/0.log" Jul 29 20:09:37.985849 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:37.985814 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tpkbb_86dc81f5-9b81-414c-959c-7131d782fa51/istio-proxy/1.log" Jul 29 20:09:38.223758 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:38.223727 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rm4bg_2d8f9976-a10f-494a-af70-c4dd33007cc0/payload-processing/0.log" Jul 29 20:09:38.340068 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:38.340021 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bfbd696bc-8jlrm_8da9004e-42d6-4e3e-b28d-c828d75884a5/router/0.log" Jul 29 20:09:38.812785 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:38.812696 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hwp86_565e7c8c-3e74-42e3-b2fa-3b34bed2740a/main/0.log" Jul 29 20:09:39.253749 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:39.253716 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-69mns_9d01ab86-9f17-4dd5-8851-703bf8028f8f/main/0.log" Jul 29 20:09:42.350345 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:42.350301 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 20:09:42.360453 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:42.360430 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 20:09:47.854548 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:47.854515 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-82wbd_d6e0bc83-0390-42b7-8eae-4123ab6713b1/global-pull-secret-syncer/0.log" Jul 29 20:09:48.026960 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:48.026920 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-krmhr_939b0a59-b0e6-4a5b-bc41-2421e6d8d615/konnectivity-agent/0.log" Jul 29 20:09:48.129398 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:48.129285 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-216.ec2.internal_bb03f04c0c3ccf4f43dec4c1ab69f17f/haproxy/0.log" Jul 29 20:09:52.932487 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:52.932452 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-54fhp_c3fc7250-c146-4804-a231-c51f9214d4ce/registry-server/0.log" Jul 29 20:09:53.214303 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:53.214264 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rc97w_27997f2e-7b2d-40ac-ad06-672996329742/manager/0.log" Jul 29 20:09:53.238954 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:53.238927 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cbvnk_72834334-6a22-4340-8487-0c46efc0c764/limitador/0.log" Jul 29 20:09:55.103653 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:55.103622 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-x8zvf_e6b38a35-f491-4e16-ad59-3c8847af8951/cluster-monitoring-operator/0.log" Jul 29 20:09:55.283610 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:55.283578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7cbzj_6f2c5638-318c-44af-9e3a-d7912dc2e63b/node-exporter/0.log" Jul 29 20:09:55.308985 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:55.308958 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7cbzj_6f2c5638-318c-44af-9e3a-d7912dc2e63b/kube-rbac-proxy/0.log" Jul 29 20:09:55.331837 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:55.331805 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7cbzj_6f2c5638-318c-44af-9e3a-d7912dc2e63b/init-textfile/0.log" Jul 29 20:09:55.847828 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:55.847785 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-x2v6v_efcdd686-3730-4f0a-a4e5-ed7b5ee6a578/prometheus-operator-admission-webhook/0.log" Jul 29 20:09:57.287857 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:57.287824 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-6b7zq_66c6ea58-7211-44bf-9bd0-3baa37879269/networking-console-plugin/0.log" Jul 29 20:09:57.877667 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:57.877610 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/1.log" Jul 29 20:09:57.886925 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:57.886875 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rbpfw_fa61cb03-3266-4e88-9397-623780de00ee/console-operator/2.log" Jul 29 20:09:58.132686 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.132605 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6"] Jul 29 20:09:58.133045 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133031 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" Jul 29 20:09:58.133111 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133047 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" Jul 29 20:09:58.133111 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133056 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" Jul 29 20:09:58.133111 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133061 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" Jul 29 20:09:58.133111 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133072 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3d0073-3bc8-4f3c-aca2-903823a08842" containerName="revoke-keys" Jul 29 20:09:58.133111 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133077 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3d0073-3bc8-4f3c-aca2-903823a08842" containerName="revoke-keys" Jul 29 20:09:58.133111 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133092 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580dcb4f-3dab-4726-81fd-4bae3e928565" containerName="maas-api" Jul 29 20:09:58.133111 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133097 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="580dcb4f-3dab-4726-81fd-4bae3e928565" containerName="maas-api" Jul 29 20:09:58.133111 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133110 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f72bab-7ee2-489f-b3b9-f58d5a6ed887" containerName="maas-api" Jul 29 20:09:58.133490 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133116 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f72bab-7ee2-489f-b3b9-f58d5a6ed887" containerName="maas-api" Jul 29 20:09:58.133490 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133180 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea3d0073-3bc8-4f3c-aca2-903823a08842" containerName="revoke-keys" Jul 29 20:09:58.133490 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133192 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="580dcb4f-3dab-4726-81fd-4bae3e928565" containerName="maas-api" Jul 29 20:09:58.133490 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133202 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="66f72bab-7ee2-489f-b3b9-f58d5a6ed887" containerName="maas-api" Jul 29 20:09:58.133490 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133209 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" Jul 29 20:09:58.133490 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.133217 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4385feed-ba9c-4c56-a1d1-7dc1dd7ed1a5" containerName="istio-proxy" Jul 29 20:09:58.136369 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.136352 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.139073 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.139042 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7qkh\"/\"openshift-service-ca.crt\"" Jul 29 20:09:58.139186 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.139061 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x7qkh\"/\"default-dockercfg-t7j52\"" Jul 29 20:09:58.140240 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.140226 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7qkh\"/\"kube-root-ca.crt\"" Jul 29 20:09:58.146005 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.145983 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6"] Jul 29 20:09:58.170536 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.170505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-podres\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.170536 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.170537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-lib-modules\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.170712 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.170569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-proc\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.170712 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.170588 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf2c2\" (UniqueName: \"kubernetes.io/projected/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-kube-api-access-vf2c2\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.170712 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.170631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-sys\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.271964 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.271931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-podres\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.272163 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.271971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-lib-modules\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.272163 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.272104 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-proc\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.272163 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.272117 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-lib-modules\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.272163 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.272120 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-podres\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.272163 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.272141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2c2\" (UniqueName: \"kubernetes.io/projected/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-kube-api-access-vf2c2\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.272408 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.272168 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-proc\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.272408 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.272217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-sys\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.272408 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.272275 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-sys\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.280915 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.280848 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf2c2\" (UniqueName: \"kubernetes.io/projected/4f9943a3-5a3d-46cb-a3c4-954c922b0aec-kube-api-access-vf2c2\") pod \"perf-node-gather-daemonset-lphl6\" (UID: \"4f9943a3-5a3d-46cb-a3c4-954c922b0aec\") " pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.439791 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.439703 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-569b885994-sdfdg_313c23e1-1b55-4446-9644-83fccb44ad0f/console/0.log" Jul 29 20:09:58.447302 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.447276 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:58.485920 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.485859 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-7dm4z_fe09f2ee-bd85-4cef-91f9-60b4495b04ed/download-server/0.log" Jul 29 20:09:58.591079 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:58.591055 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6"] Jul 29 20:09:58.593024 ip-10-0-132-216 kubenswrapper[2574]: W0729 20:09:58.592995 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f9943a3_5a3d_46cb_a3c4_954c922b0aec.slice/crio-40edae4e7a5e48811589bafaa60ffc5912f9da682889d00c816b2634a51f2c9c WatchSource:0}: Error finding container 40edae4e7a5e48811589bafaa60ffc5912f9da682889d00c816b2634a51f2c9c: Status 404 returned error can't find the container with id 40edae4e7a5e48811589bafaa60ffc5912f9da682889d00c816b2634a51f2c9c Jul 29 20:09:59.181334 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:59.181303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-xrmmc_6f762915-9790-4f0b-82ad-e675c2a38d7e/volume-data-source-validator/0.log" Jul 29 20:09:59.343296 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:59.343264 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" event={"ID":"4f9943a3-5a3d-46cb-a3c4-954c922b0aec","Type":"ContainerStarted","Data":"10527afabe95235d9cd8d4ca9520bce5961ad8f0be270226c841bfbac8136084"} Jul 29 20:09:59.343296 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:59.343314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" event={"ID":"4f9943a3-5a3d-46cb-a3c4-954c922b0aec","Type":"ContainerStarted","Data":"40edae4e7a5e48811589bafaa60ffc5912f9da682889d00c816b2634a51f2c9c"} Jul 29 20:09:59.343579 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:59.343400 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:09:59.361023 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:09:59.360964 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" podStartSLOduration=1.360948345 podStartE2EDuration="1.360948345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:09:59.358498935 +0000 UTC m=+3317.723581677" watchObservedRunningTime="2026-07-29 20:09:59.360948345 +0000 UTC m=+3317.726031087" Jul 29 20:10:00.256620 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:00.256585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9c5s_f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41/dns/0.log" Jul 29 20:10:00.279816 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:00.279785 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9c5s_f0a4ef84-8298-4de0-9e3a-dc7ca0d1ed41/kube-rbac-proxy/0.log" Jul 29 20:10:00.406195 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:00.406159 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ztx54_6415fb6e-0760-451f-9e00-778546bcda01/dns-node-resolver/0.log" Jul 29 20:10:00.987303 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:00.987268 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c55n4_cf021cd7-f744-4799-a0ed-b4764655efe6/node-ca/0.log" Jul 29 20:10:01.951827 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:01.951793 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh_be450cce-7092-401d-8713-8e584dae4daa/istio-proxy/0.log" Jul 29 20:10:02.161868 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:02.161839 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb4d8769-k7rn9_b511a429-44e4-488a-b099-0794290fbf98/kube-auth-proxy/0.log" Jul 29 20:10:02.217017 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:02.216926 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tpkbb_86dc81f5-9b81-414c-959c-7131d782fa51/istio-proxy/0.log" Jul 29 20:10:02.269364 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:02.269330 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tpkbb_86dc81f5-9b81-414c-959c-7131d782fa51/istio-proxy/1.log" Jul 29 20:10:02.343356 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:02.343324 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rm4bg_2d8f9976-a10f-494a-af70-c4dd33007cc0/payload-processing/0.log" Jul 29 20:10:02.373445 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:02.373382 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bfbd696bc-8jlrm_8da9004e-42d6-4e3e-b28d-c828d75884a5/router/0.log" Jul 29 20:10:03.209004 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:03.208967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bwdmq_95f04637-47b9-4e84-90a8-12e5b5932e7f/serve-healthcheck-canary/0.log" Jul 29 20:10:03.705739 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:03.705694 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-4fnpr_0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e/insights-operator/0.log" Jul 29 20:10:03.707850 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:03.707824 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-4fnpr_0095bbb6-69e4-4ef6-8b14-90e1ef0bcc8e/insights-operator/1.log" Jul 29 20:10:03.799938 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:03.799905 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjk6d_7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432/kube-rbac-proxy/0.log" Jul 29 20:10:03.822900 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:03.822856 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjk6d_7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432/exporter/0.log" Jul 29 20:10:03.845098 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:03.845066 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjk6d_7a62ef6a-b0d8-4a3d-ac89-5e55ac2ff432/extractor/0.log" Jul 29 20:10:05.360272 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:05.360240 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x7qkh/perf-node-gather-daemonset-lphl6" Jul 29 20:10:06.027836 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:06.027804 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-85wk6_3d6a5d3e-3dd3-4a9e-bd0f-f725a894f456/manager/0.log" Jul 29 20:10:06.413475 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:06.413413 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-77t2q_a05b81e6-834a-483d-b969-e58c0ed260b3/manager/0.log" Jul 29 20:10:06.684487 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:06.684399 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8z9vd_b8c1face-a159-420a-88fd-51d1ee50e841/server/0.log" Jul 29 20:10:06.820917 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:06.820838 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ncs2w_23b03241-94f8-485e-8a64-308224a06356/manager/0.log" Jul 29 20:10:06.848067 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:06.848038 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-q566s_1164d0b1-13d7-47e9-a107-81b2724f2893/manager/0.log" Jul 29 20:10:06.876875 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:06.876850 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f775ff5c-q566s_1164d0b1-13d7-47e9-a107-81b2724f2893/copy-manifests/0.log" Jul 29 20:10:08.718477 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:08.718449 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh_be450cce-7092-401d-8713-8e584dae4daa/istio-proxy/0.log" Jul 29 20:10:08.898480 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:08.898447 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb4d8769-k7rn9_b511a429-44e4-488a-b099-0794290fbf98/kube-auth-proxy/0.log" Jul 29 20:10:08.939373 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:08.939341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tpkbb_86dc81f5-9b81-414c-959c-7131d782fa51/istio-proxy/0.log" Jul 29 20:10:08.994610 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:08.994574 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tpkbb_86dc81f5-9b81-414c-959c-7131d782fa51/istio-proxy/1.log" Jul 29 20:10:09.048051 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:09.048010 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rm4bg_2d8f9976-a10f-494a-af70-c4dd33007cc0/payload-processing/0.log" Jul 29 20:10:09.062916 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:09.062852 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bfbd696bc-8jlrm_8da9004e-42d6-4e3e-b28d-c828d75884a5/router/0.log" Jul 29 20:10:10.514049 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:10.513958 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-j65fh_be450cce-7092-401d-8713-8e584dae4daa/istio-proxy/0.log" Jul 29 20:10:10.701626 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:10.701597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb4d8769-k7rn9_b511a429-44e4-488a-b099-0794290fbf98/kube-auth-proxy/0.log" Jul 29 20:10:10.740840 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:10.740797 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tpkbb_86dc81f5-9b81-414c-959c-7131d782fa51/istio-proxy/0.log" Jul 29 20:10:10.796558 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:10.796470 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tpkbb_86dc81f5-9b81-414c-959c-7131d782fa51/istio-proxy/1.log" Jul 29 20:10:10.854277 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:10.854242 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rm4bg_2d8f9976-a10f-494a-af70-c4dd33007cc0/payload-processing/0.log" Jul 29 20:10:10.868438 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:10.868409 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bfbd696bc-8jlrm_8da9004e-42d6-4e3e-b28d-c828d75884a5/router/0.log" Jul 29 20:10:13.566243 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:13.566206 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-kzjvp_a068b387-2317-4649-8c3b-b5de01b20a96/migrator/0.log" Jul 29 20:10:13.590137 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:13.590110 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-kzjvp_a068b387-2317-4649-8c3b-b5de01b20a96/graceful-termination/0.log" Jul 29 20:10:13.953629 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:13.953566 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t_1940e899-f629-405a-9765-aee5aeb94f1f/kube-storage-version-migrator-operator/1.log" Jul 29 20:10:13.955529 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:13.955497 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-sl54t_1940e899-f629-405a-9765-aee5aeb94f1f/kube-storage-version-migrator-operator/0.log" Jul 29 20:10:15.324725 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:15.324697 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkvr5_930d691e-e115-44f2-b81f-a9fa11919dc7/kube-multus-additional-cni-plugins/0.log" Jul 29 20:10:15.353607 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:15.353566 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkvr5_930d691e-e115-44f2-b81f-a9fa11919dc7/egress-router-binary-copy/0.log" Jul 29 20:10:15.376138 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:15.376105 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkvr5_930d691e-e115-44f2-b81f-a9fa11919dc7/cni-plugins/0.log" Jul 29 20:10:15.397151 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:15.397123 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkvr5_930d691e-e115-44f2-b81f-a9fa11919dc7/bond-cni-plugin/0.log" Jul 29 20:10:15.416846 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:15.416819 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkvr5_930d691e-e115-44f2-b81f-a9fa11919dc7/routeoverride-cni/0.log" Jul 29 20:10:15.436686 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:15.436658 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkvr5_930d691e-e115-44f2-b81f-a9fa11919dc7/whereabouts-cni-bincopy/0.log" Jul 29 20:10:15.460154 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:15.460126 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkvr5_930d691e-e115-44f2-b81f-a9fa11919dc7/whereabouts-cni/0.log" Jul 29 20:10:15.600388 ip-10-0-132-216 kubenswrapper[2574]: I0729 20:10:15.600360 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pwdqr_967e4490-1fbc-4b8b-8084-64bedcc3e271/kube-multus/0.log"