May 23 22:02:20.280200 ip-10-0-131-208 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 23 22:02:20.280212 ip-10-0-131-208 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 23 22:02:20.280221 ip-10-0-131-208 systemd[1]: kubelet.service: Failed with result 'resources'. May 23 22:02:20.280504 ip-10-0-131-208 systemd[1]: Failed to start Kubernetes Kubelet. May 23 22:02:30.471545 ip-10-0-131-208 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 23 22:02:30.471561 ip-10-0-131-208 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 01cd815d990e423782e21dba3f7ef1c5 -- May 23 22:04:56.277942 ip-10-0-131-208 systemd[1]: Starting Kubernetes Kubelet... May 23 22:04:56.737538 ip-10-0-131-208 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 23 22:04:56.737538 ip-10-0-131-208 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 23 22:04:56.737538 ip-10-0-131-208 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 23 22:04:56.737538 ip-10-0-131-208 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 23 22:04:56.737538 ip-10-0-131-208 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 23 22:04:56.738202 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.737608 2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 23 22:04:56.742633 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742617 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 23 22:04:56.742633 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742633 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742637 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742640 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742643 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742668 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742671 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742674 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742677 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742681 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742684 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742686 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742689 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742691 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742694 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742700 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742703 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742706 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742708 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742711 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742714 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 23 22:04:56.742715 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742716 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742719 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742722 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742725 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742728 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742731 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742733 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742736 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742739 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742741 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742744 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742746 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742749 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742757 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742759 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742762 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742764 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742767 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742769 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742772 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 23 22:04:56.743208 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742774 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742777 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742779 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742782 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742784 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742786 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742789 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742792 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742794 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742797 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742800 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742803 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742808 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742812 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742815 2556 feature_gate.go:328] unrecognized feature gate: Example May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742818 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742821 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742824 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742827 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 23 22:04:56.743979 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742830 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742833 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742836 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742839 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742841 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742844 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742846 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742849 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742852 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742854 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742861 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742866 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742870 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742873 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742876 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742879 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742882 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742885 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742887 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 23 22:04:56.744449 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742890 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 23 22:04:56.744997 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742892 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 23 22:04:56.744997 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742896 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 23 22:04:56.744997 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742898 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 23 22:04:56.744997 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742901 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 23 22:04:56.744997 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742904 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 23 22:04:56.744997 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.742907 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 23 22:04:56.745159 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745145 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 23 22:04:56.745159 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745157 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745161 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745164 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745166 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745170 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745172 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745175 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745178 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745183 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745187 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745190 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745193 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745196 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745199 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745201 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745204 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745206 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745209 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745212 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 23 22:04:56.745214 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745214 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745217 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745220 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745223 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745226 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745232 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745235 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745237 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745240 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745243 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745245 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745248 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745250 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745254 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745256 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745259 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745262 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745264 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745266 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745269 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 23 22:04:56.745685 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745272 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745274 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745277 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745279 2556 feature_gate.go:328] unrecognized feature gate: Example May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745282 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745284 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745287 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745289 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745291 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745294 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745297 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745299 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745302 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745304 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745308 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745311 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745314 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745316 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745319 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 23 22:04:56.746190 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745322 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745324 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745327 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745329 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745332 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745334 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745337 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745339 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745345 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745349 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745352 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745356 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745359 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745362 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745365 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745368 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745371 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745373 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745377 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 23 22:04:56.746675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745379 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745382 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745385 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745387 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745390 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745393 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745396 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.745398 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745458 2556 flags.go:64] FLAG: --address="0.0.0.0" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745466 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745472 2556 flags.go:64] FLAG: --anonymous-auth="true" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745476 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745483 2556 flags.go:64] FLAG: --authentication-token-webhook="false" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745488 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745495 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745501 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745504 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745507 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745511 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745514 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745517 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745520 2556 flags.go:64] FLAG: --cgroup-root="" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745523 2556 flags.go:64] FLAG: --cgroups-per-qos="true" May 23 22:04:56.747147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745526 2556 flags.go:64] FLAG: --client-ca-file="" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745529 2556 flags.go:64] FLAG: --cloud-config="" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745531 2556 flags.go:64] FLAG: --cloud-provider="external" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745534 2556 flags.go:64] FLAG: --cluster-dns="[]" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745543 2556 flags.go:64] FLAG: --cluster-domain="" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745546 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745549 2556 flags.go:64] FLAG: --config-dir="" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745552 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745556 2556 flags.go:64] FLAG: --container-log-max-files="5" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745565 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745569 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745572 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745575 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745579 2556 flags.go:64] FLAG: --contention-profiling="false" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745582 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745585 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745588 2556 flags.go:64] FLAG: --cpu-manager-policy="none" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745592 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745596 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745599 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745602 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745605 2556 flags.go:64] FLAG: --enable-load-reader="false" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745608 2556 flags.go:64] FLAG: --enable-server="true" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745611 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745618 2556 flags.go:64] FLAG: --event-burst="100" May 23 22:04:56.747731 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745621 2556 flags.go:64] FLAG: --event-qps="50" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745624 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745627 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745630 2556 flags.go:64] FLAG: --eviction-hard="" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745634 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745637 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745640 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745643 2556 flags.go:64] FLAG: --eviction-soft="" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745646 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745649 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745652 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745655 2556 flags.go:64] FLAG: --experimental-mounter-path="" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745671 2556 flags.go:64] FLAG: --fail-cgroupv1="false" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745674 2556 flags.go:64] FLAG: --fail-swap-on="true" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745677 2556 flags.go:64] FLAG: --feature-gates="" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745681 2556 flags.go:64] FLAG: --file-check-frequency="20s" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745684 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745693 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745697 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745700 2556 flags.go:64] FLAG: --healthz-port="10248" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745703 2556 flags.go:64] FLAG: --help="false" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745706 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-131-208.ec2.internal" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745709 2556 flags.go:64] FLAG: --housekeeping-interval="10s" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745712 2556 flags.go:64] FLAG: --http-check-frequency="20s" May 23 22:04:56.748328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745716 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745720 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745723 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745726 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745729 2556 flags.go:64] FLAG: --image-service-endpoint="" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745732 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745735 2556 flags.go:64] FLAG: --kube-api-burst="100" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745738 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745741 2556 flags.go:64] FLAG: --kube-api-qps="50" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745744 2556 flags.go:64] FLAG: --kube-reserved="" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745747 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745750 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745753 2556 flags.go:64] FLAG: --kubelet-cgroups="" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745756 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745759 2556 flags.go:64] FLAG: --lock-file="" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745761 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745764 2556 flags.go:64] FLAG: --log-flush-frequency="5s" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745768 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745773 2556 flags.go:64] FLAG: --log-json-split-stream="false" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745776 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745779 2556 flags.go:64] FLAG: --log-text-split-stream="false" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745781 2556 flags.go:64] FLAG: --logging-format="text" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745784 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745787 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" May 23 22:04:56.748958 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745790 2556 flags.go:64] FLAG: --manifest-url="" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745793 2556 flags.go:64] FLAG: --manifest-url-header="" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745808 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745811 2556 flags.go:64] FLAG: --max-open-files="1000000" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745818 2556 flags.go:64] FLAG: --max-pods="110" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745821 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745824 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745827 2556 flags.go:64] FLAG: --memory-manager-policy="None" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745830 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745833 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745836 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745839 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745845 2556 flags.go:64] FLAG: --node-status-max-images="50" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745848 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745850 2556 flags.go:64] FLAG: --oom-score-adj="-999" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745853 2556 flags.go:64] FLAG: --pod-cidr="" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745856 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745861 2556 flags.go:64] FLAG: --pod-manifest-path="" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745864 2556 flags.go:64] FLAG: --pod-max-pids="-1" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745867 2556 flags.go:64] FLAG: --pods-per-core="0" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745869 2556 flags.go:64] FLAG: --port="10250" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745872 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745875 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08a856507fa8225e8" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745878 2556 flags.go:64] FLAG: --qos-reserved="" May 23 22:04:56.749544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745882 2556 flags.go:64] FLAG: --read-only-port="10255" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745885 2556 flags.go:64] FLAG: --register-node="true" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745888 2556 flags.go:64] FLAG: --register-schedulable="true" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745891 2556 flags.go:64] FLAG: --register-with-taints="" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745895 2556 flags.go:64] FLAG: --registry-burst="10" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745897 2556 flags.go:64] FLAG: --registry-qps="5" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745900 2556 flags.go:64] FLAG: --reserved-cpus="" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745903 2556 flags.go:64] FLAG: --reserved-memory="" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745906 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745910 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745913 2556 flags.go:64] FLAG: --rotate-certificates="false" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745923 2556 flags.go:64] FLAG: --rotate-server-certificates="false" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745927 2556 flags.go:64] FLAG: --runonce="false" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745929 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745932 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745935 2556 flags.go:64] FLAG: --seccomp-default="false" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745938 2556 flags.go:64] FLAG: --serialize-image-pulls="true" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745941 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745944 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745948 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745951 2556 flags.go:64] FLAG: --storage-driver-password="root" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745954 2556 flags.go:64] FLAG: --storage-driver-secure="false" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745956 2556 flags.go:64] FLAG: --storage-driver-table="stats" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745959 2556 flags.go:64] FLAG: --storage-driver-user="root" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745962 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745965 2556 flags.go:64] FLAG: --sync-frequency="1m0s" May 23 22:04:56.750128 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745968 2556 flags.go:64] FLAG: --system-cgroups="" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745971 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745976 2556 flags.go:64] FLAG: --system-reserved-cgroup="" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745978 2556 flags.go:64] FLAG: --tls-cert-file="" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745981 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745988 2556 flags.go:64] FLAG: --tls-min-version="" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745991 2556 flags.go:64] FLAG: --tls-private-key-file="" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745994 2556 flags.go:64] FLAG: --topology-manager-policy="none" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.745997 2556 flags.go:64] FLAG: --topology-manager-policy-options="" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.746000 2556 flags.go:64] FLAG: --topology-manager-scope="container" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.746003 2556 flags.go:64] FLAG: --v="2" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.746008 2556 flags.go:64] FLAG: --version="false" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.746012 2556 flags.go:64] FLAG: --vmodule="" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.746016 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.746019 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746104 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746107 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746112 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746122 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746125 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746127 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746130 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746133 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 23 22:04:56.750788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746135 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746138 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746141 2556 feature_gate.go:328] unrecognized feature gate: Example May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746143 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746146 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746148 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746151 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746153 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746156 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746159 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746162 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746164 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746167 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746169 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746172 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746177 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746179 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746182 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746185 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746187 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 23 22:04:56.751341 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746190 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746193 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746196 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746199 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746201 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746204 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746207 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746210 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746214 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746217 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746219 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746222 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746224 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746227 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746229 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746232 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746235 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746237 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746240 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 23 22:04:56.751978 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746243 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746245 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746248 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746251 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746255 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746258 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746262 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746265 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746269 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746271 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746274 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746278 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746280 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746283 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746286 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746288 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746291 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746293 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746296 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 23 22:04:56.752870 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746299 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746302 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746304 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746307 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746310 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746314 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746317 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746320 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746323 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746326 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746328 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746331 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746333 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746336 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746338 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746341 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746343 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746346 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746348 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 23 22:04:56.753816 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.746351 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 23 22:04:56.754296 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.746356 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 23 22:04:56.755143 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.755034 2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 23 22:04:56.755205 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.755148 2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 23 22:04:56.755263 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755223 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 23 22:04:56.755263 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755232 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 23 22:04:56.755263 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755238 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 23 22:04:56.755263 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755243 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 23 22:04:56.755263 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755247 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 23 22:04:56.755263 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755252 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 23 22:04:56.755263 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755256 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 23 22:04:56.755263 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755261 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 23 22:04:56.755263 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755266 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755271 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755276 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755283 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755291 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755297 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755302 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755306 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755310 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755315 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755319 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755323 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755327 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755332 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755336 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755340 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755345 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755349 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755353 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755357 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 23 22:04:56.755675 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755362 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755366 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755370 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755375 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755379 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755384 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755388 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755392 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755396 2556 feature_gate.go:328] unrecognized feature gate: Example May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755401 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755405 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755409 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755413 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755420 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755427 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755433 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755438 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755444 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755449 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755453 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 23 22:04:56.756508 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755458 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755462 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755467 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755471 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755475 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755479 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755483 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755487 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755492 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755496 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755500 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755505 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755509 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755514 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755518 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755522 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755526 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755530 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755535 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 23 22:04:56.757039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755539 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755543 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755547 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755552 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755556 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755560 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755564 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755569 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755573 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755577 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755580 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755586 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755590 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755595 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755599 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755603 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755607 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755611 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 23 22:04:56.757579 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755615 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.755624 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755796 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755805 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755810 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755815 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755820 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755826 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755833 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755838 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755843 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755848 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755853 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755857 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755861 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 23 22:04:56.758213 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755865 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755869 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755873 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755878 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755882 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755886 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755890 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755895 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755899 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755903 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755907 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755912 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755917 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755921 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755925 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755930 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755934 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755938 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755942 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 23 22:04:56.758596 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755947 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755951 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755955 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755959 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755963 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755967 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755971 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755976 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755980 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755984 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755989 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755993 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.755998 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756002 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756006 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756011 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756015 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756019 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756024 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756028 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 23 22:04:56.759299 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756032 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756036 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756040 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756044 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756049 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756062 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756067 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756071 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756075 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756079 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756083 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756087 2556 feature_gate.go:328] unrecognized feature gate: Example May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756091 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756095 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756100 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756104 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756108 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756113 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756117 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756120 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 23 22:04:56.760020 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756124 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756129 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756133 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756137 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756141 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756145 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756149 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756153 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756160 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756166 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756170 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756175 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756179 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:56.756184 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.756192 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 23 22:04:56.760581 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.756348 2556 server.go:962] "Client rotation is on, will bootstrap in background" May 23 22:04:56.761001 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.760444 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 23 22:04:56.761599 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.761585 2556 server.go:1019] "Starting client certificate rotation" May 23 22:04:56.761800 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.761687 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 23 22:04:56.761800 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.761722 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 23 22:04:56.789930 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.789900 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 23 22:04:56.791847 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.791831 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 23 22:04:56.809180 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.809152 2556 log.go:25] "Validated CRI v1 runtime API" May 23 22:04:56.815362 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.815340 2556 log.go:25] "Validated CRI v1 image API" May 23 22:04:56.816598 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.816584 2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 23 22:04:56.820459 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.820440 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 23 22:04:56.820785 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.820767 2556 fs.go:135] Filesystem UUIDs: map[104c56c3-1b45-4ead-8b69-638fcaa9ae44:/dev/nvme0n1p4 304582c6-5b5f-434c-9052-f7628707f223:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 23 22:04:56.820822 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.820786 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 23 22:04:56.825131 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.825006 2556 manager.go:217] Machine: {Timestamp:2026-05-23 22:04:56.824505023 +0000 UTC m=+0.429680418 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099149 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec286b7c008df19adc78afe392c00220 SystemUUID:ec286b7c-008d-f19a-dc78-afe392c00220 BootID:01cd815d-990e-4237-82e2-1dba3f7ef1c5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:62:66:85:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:62:66:85:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:de:68:32:07:60 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 23 22:04:56.825771 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.825759 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 23 22:04:56.825903 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.825891 2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 23 22:04:56.827777 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.827754 2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 23 22:04:56.827914 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.827779 2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-208.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 23 22:04:56.827961 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.827924 2556 topology_manager.go:138] "Creating topology manager with none policy" May 23 22:04:56.827961 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.827934 2556 container_manager_linux.go:306] "Creating device plugin manager" May 23 22:04:56.827961 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.827942 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 23 22:04:56.828781 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.828770 2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 23 22:04:56.830379 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.830370 2556 state_mem.go:36] "Initialized new in-memory state store" May 23 22:04:56.830491 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.830482 2556 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 23 22:04:56.833425 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.833416 2556 kubelet.go:491] "Attempting to sync node with API server" May 23 22:04:56.833463 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.833434 2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 23 22:04:56.833463 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.833447 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 23 22:04:56.833463 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.833456 2556 kubelet.go:397] "Adding apiserver pod source" May 23 22:04:56.833563 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.833465 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 23 22:04:56.834764 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.834753 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 23 22:04:56.834818 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.834770 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 23 22:04:56.837985 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.837966 2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 23 22:04:56.840707 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.840694 2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 23 22:04:56.841600 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841588 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 23 22:04:56.841642 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841607 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 23 22:04:56.841642 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841613 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 23 22:04:56.841642 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841619 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 23 22:04:56.841642 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841628 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 23 22:04:56.841642 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841634 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 23 22:04:56.841642 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841643 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 23 22:04:56.841845 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841651 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 23 22:04:56.841845 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841672 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 23 22:04:56.841845 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841685 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 23 22:04:56.841845 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841697 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 23 22:04:56.841976 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.841967 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 23 22:04:56.843020 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.843007 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 23 22:04:56.843094 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.843026 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 23 22:04:56.846338 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.846321 2556 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 23 22:04:56.846423 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.846364 2556 server.go:1295] "Started kubelet" May 23 22:04:56.846569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.846501 2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 23 22:04:56.846617 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.846591 2556 server_v1.go:47] "podresources" method="list" useActivePods=true May 23 22:04:56.847091 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.847053 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 23 22:04:56.847196 ip-10-0-131-208 systemd[1]: Started Kubernetes Kubelet. May 23 22:04:56.847975 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.847961 2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 23 22:04:56.853366 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.853323 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 23 22:04:56.853727 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.853704 2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-208.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 23 22:04:56.854093 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.854056 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 23 22:04:56.854725 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.854705 2556 server.go:317] "Adding debug handlers to kubelet server" May 23 22:04:56.857473 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.855210 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-208.ec2.internal.18b25107d51558b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-208.ec2.internal,UID:ip-10-0-131-208.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-208.ec2.internal,},FirstTimestamp:2026-05-23 22:04:56.84633413 +0000 UTC m=+0.451509534,LastTimestamp:2026-05-23 22:04:56.84633413 +0000 UTC m=+0.451509534,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-208.ec2.internal,}" May 23 22:04:56.861171 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.861150 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 23 22:04:56.861568 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.861532 2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 23 22:04:56.861799 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.861779 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 23 22:04:56.861900 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.861885 2556 volume_manager.go:295] "The desired_state_of_world populator starts" May 23 22:04:56.861963 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.861902 2556 volume_manager.go:297] "Starting Kubelet Volume Manager" May 23 22:04:56.861963 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.861925 2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 23 22:04:56.862053 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.862025 2556 reconstruct.go:97] "Volume reconstruction finished" May 23 22:04:56.862053 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.862033 2556 reconciler.go:26] "Reconciler: start to sync state" May 23 22:04:56.862317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.862301 2556 factory.go:55] Registering systemd factory May 23 22:04:56.862362 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.862321 2556 factory.go:223] Registration of the systemd container factory successfully May 23 22:04:56.862545 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.862533 2556 factory.go:153] Registering CRI-O factory May 23 22:04:56.862588 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.862549 2556 factory.go:223] Registration of the crio container factory successfully May 23 22:04:56.862626 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.862599 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 23 22:04:56.862626 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.862619 2556 factory.go:103] Registering Raw factory May 23 22:04:56.862713 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.862645 2556 manager.go:1196] Started watching for new ooms in manager May 23 22:04:56.863029 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.863016 2556 manager.go:319] Starting recovery of all containers May 23 22:04:56.863095 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.863074 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:56.863544 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.863521 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 23 22:04:56.863783 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.863749 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 23 22:04:56.864404 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.864388 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kddxz" May 23 22:04:56.869678 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.869620 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kddxz" May 23 22:04:56.872691 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.872676 2556 manager.go:324] Recovery completed May 23 22:04:56.876624 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.876611 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 23 22:04:56.878611 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.878598 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientMemory" May 23 22:04:56.878678 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.878624 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasNoDiskPressure" May 23 22:04:56.878678 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.878641 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientPID" May 23 22:04:56.879157 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.879142 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" May 23 22:04:56.879208 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.879158 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 23 22:04:56.879208 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.879175 2556 state_mem.go:36] "Initialized new in-memory state store" May 23 22:04:56.882426 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.882414 2556 policy_none.go:49] "None policy: Start" May 23 22:04:56.882469 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.882431 2556 memory_manager.go:186] "Starting memorymanager" policy="None" May 23 22:04:56.882469 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.882441 2556 state_mem.go:35] "Initializing new in-memory state store" May 23 22:04:56.920996 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.920983 2556 manager.go:341] "Starting Device Plugin manager" May 23 22:04:56.921077 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.921014 2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 23 22:04:56.921077 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.921024 2556 server.go:85] "Starting device plugin registration server" May 23 22:04:56.921286 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.921273 2556 eviction_manager.go:189] "Eviction manager: starting control loop" May 23 22:04:56.921357 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.921287 2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 23 22:04:56.921466 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.921447 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 23 22:04:56.921558 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.921523 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 23 22:04:56.921558 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.921532 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 23 22:04:56.922457 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.922435 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 23 22:04:56.947642 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.922473 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:56.968611 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.968576 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 23 22:04:56.969750 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.969735 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 23 22:04:56.969835 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.969755 2556 status_manager.go:230] "Starting to sync pod status with apiserver" May 23 22:04:56.969835 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.969777 2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 23 22:04:56.969835 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.969787 2556 kubelet.go:2451] "Starting kubelet main sync loop" May 23 22:04:56.969961 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:56.969887 2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 23 22:04:56.972314 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:56.972295 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 23 22:04:57.021600 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.021517 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 23 22:04:57.022933 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.022917 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientMemory" May 23 22:04:57.023008 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.022947 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasNoDiskPressure" May 23 22:04:57.023008 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.022957 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientPID" May 23 22:04:57.023008 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.022979 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-208.ec2.internal" May 23 22:04:57.031698 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.031684 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-208.ec2.internal" May 23 22:04:57.031760 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.031706 2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-208.ec2.internal\": node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.048279 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.048251 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.070737 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.070698 2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal"] May 23 22:04:57.070826 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.070784 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 23 22:04:57.072470 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.072454 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientMemory" May 23 22:04:57.072528 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.072486 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasNoDiskPressure" May 23 22:04:57.072528 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.072498 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientPID" May 23 22:04:57.074891 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.074879 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 23 22:04:57.075052 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.075039 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal" May 23 22:04:57.075090 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.075069 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 23 22:04:57.075624 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.075600 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientMemory" May 23 22:04:57.075624 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.075627 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasNoDiskPressure" May 23 22:04:57.075764 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.075636 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientPID" May 23 22:04:57.075764 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.075600 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientMemory" May 23 22:04:57.075764 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.075697 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasNoDiskPressure" May 23 22:04:57.075764 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.075710 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientPID" May 23 22:04:57.077873 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.077858 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" May 23 22:04:57.077948 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.077884 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 23 22:04:57.078513 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.078499 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientMemory" May 23 22:04:57.078570 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.078529 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasNoDiskPressure" May 23 22:04:57.078570 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.078546 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeHasSufficientPID" May 23 22:04:57.110633 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.110600 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-208.ec2.internal\" not found" node="ip-10-0-131-208.ec2.internal" May 23 22:04:57.114981 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.114965 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-208.ec2.internal\" not found" node="ip-10-0-131-208.ec2.internal" May 23 22:04:57.148557 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.148536 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.163869 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.163848 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1a1c6272cf368f241f75f4cc656473e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal\" (UID: \"d1a1c6272cf368f241f75f4cc656473e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" May 23 22:04:57.163938 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.163876 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1a1c6272cf368f241f75f4cc656473e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal\" (UID: \"d1a1c6272cf368f241f75f4cc656473e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" May 23 22:04:57.163938 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.163895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67c2375dab2c957f4076b88e403b86cb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-208.ec2.internal\" (UID: \"67c2375dab2c957f4076b88e403b86cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal" May 23 22:04:57.248935 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.248904 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.264177 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.264160 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67c2375dab2c957f4076b88e403b86cb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-208.ec2.internal\" (UID: \"67c2375dab2c957f4076b88e403b86cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal" May 23 22:04:57.264221 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.264183 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1a1c6272cf368f241f75f4cc656473e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal\" (UID: \"d1a1c6272cf368f241f75f4cc656473e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" May 23 22:04:57.264221 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.264200 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1a1c6272cf368f241f75f4cc656473e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal\" (UID: \"d1a1c6272cf368f241f75f4cc656473e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" May 23 22:04:57.264296 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.264243 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1a1c6272cf368f241f75f4cc656473e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal\" (UID: \"d1a1c6272cf368f241f75f4cc656473e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" May 23 22:04:57.264296 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.264261 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67c2375dab2c957f4076b88e403b86cb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-208.ec2.internal\" (UID: \"67c2375dab2c957f4076b88e403b86cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal" May 23 22:04:57.264296 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.264271 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1a1c6272cf368f241f75f4cc656473e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal\" (UID: \"d1a1c6272cf368f241f75f4cc656473e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" May 23 22:04:57.349636 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.349564 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.413091 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.413054 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal" May 23 22:04:57.417794 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.417772 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" May 23 22:04:57.450322 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.450278 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.550796 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.550761 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.651294 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.651219 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.751824 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.751786 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.761974 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.761947 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 23 22:04:57.762125 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.762109 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 23 22:04:57.852070 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.852031 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.862318 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.862292 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 23 22:04:57.871120 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.871060 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 23 22:04:57.871220 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.871151 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-22 21:59:56 +0000 UTC" deadline="2027-12-15 09:46:19.720694533 +0000 UTC" May 23 22:04:57.871220 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.871172 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13691h41m21.849524827s" May 23 22:04:57.886919 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.886898 2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 23 22:04:57.891753 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.891738 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmh8v" May 23 22:04:57.899457 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.899438 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmh8v" May 23 22:04:57.918054 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:57.917908 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c2375dab2c957f4076b88e403b86cb.slice/crio-6a2bc7085711abbc82fd166e63b04ebca87b8daad16b8095fd4610b89898182c WatchSource:0}: Error finding container 6a2bc7085711abbc82fd166e63b04ebca87b8daad16b8095fd4610b89898182c: Status 404 returned error can't find the container with id 6a2bc7085711abbc82fd166e63b04ebca87b8daad16b8095fd4610b89898182c May 23 22:04:57.918270 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:57.918249 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a1c6272cf368f241f75f4cc656473e.slice/crio-233c3475d163de69f27f51a165a10902d38de41e1acb734cfece1d6f7c1efceb WatchSource:0}: Error finding container 233c3475d163de69f27f51a165a10902d38de41e1acb734cfece1d6f7c1efceb: Status 404 returned error can't find the container with id 233c3475d163de69f27f51a165a10902d38de41e1acb734cfece1d6f7c1efceb May 23 22:04:57.922291 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.922275 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 23 22:04:57.953035 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:57.953012 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:57.973082 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.973044 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" event={"ID":"d1a1c6272cf368f241f75f4cc656473e","Type":"ContainerStarted","Data":"233c3475d163de69f27f51a165a10902d38de41e1acb734cfece1d6f7c1efceb"} May 23 22:04:57.973983 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:57.973964 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal" event={"ID":"67c2375dab2c957f4076b88e403b86cb","Type":"ContainerStarted","Data":"6a2bc7085711abbc82fd166e63b04ebca87b8daad16b8095fd4610b89898182c"} May 23 22:04:58.018412 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.018391 2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 23 22:04:58.053287 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:58.053259 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:58.153757 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:58.153721 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:58.254262 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:58.254186 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-208.ec2.internal\" not found" May 23 22:04:58.316167 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.316132 2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 23 22:04:58.362187 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.362155 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" May 23 22:04:58.374638 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.374606 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 23 22:04:58.375573 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.375552 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal" May 23 22:04:58.381559 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.381540 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 23 22:04:58.835110 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.835083 2556 apiserver.go:52] "Watching apiserver" May 23 22:04:58.843049 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.843027 2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 23 22:04:58.845063 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.845035 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp","openshift-image-registry/node-ca-gm8x9","openshift-multus/multus-ffcwv","openshift-network-operator/iptables-alerter-vhtk4","openshift-ovn-kubernetes/ovnkube-node-chpxl","kube-system/konnectivity-agent-nm2bb","kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wg7xc","openshift-dns/node-resolver-5jmxg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal","openshift-multus/multus-additional-cni-plugins-ndkjb","openshift-multus/network-metrics-daemon-h5tlh","openshift-network-diagnostics/network-check-target-72r52"] May 23 22:04:58.847593 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.847573 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:04:58.847714 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:58.847688 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:04:58.849720 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.849698 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.851718 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.851698 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 23 22:04:58.851997 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.851940 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-blrpm\"" May 23 22:04:58.851997 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.851970 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ffcwv" May 23 22:04:58.852139 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.852016 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 23 22:04:58.852327 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.851974 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 23 22:04:58.853955 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.853936 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 23 22:04:58.854120 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.854101 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.854196 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.854148 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 23 22:04:58.854254 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.854224 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 23 22:04:58.854254 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.854231 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gdwjh\"" May 23 22:04:58.854535 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.854477 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 23 22:04:58.856295 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.856272 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 23 22:04:58.856392 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.856277 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 23 22:04:58.856453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.856401 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.856505 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.856447 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v2swx\"" May 23 22:04:58.857030 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.857012 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 23 22:04:58.858399 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.858380 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tkzgt\"" May 23 22:04:58.858680 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.858645 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nm2bb" May 23 22:04:58.859070 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.859041 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 23 22:04:58.859163 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.859078 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 23 22:04:58.859163 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.859095 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 23 22:04:58.859271 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.859094 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 23 22:04:58.859271 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.859043 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 23 22:04:58.859366 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.859287 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 23 22:04:58.860631 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.860612 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 23 22:04:58.860723 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.860675 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 23 22:04:58.860909 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.860892 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-klnqp\"" May 23 22:04:58.861016 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.861000 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.862809 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.862793 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 23 22:04:58.863063 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.863046 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 23 22:04:58.863163 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.863085 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 23 22:04:58.865101 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.863798 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dsjx7\"" May 23 22:04:58.865101 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.864159 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.866330 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.866219 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 23 22:04:58.866330 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.866300 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 23 22:04:58.866499 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.866481 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sdm8c\"" May 23 22:04:58.866784 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.866762 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:58.868789 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.868765 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9xwv5\"" May 23 22:04:58.868882 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.868769 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 23 22:04:58.868882 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.868769 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 23 22:04:58.870218 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.870201 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:04:58.870303 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:58.870263 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:04:58.872546 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.872529 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:58.872971 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.872950 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f69b957c-3ac7-4ede-bcf8-e038427dbf53-agent-certs\") pod \"konnectivity-agent-nm2bb\" (UID: \"f69b957c-3ac7-4ede-bcf8-e038427dbf53\") " pod="kube-system/konnectivity-agent-nm2bb" May 23 22:04:58.873076 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.872990 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-conf-dir\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.873076 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e0fe5df-919d-47c3-bdbb-62aa6ad5da25-host-slash\") pod \"iptables-alerter-vhtk4\" (UID: \"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25\") " pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.873076 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873041 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-run-ovn-kubernetes\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.873076 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.873278 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873090 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb86886e-a68b-4c4e-a078-03ac154dc901-env-overrides\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.873278 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873113 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-registration-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.873278 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873136 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:04:58.873278 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-run-k8s-cni-cncf-io\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.873278 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873201 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpv7r\" (UniqueName: \"kubernetes.io/projected/7e0fe5df-919d-47c3-bdbb-62aa6ad5da25-kube-api-access-cpv7r\") pod \"iptables-alerter-vhtk4\" (UID: \"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25\") " pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.873278 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-slash\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.873522 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-run-ovn\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.873522 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873357 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-cni-bin\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.873522 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873394 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3525a98d-5c23-41d9-a595-30bce5c97349-tmp\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.873522 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873438 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8995c7c9-bd2c-4658-bb7e-e79c5e42ba48-host\") pod \"node-ca-gm8x9\" (UID: \"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48\") " pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.873522 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-system-cni-dir\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.873732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f69b957c-3ac7-4ede-bcf8-e038427dbf53-konnectivity-ca\") pod \"konnectivity-agent-nm2bb\" (UID: \"f69b957c-3ac7-4ede-bcf8-e038427dbf53\") " pod="kube-system/konnectivity-agent-nm2bb" May 23 22:04:58.873732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873553 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mptpx\" (UniqueName: \"kubernetes.io/projected/3525a98d-5c23-41d9-a595-30bce5c97349-kube-api-access-mptpx\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.873732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873578 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-os-release\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.873732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873602 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-daemon-config\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.873732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873628 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g22vj\" (UniqueName: \"kubernetes.io/projected/eb86886e-a68b-4c4e-a078-03ac154dc901-kube-api-access-g22vj\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.873732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-socket-dir-parent\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.873732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-var-lib-cni-bin\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.873732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873722 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-kubernetes\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-host\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vggsg\" (UniqueName: \"kubernetes.io/projected/824089f7-53ba-4de5-8259-3c5e5be800cd-kube-api-access-vggsg\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-kubelet\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-run-openvswitch\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-node-log\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873875 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb86886e-a68b-4c4e-a078-03ac154dc901-ovn-node-metrics-cert\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-modprobe-d\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873919 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-run\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-run-multus-certs\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.873978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-run-netns\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-run-systemd\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-sysctl-d\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-etc-openvswitch\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-device-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-sysconfig\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-cni-dir\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874199 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-var-lib-kubelet\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-log-socket\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874261 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-lib-modules\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zxjz\" (UniqueName: \"kubernetes.io/projected/8995c7c9-bd2c-4658-bb7e-e79c5e42ba48-kube-api-access-7zxjz\") pod \"node-ca-gm8x9\" (UID: \"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48\") " pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/824089f7-53ba-4de5-8259-3c5e5be800cd-cni-binary-copy\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874427 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-cni-netd\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb86886e-a68b-4c4e-a078-03ac154dc901-ovnkube-script-lib\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874491 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3525a98d-5c23-41d9-a595-30bce5c97349-etc-tuned\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874526 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-run-netns\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb86886e-a68b-4c4e-a078-03ac154dc901-ovnkube-config\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874604 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thz6n\" (UniqueName: \"kubernetes.io/projected/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-kube-api-access-thz6n\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874643 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-var-lib-cni-multus\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-systemd-units\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874716 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-var-lib-openvswitch\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.874813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-systemd\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-var-lib-kubelet\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874790 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6mb22\"" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8995c7c9-bd2c-4658-bb7e-e79c5e42ba48-serviceca\") pod \"node-ca-gm8x9\" (UID: \"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48\") " pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-cnibin\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874841 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-hostroot\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874866 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-etc-kubernetes\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874889 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7e0fe5df-919d-47c3-bdbb-62aa6ad5da25-iptables-alerter-script\") pod \"iptables-alerter-vhtk4\" (UID: \"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25\") " pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874915 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-socket-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874970 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874988 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzwxd\" (UniqueName: \"kubernetes.io/projected/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-kube-api-access-mzwxd\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.875022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-sys\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.874842 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.875246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-sys-fs\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.875730 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.875279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-sysctl-conf\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.900042 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.900006 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-22 21:59:57 +0000 UTC" deadline="2028-01-21 15:47:11.586575647 +0000 UTC" May 23 22:04:58.900121 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.900042 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14585h42m12.686536963s" May 23 22:04:58.963324 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.963292 2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 23 22:04:58.975814 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.975782 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-cni-netd\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.975814 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.975819 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb86886e-a68b-4c4e-a078-03ac154dc901-ovnkube-script-lib\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.976043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.975839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c52a45fc-b5ef-4a29-886d-24a731b34cd3-hosts-file\") pod \"node-resolver-5jmxg\" (UID: \"c52a45fc-b5ef-4a29-886d-24a731b34cd3\") " pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:58.976043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.975858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53b84289-d5e8-41de-b21c-3793bf8bf775-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:58.976043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.975883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvs6q\" (UniqueName: \"kubernetes.io/projected/53b84289-d5e8-41de-b21c-3793bf8bf775-kube-api-access-xvs6q\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:58.976043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.975904 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3525a98d-5c23-41d9-a595-30bce5c97349-etc-tuned\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.976043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.975927 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-run-netns\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.976043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.975969 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-run-netns\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.976043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.975995 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-cni-netd\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.976043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976010 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb86886e-a68b-4c4e-a078-03ac154dc901-ovnkube-config\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.976043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976039 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkbd2\" (UniqueName: \"kubernetes.io/projected/c52a45fc-b5ef-4a29-886d-24a731b34cd3-kube-api-access-tkbd2\") pod \"node-resolver-5jmxg\" (UID: \"c52a45fc-b5ef-4a29-886d-24a731b34cd3\") " pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976068 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-system-cni-dir\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53b84289-d5e8-41de-b21c-3793bf8bf775-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976154 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thz6n\" (UniqueName: \"kubernetes.io/projected/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-kube-api-access-thz6n\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976191 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-var-lib-cni-multus\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976214 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-systemd-units\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976239 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-var-lib-openvswitch\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976275 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c52a45fc-b5ef-4a29-886d-24a731b34cd3-tmp-dir\") pod \"node-resolver-5jmxg\" (UID: \"c52a45fc-b5ef-4a29-886d-24a731b34cd3\") " pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976275 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-var-lib-cni-multus\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976274 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976315 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-systemd\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976337 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-var-lib-openvswitch\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976343 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-var-lib-kubelet\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976368 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8995c7c9-bd2c-4658-bb7e-e79c5e42ba48-serviceca\") pod \"node-ca-gm8x9\" (UID: \"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48\") " pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976387 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-systemd\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976393 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-cnibin\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976416 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-hostroot\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976430 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-var-lib-kubelet\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.976494 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976440 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-etc-kubernetes\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976468 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7e0fe5df-919d-47c3-bdbb-62aa6ad5da25-iptables-alerter-script\") pod \"iptables-alerter-vhtk4\" (UID: \"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25\") " pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976472 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-cnibin\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976493 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976516 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-socket-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976542 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976567 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzwxd\" (UniqueName: \"kubernetes.io/projected/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-kube-api-access-mzwxd\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976592 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-sys\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976600 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-systemd-units\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976600 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-etc-kubernetes\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976615 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-sys-fs\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976695 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976790 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-sys\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976813 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-socket-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976838 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976867 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-hostroot\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976916 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-sysctl-conf\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.977317 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976956 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f69b957c-3ac7-4ede-bcf8-e038427dbf53-agent-certs\") pod \"konnectivity-agent-nm2bb\" (UID: \"f69b957c-3ac7-4ede-bcf8-e038427dbf53\") " pod="kube-system/konnectivity-agent-nm2bb" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.976995 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb86886e-a68b-4c4e-a078-03ac154dc901-ovnkube-script-lib\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977012 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-conf-dir\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977038 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e0fe5df-919d-47c3-bdbb-62aa6ad5da25-host-slash\") pod \"iptables-alerter-vhtk4\" (UID: \"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25\") " pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977087 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-sys-fs\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977091 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8995c7c9-bd2c-4658-bb7e-e79c5e42ba48-serviceca\") pod \"node-ca-gm8x9\" (UID: \"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48\") " pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977131 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-conf-dir\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977132 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-sysctl-conf\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977145 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e0fe5df-919d-47c3-bdbb-62aa6ad5da25-host-slash\") pod \"iptables-alerter-vhtk4\" (UID: \"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25\") " pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977166 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-run-ovn-kubernetes\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977171 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7e0fe5df-919d-47c3-bdbb-62aa6ad5da25-iptables-alerter-script\") pod \"iptables-alerter-vhtk4\" (UID: \"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25\") " pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977199 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977215 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-run-ovn-kubernetes\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977227 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb86886e-a68b-4c4e-a078-03ac154dc901-env-overrides\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53b84289-d5e8-41de-b21c-3793bf8bf775-cni-binary-copy\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977298 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977313 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-registration-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.978277 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977343 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977368 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-run-k8s-cni-cncf-io\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977380 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-registration-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977392 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpv7r\" (UniqueName: \"kubernetes.io/projected/7e0fe5df-919d-47c3-bdbb-62aa6ad5da25-kube-api-access-cpv7r\") pod \"iptables-alerter-vhtk4\" (UID: \"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25\") " pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977425 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-slash\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977447 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-run-ovn\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:58.977455 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977460 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-run-k8s-cni-cncf-io\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977470 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-cni-bin\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977502 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-cni-bin\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:58.977524 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs podName:bb43ba8a-7020-4f4a-8c3e-ed619161fc6b nodeName:}" failed. No retries permitted until 2026-05-23 22:04:59.477504204 +0000 UTC m=+3.082679585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs") pod "network-metrics-daemon-h5tlh" (UID: "bb43ba8a-7020-4f4a-8c3e-ed619161fc6b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977540 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-slash\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-cnibin\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977543 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-run-ovn\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977577 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3525a98d-5c23-41d9-a595-30bce5c97349-tmp\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977579 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb86886e-a68b-4c4e-a078-03ac154dc901-env-overrides\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977602 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8995c7c9-bd2c-4658-bb7e-e79c5e42ba48-host\") pod \"node-ca-gm8x9\" (UID: \"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48\") " pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.979159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977625 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-system-cni-dir\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977697 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-system-cni-dir\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977697 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8995c7c9-bd2c-4658-bb7e-e79c5e42ba48-host\") pod \"node-ca-gm8x9\" (UID: \"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48\") " pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-os-release\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977815 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f69b957c-3ac7-4ede-bcf8-e038427dbf53-konnectivity-ca\") pod \"konnectivity-agent-nm2bb\" (UID: \"f69b957c-3ac7-4ede-bcf8-e038427dbf53\") " pod="kube-system/konnectivity-agent-nm2bb" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977848 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mptpx\" (UniqueName: \"kubernetes.io/projected/3525a98d-5c23-41d9-a595-30bce5c97349-kube-api-access-mptpx\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977881 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-os-release\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977908 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-daemon-config\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977934 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g22vj\" (UniqueName: \"kubernetes.io/projected/eb86886e-a68b-4c4e-a078-03ac154dc901-kube-api-access-g22vj\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977961 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-socket-dir-parent\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.977987 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-var-lib-cni-bin\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978013 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-kubernetes\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978038 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-host\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978066 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vggsg\" (UniqueName: \"kubernetes.io/projected/824089f7-53ba-4de5-8259-3c5e5be800cd-kube-api-access-vggsg\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978099 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-kubelet\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978131 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-run-openvswitch\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978155 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-node-log\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.981229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978178 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb86886e-a68b-4c4e-a078-03ac154dc901-ovn-node-metrics-cert\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978226 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-modprobe-d\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978246 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-run\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978267 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-run-multus-certs\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978290 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-run-netns\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978321 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-run-systemd\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978328 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f69b957c-3ac7-4ede-bcf8-e038427dbf53-konnectivity-ca\") pod \"konnectivity-agent-nm2bb\" (UID: \"f69b957c-3ac7-4ede-bcf8-e038427dbf53\") " pod="kube-system/konnectivity-agent-nm2bb" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978340 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-sysctl-d\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978362 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-etc-openvswitch\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978477 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-socket-dir-parent\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978480 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-var-lib-cni-bin\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978503 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-modprobe-d\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978526 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-kubernetes\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978537 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-os-release\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978544 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-run-multus-certs\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978572 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-host\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978579 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-node-log\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.981792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978580 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-run-openvswitch\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978607 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-run-netns\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978619 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-run-systemd\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978678 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-etc-openvswitch\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978705 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-sysctl-d\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978813 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-device-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978837 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-host-kubelet\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978840 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-run\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978847 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-sysconfig\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978902 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-etc-sysconfig\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978946 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-device-dir\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.978984 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-cni-dir\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979033 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-var-lib-kubelet\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979055 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-host-var-lib-kubelet\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979096 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-log-socket\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979124 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-lib-modules\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979171 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb86886e-a68b-4c4e-a078-03ac154dc901-log-socket\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.982453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979179 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zxjz\" (UniqueName: \"kubernetes.io/projected/8995c7c9-bd2c-4658-bb7e-e79c5e42ba48-kube-api-access-7zxjz\") pod \"node-ca-gm8x9\" (UID: \"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48\") " pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979225 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/824089f7-53ba-4de5-8259-3c5e5be800cd-cni-binary-copy\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979242 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-cni-dir\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979310 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3525a98d-5c23-41d9-a595-30bce5c97349-lib-modules\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979337 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/824089f7-53ba-4de5-8259-3c5e5be800cd-multus-daemon-config\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979720 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb86886e-a68b-4c4e-a078-03ac154dc901-ovnkube-config\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979774 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/824089f7-53ba-4de5-8259-3c5e5be800cd-cni-binary-copy\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979968 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3525a98d-5c23-41d9-a595-30bce5c97349-etc-tuned\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.979998 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3525a98d-5c23-41d9-a595-30bce5c97349-tmp\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.980209 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f69b957c-3ac7-4ede-bcf8-e038427dbf53-agent-certs\") pod \"konnectivity-agent-nm2bb\" (UID: \"f69b957c-3ac7-4ede-bcf8-e038427dbf53\") " pod="kube-system/konnectivity-agent-nm2bb" May 23 22:04:58.983088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.980911 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb86886e-a68b-4c4e-a078-03ac154dc901-ovn-node-metrics-cert\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:58.987001 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.986973 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thz6n\" (UniqueName: \"kubernetes.io/projected/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-kube-api-access-thz6n\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:04:58.987808 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.987783 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpv7r\" (UniqueName: \"kubernetes.io/projected/7e0fe5df-919d-47c3-bdbb-62aa6ad5da25-kube-api-access-cpv7r\") pod \"iptables-alerter-vhtk4\" (UID: \"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25\") " pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:58.988735 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.988713 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzwxd\" (UniqueName: \"kubernetes.io/projected/fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c-kube-api-access-mzwxd\") pod \"aws-ebs-csi-driver-node-7zvfp\" (UID: \"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:58.988922 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.988885 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zxjz\" (UniqueName: \"kubernetes.io/projected/8995c7c9-bd2c-4658-bb7e-e79c5e42ba48-kube-api-access-7zxjz\") pod \"node-ca-gm8x9\" (UID: \"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48\") " pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:58.989478 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.989455 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mptpx\" (UniqueName: \"kubernetes.io/projected/3525a98d-5c23-41d9-a595-30bce5c97349-kube-api-access-mptpx\") pod \"tuned-wg7xc\" (UID: \"3525a98d-5c23-41d9-a595-30bce5c97349\") " pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:58.989860 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.989837 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vggsg\" (UniqueName: \"kubernetes.io/projected/824089f7-53ba-4de5-8259-3c5e5be800cd-kube-api-access-vggsg\") pod \"multus-ffcwv\" (UID: \"824089f7-53ba-4de5-8259-3c5e5be800cd\") " pod="openshift-multus/multus-ffcwv" May 23 22:04:58.990223 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:58.990193 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g22vj\" (UniqueName: \"kubernetes.io/projected/eb86886e-a68b-4c4e-a078-03ac154dc901-kube-api-access-g22vj\") pod \"ovnkube-node-chpxl\" (UID: \"eb86886e-a68b-4c4e-a078-03ac154dc901\") " pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:59.080466 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080430 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53b84289-d5e8-41de-b21c-3793bf8bf775-cni-binary-copy\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080645 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080488 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-cnibin\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080645 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080537 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-os-release\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080645 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080571 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080645 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080601 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:04:59.080645 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080611 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-cnibin\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080645 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080632 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c52a45fc-b5ef-4a29-886d-24a731b34cd3-hosts-file\") pod \"node-resolver-5jmxg\" (UID: \"c52a45fc-b5ef-4a29-886d-24a731b34cd3\") " pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080690 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53b84289-d5e8-41de-b21c-3793bf8bf775-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080701 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c52a45fc-b5ef-4a29-886d-24a731b34cd3-hosts-file\") pod \"node-resolver-5jmxg\" (UID: \"c52a45fc-b5ef-4a29-886d-24a731b34cd3\") " pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080707 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-os-release\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080720 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvs6q\" (UniqueName: \"kubernetes.io/projected/53b84289-d5e8-41de-b21c-3793bf8bf775-kube-api-access-xvs6q\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080761 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkbd2\" (UniqueName: \"kubernetes.io/projected/c52a45fc-b5ef-4a29-886d-24a731b34cd3-kube-api-access-tkbd2\") pod \"node-resolver-5jmxg\" (UID: \"c52a45fc-b5ef-4a29-886d-24a731b34cd3\") " pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080795 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-system-cni-dir\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080805 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080822 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53b84289-d5e8-41de-b21c-3793bf8bf775-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080852 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c52a45fc-b5ef-4a29-886d-24a731b34cd3-tmp-dir\") pod \"node-resolver-5jmxg\" (UID: \"c52a45fc-b5ef-4a29-886d-24a731b34cd3\") " pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:59.080969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.080871 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53b84289-d5e8-41de-b21c-3793bf8bf775-system-cni-dir\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.081440 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.081098 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53b84289-d5e8-41de-b21c-3793bf8bf775-cni-binary-copy\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.081440 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.081153 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c52a45fc-b5ef-4a29-886d-24a731b34cd3-tmp-dir\") pod \"node-resolver-5jmxg\" (UID: \"c52a45fc-b5ef-4a29-886d-24a731b34cd3\") " pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:59.081440 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.081181 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53b84289-d5e8-41de-b21c-3793bf8bf775-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.081440 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.081344 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53b84289-d5e8-41de-b21c-3793bf8bf775-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.087269 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.087165 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 23 22:04:59.087269 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.087191 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 23 22:04:59.087269 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.087204 2556 projected.go:194] Error preparing data for projected volume kube-api-access-rb8jj for pod openshift-network-diagnostics/network-check-target-72r52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:04:59.087545 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.087281 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj podName:2cf68606-cd54-4b99-8b79-7401b14a4f26 nodeName:}" failed. No retries permitted until 2026-05-23 22:04:59.58726227 +0000 UTC m=+3.192437673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rb8jj" (UniqueName: "kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj") pod "network-check-target-72r52" (UID: "2cf68606-cd54-4b99-8b79-7401b14a4f26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:04:59.088911 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.088888 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkbd2\" (UniqueName: \"kubernetes.io/projected/c52a45fc-b5ef-4a29-886d-24a731b34cd3-kube-api-access-tkbd2\") pod \"node-resolver-5jmxg\" (UID: \"c52a45fc-b5ef-4a29-886d-24a731b34cd3\") " pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:59.089513 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.089487 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvs6q\" (UniqueName: \"kubernetes.io/projected/53b84289-d5e8-41de-b21c-3793bf8bf775-kube-api-access-xvs6q\") pod \"multus-additional-cni-plugins-ndkjb\" (UID: \"53b84289-d5e8-41de-b21c-3793bf8bf775\") " pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.161680 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.161633 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gm8x9" May 23 22:04:59.171543 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.171519 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhtk4" May 23 22:04:59.180208 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.180181 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ffcwv" May 23 22:04:59.185000 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.184976 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:04:59.191546 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.191529 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nm2bb" May 23 22:04:59.198133 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.198103 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" May 23 22:04:59.203733 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.203717 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" May 23 22:04:59.210248 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.210233 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5jmxg" May 23 22:04:59.214801 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.214783 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" May 23 22:04:59.335411 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.335372 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 23 22:04:59.485022 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.484945 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:04:59.485160 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.485053 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:04:59.485160 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.485130 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs podName:bb43ba8a-7020-4f4a-8c3e-ed619161fc6b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:00.485110997 +0000 UTC m=+4.090286390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs") pod "network-metrics-daemon-h5tlh" (UID: "bb43ba8a-7020-4f4a-8c3e-ed619161fc6b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:04:59.598761 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:59.598731 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69b957c_3ac7_4ede_bcf8_e038427dbf53.slice/crio-a60fc7ae32b5f3ad37c05fb4c24f27ca93231f7ca16612fc4b497e226c7a470d WatchSource:0}: Error finding container a60fc7ae32b5f3ad37c05fb4c24f27ca93231f7ca16612fc4b497e226c7a470d: Status 404 returned error can't find the container with id a60fc7ae32b5f3ad37c05fb4c24f27ca93231f7ca16612fc4b497e226c7a470d May 23 22:04:59.601806 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:59.601766 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b84289_d5e8_41de_b21c_3793bf8bf775.slice/crio-eb86356be755c98763137169a3c0bddd3a55155631ad5233a02843b5414a6058 WatchSource:0}: Error finding container eb86356be755c98763137169a3c0bddd3a55155631ad5233a02843b5414a6058: Status 404 returned error can't find the container with id eb86356be755c98763137169a3c0bddd3a55155631ad5233a02843b5414a6058 May 23 22:04:59.604493 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:59.604178 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3525a98d_5c23_41d9_a595_30bce5c97349.slice/crio-d49983463c55097e51252accdab9414826d5e814636422f9347d24d39c0ada16 WatchSource:0}: Error finding container d49983463c55097e51252accdab9414826d5e814636422f9347d24d39c0ada16: Status 404 returned error can't find the container with id d49983463c55097e51252accdab9414826d5e814636422f9347d24d39c0ada16 May 23 22:04:59.604738 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:59.604648 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824089f7_53ba_4de5_8259_3c5e5be800cd.slice/crio-08e3164813e471ee25870c704b6f8d5a504b8bc4f8a09aad4e6bededf3b3b873 WatchSource:0}: Error finding container 08e3164813e471ee25870c704b6f8d5a504b8bc4f8a09aad4e6bededf3b3b873: Status 404 returned error can't find the container with id 08e3164813e471ee25870c704b6f8d5a504b8bc4f8a09aad4e6bededf3b3b873 May 23 22:04:59.605573 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:59.605357 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0fe5df_919d_47c3_bdbb_62aa6ad5da25.slice/crio-b453569963ca668eeb55eab62541a676536eabac16b015267f0dcd495a378842 WatchSource:0}: Error finding container b453569963ca668eeb55eab62541a676536eabac16b015267f0dcd495a378842: Status 404 returned error can't find the container with id b453569963ca668eeb55eab62541a676536eabac16b015267f0dcd495a378842 May 23 22:04:59.606509 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:59.606482 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8995c7c9_bd2c_4658_bb7e_e79c5e42ba48.slice/crio-b102d5e06ca16a38363fa5c00d7a373b08baf96a552d77cf73f95e2c38412e7e WatchSource:0}: Error finding container b102d5e06ca16a38363fa5c00d7a373b08baf96a552d77cf73f95e2c38412e7e: Status 404 returned error can't find the container with id b102d5e06ca16a38363fa5c00d7a373b08baf96a552d77cf73f95e2c38412e7e May 23 22:04:59.609039 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:59.609009 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb86886e_a68b_4c4e_a078_03ac154dc901.slice/crio-7d57f0ed583f87d9e0fcf8f25b535025c977a26f7cd97f3f652093f407e6dc6d WatchSource:0}: Error finding container 7d57f0ed583f87d9e0fcf8f25b535025c977a26f7cd97f3f652093f407e6dc6d: Status 404 returned error can't find the container with id 7d57f0ed583f87d9e0fcf8f25b535025c977a26f7cd97f3f652093f407e6dc6d May 23 22:04:59.609792 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:59.609767 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2cabf2_63a3_4ce2_a1f8_5d5486d8fc4c.slice/crio-83ceba017d6d29932f1181f9ed493c0491ead416ed153f5008d2e90657c5a158 WatchSource:0}: Error finding container 83ceba017d6d29932f1181f9ed493c0491ead416ed153f5008d2e90657c5a158: Status 404 returned error can't find the container with id 83ceba017d6d29932f1181f9ed493c0491ead416ed153f5008d2e90657c5a158 May 23 22:04:59.610502 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:04:59.610301 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52a45fc_b5ef_4a29_886d_24a731b34cd3.slice/crio-db5cee37f4d73483342ee2810fc85adbb35a6284bcaf21c4e1fb6316b97a64b7 WatchSource:0}: Error finding container db5cee37f4d73483342ee2810fc85adbb35a6284bcaf21c4e1fb6316b97a64b7: Status 404 returned error can't find the container with id db5cee37f4d73483342ee2810fc85adbb35a6284bcaf21c4e1fb6316b97a64b7 May 23 22:04:59.686309 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.686279 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:04:59.689385 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.687214 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 23 22:04:59.689385 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.687254 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 23 22:04:59.689385 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.687270 2556 projected.go:194] Error preparing data for projected volume kube-api-access-rb8jj for pod openshift-network-diagnostics/network-check-target-72r52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:04:59.689385 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:04:59.687343 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj podName:2cf68606-cd54-4b99-8b79-7401b14a4f26 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:00.687315642 +0000 UTC m=+4.292491044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb8jj" (UniqueName: "kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj") pod "network-check-target-72r52" (UID: "2cf68606-cd54-4b99-8b79-7401b14a4f26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:04:59.900502 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.900470 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-22 21:59:57 +0000 UTC" deadline="2027-12-13 08:58:58.279577787 +0000 UTC" May 23 22:04:59.900502 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.900497 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13642h53m58.379083035s" May 23 22:04:59.979574 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.978992 2556 generic.go:358] "Generic (PLEG): container finished" podID="d1a1c6272cf368f241f75f4cc656473e" containerID="732d5fd02a6f90f4401f83321cfdb6a660e0f22050073aafa4e81e5059b024da" exitCode=0 May 23 22:04:59.979574 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.979070 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" event={"ID":"d1a1c6272cf368f241f75f4cc656473e","Type":"ContainerDied","Data":"732d5fd02a6f90f4401f83321cfdb6a660e0f22050073aafa4e81e5059b024da"} May 23 22:04:59.983112 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.983080 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal" event={"ID":"67c2375dab2c957f4076b88e403b86cb","Type":"ContainerStarted","Data":"0714d69e6a138e6f8d956afca10ffe5c39793034e4ca270e659e1153e0cec742"} May 23 22:04:59.990014 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.989958 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ffcwv" event={"ID":"824089f7-53ba-4de5-8259-3c5e5be800cd","Type":"ContainerStarted","Data":"08e3164813e471ee25870c704b6f8d5a504b8bc4f8a09aad4e6bededf3b3b873"} May 23 22:04:59.994117 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.992989 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" event={"ID":"3525a98d-5c23-41d9-a595-30bce5c97349","Type":"ContainerStarted","Data":"d49983463c55097e51252accdab9414826d5e814636422f9347d24d39c0ada16"} May 23 22:04:59.997036 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:04:59.996994 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nm2bb" event={"ID":"f69b957c-3ac7-4ede-bcf8-e038427dbf53","Type":"ContainerStarted","Data":"a60fc7ae32b5f3ad37c05fb4c24f27ca93231f7ca16612fc4b497e226c7a470d"} May 23 22:05:00.000372 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.000324 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5jmxg" event={"ID":"c52a45fc-b5ef-4a29-886d-24a731b34cd3","Type":"ContainerStarted","Data":"db5cee37f4d73483342ee2810fc85adbb35a6284bcaf21c4e1fb6316b97a64b7"} May 23 22:05:00.005869 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.005822 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" event={"ID":"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c","Type":"ContainerStarted","Data":"83ceba017d6d29932f1181f9ed493c0491ead416ed153f5008d2e90657c5a158"} May 23 22:05:00.008654 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.008606 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerStarted","Data":"7d57f0ed583f87d9e0fcf8f25b535025c977a26f7cd97f3f652093f407e6dc6d"} May 23 22:05:00.010555 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.010509 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gm8x9" event={"ID":"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48","Type":"ContainerStarted","Data":"b102d5e06ca16a38363fa5c00d7a373b08baf96a552d77cf73f95e2c38412e7e"} May 23 22:05:00.011917 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.011871 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhtk4" event={"ID":"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25","Type":"ContainerStarted","Data":"b453569963ca668eeb55eab62541a676536eabac16b015267f0dcd495a378842"} May 23 22:05:00.015501 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.015476 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" event={"ID":"53b84289-d5e8-41de-b21c-3793bf8bf775","Type":"ContainerStarted","Data":"eb86356be755c98763137169a3c0bddd3a55155631ad5233a02843b5414a6058"} May 23 22:05:00.493305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.493216 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:00.493470 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:00.493390 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:00.493470 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:00.493455 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs podName:bb43ba8a-7020-4f4a-8c3e-ed619161fc6b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:02.493436386 +0000 UTC m=+6.098611785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs") pod "network-metrics-daemon-h5tlh" (UID: "bb43ba8a-7020-4f4a-8c3e-ed619161fc6b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:00.694507 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.694471 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:00.694736 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:00.694673 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 23 22:05:00.694736 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:00.694698 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 23 22:05:00.694736 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:00.694711 2556 projected.go:194] Error preparing data for projected volume kube-api-access-rb8jj for pod openshift-network-diagnostics/network-check-target-72r52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:00.694900 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:00.694778 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj podName:2cf68606-cd54-4b99-8b79-7401b14a4f26 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:02.694758384 +0000 UTC m=+6.299933791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb8jj" (UniqueName: "kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj") pod "network-check-target-72r52" (UID: "2cf68606-cd54-4b99-8b79-7401b14a4f26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:00.971758 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.971010 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:00.971758 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:00.971133 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:00.971758 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:00.971557 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:00.971758 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:00.971674 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:01.034481 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:01.034400 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" event={"ID":"d1a1c6272cf368f241f75f4cc656473e","Type":"ContainerStarted","Data":"4b519eb3820d62c66e1d6af3abe05e0a0173f7fc24f80eeebbb9717062b5deb6"} May 23 22:05:01.049330 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:01.048235 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-208.ec2.internal" podStartSLOduration=3.048215102 podStartE2EDuration="3.048215102s" podCreationTimestamp="2026-05-23 22:04:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:05:00.004833799 +0000 UTC m=+3.610009206" watchObservedRunningTime="2026-05-23 22:05:01.048215102 +0000 UTC m=+4.653390523" May 23 22:05:02.509275 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:02.508614 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:02.509275 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:02.508798 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:02.509275 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:02.508862 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs podName:bb43ba8a-7020-4f4a-8c3e-ed619161fc6b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:06.508844007 +0000 UTC m=+10.114019395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs") pod "network-metrics-daemon-h5tlh" (UID: "bb43ba8a-7020-4f4a-8c3e-ed619161fc6b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:02.710887 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:02.710407 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:02.710887 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:02.710563 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 23 22:05:02.710887 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:02.710584 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 23 22:05:02.710887 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:02.710596 2556 projected.go:194] Error preparing data for projected volume kube-api-access-rb8jj for pod openshift-network-diagnostics/network-check-target-72r52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:02.710887 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:02.710672 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj podName:2cf68606-cd54-4b99-8b79-7401b14a4f26 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:06.710641606 +0000 UTC m=+10.315817001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb8jj" (UniqueName: "kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj") pod "network-check-target-72r52" (UID: "2cf68606-cd54-4b99-8b79-7401b14a4f26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:02.970727 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:02.970625 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:02.970727 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:02.970684 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:02.970941 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:02.970776 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:02.971183 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:02.971155 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:04.972948 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:04.972903 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:04.973372 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:04.973008 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:04.973372 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:04.973067 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:04.973372 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:04.973166 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:06.537571 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:06.537532 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:06.538064 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:06.537614 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:06.538064 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:06.537692 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs podName:bb43ba8a-7020-4f4a-8c3e-ed619161fc6b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:14.537677716 +0000 UTC m=+18.142853098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs") pod "network-metrics-daemon-h5tlh" (UID: "bb43ba8a-7020-4f4a-8c3e-ed619161fc6b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:06.739088 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:06.739022 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:06.739267 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:06.739202 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 23 22:05:06.739267 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:06.739227 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 23 22:05:06.739267 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:06.739241 2556 projected.go:194] Error preparing data for projected volume kube-api-access-rb8jj for pod openshift-network-diagnostics/network-check-target-72r52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:06.739429 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:06.739307 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj podName:2cf68606-cd54-4b99-8b79-7401b14a4f26 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:14.73928692 +0000 UTC m=+18.344462309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb8jj" (UniqueName: "kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj") pod "network-check-target-72r52" (UID: "2cf68606-cd54-4b99-8b79-7401b14a4f26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:06.972181 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:06.972104 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:06.972181 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:06.972139 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:06.972385 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:06.972230 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:06.972385 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:06.972309 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:07.174830 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.174766 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-208.ec2.internal" podStartSLOduration=9.174747785 podStartE2EDuration="9.174747785s" podCreationTimestamp="2026-05-23 22:04:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:05:01.048874925 +0000 UTC m=+4.654050330" watchObservedRunningTime="2026-05-23 22:05:07.174747785 +0000 UTC m=+10.779923190" May 23 22:05:07.175245 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.175210 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4xkr7"] May 23 22:05:07.178548 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.178133 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.178548 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:07.178237 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:07.241618 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.241547 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.241789 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.241626 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-kubelet-config\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.241789 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.241672 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-dbus\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.342430 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.342184 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.342430 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.342272 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-kubelet-config\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.342430 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.342301 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-dbus\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.342755 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:07.342493 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 23 22:05:07.342755 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:07.342554 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret podName:ca1690e5-e0b4-451e-a0c8-5c626f0c5352 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:07.842536573 +0000 UTC m=+11.447711959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret") pod "global-pull-secret-syncer-4xkr7" (UID: "ca1690e5-e0b4-451e-a0c8-5c626f0c5352") : object "kube-system"/"original-pull-secret" not registered May 23 22:05:07.342755 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.342699 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-dbus\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.342919 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.342771 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-kubelet-config\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.846922 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:07.846884 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:07.847447 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:07.847062 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 23 22:05:07.847447 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:07.847124 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret podName:ca1690e5-e0b4-451e-a0c8-5c626f0c5352 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:08.847105405 +0000 UTC m=+12.452280793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret") pod "global-pull-secret-syncer-4xkr7" (UID: "ca1690e5-e0b4-451e-a0c8-5c626f0c5352") : object "kube-system"/"original-pull-secret" not registered May 23 22:05:08.854067 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:08.853996 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:08.854563 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:08.854163 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 23 22:05:08.854563 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:08.854235 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret podName:ca1690e5-e0b4-451e-a0c8-5c626f0c5352 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:10.854216237 +0000 UTC m=+14.459391623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret") pod "global-pull-secret-syncer-4xkr7" (UID: "ca1690e5-e0b4-451e-a0c8-5c626f0c5352") : object "kube-system"/"original-pull-secret" not registered May 23 22:05:08.970829 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:08.970793 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:08.971009 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:08.970842 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:08.971009 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:08.970793 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:08.971009 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:08.970930 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:08.971147 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:08.971026 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:08.971147 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:08.971082 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:10.870492 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:10.870452 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:10.870918 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:10.870598 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 23 22:05:10.870918 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:10.870689 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret podName:ca1690e5-e0b4-451e-a0c8-5c626f0c5352 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:14.870669836 +0000 UTC m=+18.475845233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret") pod "global-pull-secret-syncer-4xkr7" (UID: "ca1690e5-e0b4-451e-a0c8-5c626f0c5352") : object "kube-system"/"original-pull-secret" not registered May 23 22:05:10.970523 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:10.970482 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:10.970523 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:10.970515 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:10.970784 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:10.970634 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:10.970784 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:10.970731 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:10.970879 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:10.970794 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:10.970910 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:10.970872 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:12.970147 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:12.970110 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:12.970576 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:12.970117 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:12.970576 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:12.970239 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:12.970576 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:12.970328 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:12.970576 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:12.970121 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:12.970576 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:12.970421 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:14.596949 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:14.596914 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:14.597326 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.597030 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:14.597326 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.597109 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs podName:bb43ba8a-7020-4f4a-8c3e-ed619161fc6b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:30.597085805 +0000 UTC m=+34.202261212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs") pod "network-metrics-daemon-h5tlh" (UID: "bb43ba8a-7020-4f4a-8c3e-ed619161fc6b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:14.798774 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:14.798731 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:14.798973 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.798864 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 23 22:05:14.798973 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.798879 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 23 22:05:14.798973 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.798890 2556 projected.go:194] Error preparing data for projected volume kube-api-access-rb8jj for pod openshift-network-diagnostics/network-check-target-72r52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:14.798973 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.798953 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj podName:2cf68606-cd54-4b99-8b79-7401b14a4f26 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:30.798933921 +0000 UTC m=+34.404109303 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb8jj" (UniqueName: "kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj") pod "network-check-target-72r52" (UID: "2cf68606-cd54-4b99-8b79-7401b14a4f26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:14.899930 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:14.899835 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:14.900081 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.900013 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 23 22:05:14.900140 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.900095 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret podName:ca1690e5-e0b4-451e-a0c8-5c626f0c5352 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:22.900074887 +0000 UTC m=+26.505250285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret") pod "global-pull-secret-syncer-4xkr7" (UID: "ca1690e5-e0b4-451e-a0c8-5c626f0c5352") : object "kube-system"/"original-pull-secret" not registered May 23 22:05:14.970048 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:14.970008 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:14.970048 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:14.970048 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:14.970048 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:14.970053 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:14.970332 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.970133 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:14.970332 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.970267 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:14.970440 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:14.970353 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:16.973796 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:16.973561 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:16.974259 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:16.973579 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:16.974259 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:16.973905 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:16.974259 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:16.973948 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:16.974259 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:16.973588 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:16.974259 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:16.974068 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:18.065425 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.065171 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5jmxg" event={"ID":"c52a45fc-b5ef-4a29-886d-24a731b34cd3","Type":"ContainerStarted","Data":"891a87666fc82753d857e31a502c6497b57f5f2397d21ce20d5acd9af835ff39"} May 23 22:05:18.066585 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.066561 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" event={"ID":"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c","Type":"ContainerStarted","Data":"690b70f63d271f25cc8796f199331d02e1fa65baa76bfdac97d89b64f17593de"} May 23 22:05:18.068845 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.068828 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:05:18.069137 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.069119 2556 generic.go:358] "Generic (PLEG): container finished" podID="eb86886e-a68b-4c4e-a078-03ac154dc901" containerID="b7062b13be3453049a607d0b1afdb70036524a8769e16bf0e2e8c219bc8d58c4" exitCode=1 May 23 22:05:18.069234 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.069186 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerStarted","Data":"b3a2ca65d78036553d3f5a116334be3ddb0ff6e850280da0717d334b574beda1"} May 23 22:05:18.069234 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.069206 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerStarted","Data":"879eedb578a31c6e207f8022dd3c9c5574b2d30bf61f9570423dfb415638ddad"} May 23 22:05:18.069234 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.069221 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerStarted","Data":"18b620b615d504b693abf78a9b75e4f7b7f60410d76007187d363b50521685e5"} May 23 22:05:18.069234 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.069232 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerDied","Data":"b7062b13be3453049a607d0b1afdb70036524a8769e16bf0e2e8c219bc8d58c4"} May 23 22:05:18.069425 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.069245 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerStarted","Data":"e093754fc4a532d12c29b6cc7641891defd71b321bae8d1c21c3745a79d74e93"} May 23 22:05:18.070625 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.070584 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gm8x9" event={"ID":"8995c7c9-bd2c-4658-bb7e-e79c5e42ba48","Type":"ContainerStarted","Data":"5371d4a6795acb0c9d0195c51ab437665832f6c09d03eb22092858529928f099"} May 23 22:05:18.071916 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.071896 2556 generic.go:358] "Generic (PLEG): container finished" podID="53b84289-d5e8-41de-b21c-3793bf8bf775" containerID="9e94d56fcbd3d2ff51b3cfef4565d22a6611a0fd9e01d51f9fb32565c6bfde6f" exitCode=0 May 23 22:05:18.072005 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.071977 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" event={"ID":"53b84289-d5e8-41de-b21c-3793bf8bf775","Type":"ContainerDied","Data":"9e94d56fcbd3d2ff51b3cfef4565d22a6611a0fd9e01d51f9fb32565c6bfde6f"} May 23 22:05:18.073308 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.073275 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ffcwv" event={"ID":"824089f7-53ba-4de5-8259-3c5e5be800cd","Type":"ContainerStarted","Data":"ea9b25440fa9c4ac215937a2fa2dd4065d5a5e0c62fddf7c5c358edfd324a10b"} May 23 22:05:18.074569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.074543 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" event={"ID":"3525a98d-5c23-41d9-a595-30bce5c97349","Type":"ContainerStarted","Data":"2f5471deb9022d9934a1aa93d99832449a1b554d894252f85eec6812de20332e"} May 23 22:05:18.075629 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.075611 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nm2bb" event={"ID":"f69b957c-3ac7-4ede-bcf8-e038427dbf53","Type":"ContainerStarted","Data":"e3070e2ffe2e93a8fa53b588c1e01e251382b0c34c7b8c5860b64b8cafeeb809"} May 23 22:05:18.079051 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.079009 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-5jmxg" podStartSLOduration=3.457127003 podStartE2EDuration="21.078994604s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:04:59.631933816 +0000 UTC m=+3.237109204" lastFinishedPulling="2026-05-23 22:05:17.253801418 +0000 UTC m=+20.858976805" observedRunningTime="2026-05-23 22:05:18.078310699 +0000 UTC m=+21.683486104" watchObservedRunningTime="2026-05-23 22:05:18.078994604 +0000 UTC m=+21.684170009" May 23 22:05:18.095729 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.095677 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wg7xc" podStartSLOduration=3.454832843 podStartE2EDuration="21.095651967s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:04:59.606639134 +0000 UTC m=+3.211814521" lastFinishedPulling="2026-05-23 22:05:17.247458249 +0000 UTC m=+20.852633645" observedRunningTime="2026-05-23 22:05:18.095446649 +0000 UTC m=+21.700622057" watchObservedRunningTime="2026-05-23 22:05:18.095651967 +0000 UTC m=+21.700827372" May 23 22:05:18.148015 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.147969 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nm2bb" podStartSLOduration=3.57062826 podStartE2EDuration="21.147953577s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:04:59.60194647 +0000 UTC m=+3.207121853" lastFinishedPulling="2026-05-23 22:05:17.179271781 +0000 UTC m=+20.784447170" observedRunningTime="2026-05-23 22:05:18.14789268 +0000 UTC m=+21.753068084" watchObservedRunningTime="2026-05-23 22:05:18.147953577 +0000 UTC m=+21.753128983" May 23 22:05:18.148452 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.148422 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-ffcwv" podStartSLOduration=3.48703697 podStartE2EDuration="21.148410799s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:04:59.608488303 +0000 UTC m=+3.213663706" lastFinishedPulling="2026-05-23 22:05:17.26986214 +0000 UTC m=+20.875037535" observedRunningTime="2026-05-23 22:05:18.130155031 +0000 UTC m=+21.735330440" watchObservedRunningTime="2026-05-23 22:05:18.148410799 +0000 UTC m=+21.753586203" May 23 22:05:18.160915 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.160869 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gm8x9" podStartSLOduration=3.54125252 podStartE2EDuration="21.160854322s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:04:59.60959721 +0000 UTC m=+3.214772605" lastFinishedPulling="2026-05-23 22:05:17.22919902 +0000 UTC m=+20.834374407" observedRunningTime="2026-05-23 22:05:18.160636481 +0000 UTC m=+21.765811886" watchObservedRunningTime="2026-05-23 22:05:18.160854322 +0000 UTC m=+21.766029729" May 23 22:05:18.490100 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.489878 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 23 22:05:18.934538 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.934395 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-23T22:05:18.490066069Z","UUID":"ef725266-bb3b-401c-91fc-91a069437068","Handler":null,"Name":"","Endpoint":""} May 23 22:05:18.937497 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.937473 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 23 22:05:18.937497 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.937500 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 23 22:05:18.970836 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.970807 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:18.970973 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.970806 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:18.970973 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:18.970918 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:18.971083 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:18.970807 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:18.971083 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:18.970971 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:18.971083 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:18.971044 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:19.079641 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:19.079588 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" event={"ID":"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c","Type":"ContainerStarted","Data":"85018e2d862093d4773e0e7ccb664960e75ee306404ad3fc1a351ae52467f6c8"} May 23 22:05:19.083155 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:19.083133 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:05:19.083575 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:19.083549 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerStarted","Data":"7ca4dac684490be247cb921cbb454144b19c26ade2c8ac9e9cc96992ff7da459"} May 23 22:05:19.085210 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:19.085187 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhtk4" event={"ID":"7e0fe5df-919d-47c3-bdbb-62aa6ad5da25","Type":"ContainerStarted","Data":"e2ca466e845b59453e5d1ed6cff9aef823c58f5d00c7994f3e747eb06bb67cdf"} May 23 22:05:19.111612 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:19.111525 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vhtk4" podStartSLOduration=4.541400144 podStartE2EDuration="22.111506618s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:04:59.609163363 +0000 UTC m=+3.214338745" lastFinishedPulling="2026-05-23 22:05:17.179269825 +0000 UTC m=+20.784445219" observedRunningTime="2026-05-23 22:05:19.110974319 +0000 UTC m=+22.716149724" watchObservedRunningTime="2026-05-23 22:05:19.111506618 +0000 UTC m=+22.716682023" May 23 22:05:20.087877 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:20.087841 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" event={"ID":"fc2cabf2-63a3-4ce2-a1f8-5d5486d8fc4c","Type":"ContainerStarted","Data":"b0622b230f450199936f537e54b1883ea090bcad5f7c2efe0ed52e182ad3ac56"} May 23 22:05:20.104069 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:20.104029 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zvfp" podStartSLOduration=3.0670051640000002 podStartE2EDuration="23.104016076s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:04:59.632009682 +0000 UTC m=+3.237185063" lastFinishedPulling="2026-05-23 22:05:19.669020579 +0000 UTC m=+23.274195975" observedRunningTime="2026-05-23 22:05:20.103500005 +0000 UTC m=+23.708675419" watchObservedRunningTime="2026-05-23 22:05:20.104016076 +0000 UTC m=+23.709191479" May 23 22:05:20.677815 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:20.677733 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nm2bb" May 23 22:05:20.678379 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:20.678358 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nm2bb" May 23 22:05:20.970859 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:20.970822 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:20.971032 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:20.970859 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:20.971032 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:20.970870 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:20.971032 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:20.970974 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:20.971169 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:20.971110 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:20.971229 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:20.971210 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:21.092629 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:21.092601 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:05:21.093223 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:21.092963 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerStarted","Data":"6e96ad9406c8168fed38eaf41e40a4309d3288919fe3258fba41fa9efd35ac32"} May 23 22:05:21.093273 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:21.093259 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nm2bb" May 23 22:05:21.093639 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:21.093624 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nm2bb" May 23 22:05:22.960699 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:22.960537 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:22.961149 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:22.960649 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 23 22:05:22.961149 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:22.960824 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret podName:ca1690e5-e0b4-451e-a0c8-5c626f0c5352 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:38.960801875 +0000 UTC m=+42.565977277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret") pod "global-pull-secret-syncer-4xkr7" (UID: "ca1690e5-e0b4-451e-a0c8-5c626f0c5352") : object "kube-system"/"original-pull-secret" not registered May 23 22:05:22.970775 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:22.970753 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:22.970886 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:22.970805 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:22.970957 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:22.970909 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:22.971013 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:22.970963 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:22.971013 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:22.970973 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:22.971077 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:22.971024 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:23.098921 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:23.098898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:05:23.099241 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:23.099216 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerStarted","Data":"9406189ada3757f5c9427875e66bbe8ce6959937d86897910e77ebe601efdbe5"} May 23 22:05:23.099615 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:23.099580 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:05:23.099615 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:23.099610 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:05:23.099788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:23.099623 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:05:23.099788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:23.099679 2556 scope.go:117] "RemoveContainer" containerID="b7062b13be3453049a607d0b1afdb70036524a8769e16bf0e2e8c219bc8d58c4" May 23 22:05:23.114543 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:23.114523 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:05:23.114642 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:23.114607 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:05:24.104014 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:24.103988 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:05:24.104471 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:24.104302 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" event={"ID":"eb86886e-a68b-4c4e-a078-03ac154dc901","Type":"ContainerStarted","Data":"3978beaf785b4291178b13f0a5d01ecbf2485a53ba948f634fd1cfb62498128f"} May 23 22:05:24.105904 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:24.105879 2556 generic.go:358] "Generic (PLEG): container finished" podID="53b84289-d5e8-41de-b21c-3793bf8bf775" containerID="444fa6044084b5523145a19d6797878892a240c997d0f48c3c617a966d9d55ca" exitCode=0 May 23 22:05:24.106004 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:24.105927 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" event={"ID":"53b84289-d5e8-41de-b21c-3793bf8bf775","Type":"ContainerDied","Data":"444fa6044084b5523145a19d6797878892a240c997d0f48c3c617a966d9d55ca"} May 23 22:05:24.131390 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:24.131346 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" podStartSLOduration=9.272439134 podStartE2EDuration="27.131333289s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:04:59.631932902 +0000 UTC m=+3.237108294" lastFinishedPulling="2026-05-23 22:05:17.490827053 +0000 UTC m=+21.096002449" observedRunningTime="2026-05-23 22:05:24.130839467 +0000 UTC m=+27.736014871" watchObservedRunningTime="2026-05-23 22:05:24.131333289 +0000 UTC m=+27.736508733" May 23 22:05:24.970675 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:24.970638 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:24.970770 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:24.970678 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:24.970770 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:24.970646 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:24.970876 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:24.970768 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:24.970876 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:24.970852 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:24.970967 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:24.970941 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:25.109568 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:25.109543 2556 generic.go:358] "Generic (PLEG): container finished" podID="53b84289-d5e8-41de-b21c-3793bf8bf775" containerID="85be371c30df70d6f54343428789490da09bb5d299625e0ae5ed27810921063e" exitCode=0 May 23 22:05:25.109923 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:25.109618 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" event={"ID":"53b84289-d5e8-41de-b21c-3793bf8bf775","Type":"ContainerDied","Data":"85be371c30df70d6f54343428789490da09bb5d299625e0ae5ed27810921063e"} May 23 22:05:25.182473 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:25.182412 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-72r52"] May 23 22:05:25.182592 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:25.182494 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:25.182640 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:25.182598 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:25.185253 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:25.185228 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4xkr7"] May 23 22:05:25.185361 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:25.185307 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:25.185415 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:25.185380 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:25.185748 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:25.185729 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5tlh"] May 23 22:05:25.185847 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:25.185792 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:25.185899 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:25.185864 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:26.971764 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:26.971587 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:26.972212 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:26.971654 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:26.972212 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:26.971715 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:26.972212 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:26.971952 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:26.972212 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:26.971822 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:26.972212 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:26.971999 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:27.115861 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:27.115828 2556 generic.go:358] "Generic (PLEG): container finished" podID="53b84289-d5e8-41de-b21c-3793bf8bf775" containerID="a079d7e6afe2ff687e0745c0026a24a3ddbd83a9d81142e4d69ef6d7feb7c242" exitCode=0 May 23 22:05:27.116002 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:27.115870 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" event={"ID":"53b84289-d5e8-41de-b21c-3793bf8bf775","Type":"ContainerDied","Data":"a079d7e6afe2ff687e0745c0026a24a3ddbd83a9d81142e4d69ef6d7feb7c242"} May 23 22:05:28.970183 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:28.970148 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:28.970706 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:28.970148 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:28.970706 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:28.970263 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:28.970706 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:28.970352 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:28.970706 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:28.970150 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:28.970706 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:28.970447 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:30.624640 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:30.624603 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:30.625167 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:30.624779 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:30.625167 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:30.624848 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs podName:bb43ba8a-7020-4f4a-8c3e-ed619161fc6b nodeName:}" failed. No retries permitted until 2026-05-23 22:06:02.624829814 +0000 UTC m=+66.230005200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs") pod "network-metrics-daemon-h5tlh" (UID: "bb43ba8a-7020-4f4a-8c3e-ed619161fc6b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 23 22:05:30.826246 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:30.826209 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:30.826421 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:30.826387 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 23 22:05:30.826421 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:30.826407 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 23 22:05:30.826421 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:30.826416 2556 projected.go:194] Error preparing data for projected volume kube-api-access-rb8jj for pod openshift-network-diagnostics/network-check-target-72r52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:30.826578 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:30.826467 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj podName:2cf68606-cd54-4b99-8b79-7401b14a4f26 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:02.826453878 +0000 UTC m=+66.431629261 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb8jj" (UniqueName: "kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj") pod "network-check-target-72r52" (UID: "2cf68606-cd54-4b99-8b79-7401b14a4f26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 23 22:05:30.970506 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:30.970454 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:30.970723 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:30.970573 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72r52" podUID="2cf68606-cd54-4b99-8b79-7401b14a4f26" May 23 22:05:30.970723 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:30.970455 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:30.970723 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:30.970688 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xkr7" podUID="ca1690e5-e0b4-451e-a0c8-5c626f0c5352" May 23 22:05:30.970723 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:30.970454 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:30.970944 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:30.970808 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:05:31.254438 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.254358 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-208.ec2.internal" event="NodeReady" May 23 22:05:31.254602 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.254508 2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 23 22:05:31.289860 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.289829 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77787fc544-t6lmp"] May 23 22:05:31.310076 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.310050 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m"] May 23 22:05:31.310231 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.310184 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.312563 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.312537 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 23 22:05:31.312849 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.312827 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 23 22:05:31.312974 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.312917 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 23 22:05:31.313524 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.313505 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9j6m4\"" May 23 22:05:31.318235 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.317914 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 23 22:05:31.330221 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.330202 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk"] May 23 22:05:31.330354 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.330339 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.332623 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.332604 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 23 22:05:31.332772 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.332681 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 23 22:05:31.332860 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.332842 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 23 22:05:31.333482 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.333467 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 23 22:05:31.356213 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.356189 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9"] May 23 22:05:31.356335 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.356319 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" May 23 22:05:31.358653 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.358635 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sfjl2\"" May 23 22:05:31.358744 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.358682 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 23 22:05:31.371200 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.371162 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-st2tr"] May 23 22:05:31.371366 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.371307 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.373572 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.373552 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 23 22:05:31.373572 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.373573 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 23 22:05:31.373739 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.373601 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 23 22:05:31.373739 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.373627 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 23 22:05:31.385196 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.385177 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk"] May 23 22:05:31.385292 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.385200 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m"] May 23 22:05:31.385292 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.385210 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77787fc544-t6lmp"] May 23 22:05:31.385292 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.385221 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-st2tr"] May 23 22:05:31.385292 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.385232 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9"] May 23 22:05:31.385469 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.385338 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.387954 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.387816 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 23 22:05:31.388056 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.387959 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5kjmz\"" May 23 22:05:31.388056 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.388003 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 23 22:05:31.403915 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.403892 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m82sl"] May 23 22:05:31.419574 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.419512 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m82sl"] May 23 22:05:31.419718 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.419622 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:31.422034 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.421998 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 23 22:05:31.422174 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.422088 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mnn9s\"" May 23 22:05:31.422174 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.422113 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 23 22:05:31.422378 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.422366 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 23 22:05:31.430735 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430716 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-registry-certificates\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.430820 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430740 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7sh6\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-kube-api-access-t7sh6\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.430820 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-trusted-ca\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.430820 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-installation-pull-secrets\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.430820 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430810 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-bound-sa-token\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.430949 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430827 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd3f210-a6bb-4a2e-add5-42cbb626d556-tmp\") pod \"klusterlet-addon-workmgr-67f48dd96f-8qp7m\" (UID: \"6cd3f210-a6bb-4a2e-add5-42cbb626d556\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.430949 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-image-registry-private-configuration\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.430949 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6396088-510a-48b9-a212-3a91a1facc75-ca-trust-extracted\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.430949 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430929 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cd3f210-a6bb-4a2e-add5-42cbb626d556-klusterlet-config\") pod \"klusterlet-addon-workmgr-67f48dd96f-8qp7m\" (UID: \"6cd3f210-a6bb-4a2e-add5-42cbb626d556\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.431065 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.430971 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd4jj\" (UniqueName: \"kubernetes.io/projected/6cd3f210-a6bb-4a2e-add5-42cbb626d556-kube-api-access-xd4jj\") pod \"klusterlet-addon-workmgr-67f48dd96f-8qp7m\" (UID: \"6cd3f210-a6bb-4a2e-add5-42cbb626d556\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.431065 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.431054 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.531985 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.531909 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6396088-510a-48b9-a212-3a91a1facc75-ca-trust-extracted\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.531985 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.531956 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cd3f210-a6bb-4a2e-add5-42cbb626d556-klusterlet-config\") pod \"klusterlet-addon-workmgr-67f48dd96f-8qp7m\" (UID: \"6cd3f210-a6bb-4a2e-add5-42cbb626d556\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.532194 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532064 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xd4jj\" (UniqueName: \"kubernetes.io/projected/6cd3f210-a6bb-4a2e-add5-42cbb626d556-kube-api-access-xd4jj\") pod \"klusterlet-addon-workmgr-67f48dd96f-8qp7m\" (UID: \"6cd3f210-a6bb-4a2e-add5-42cbb626d556\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.532194 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:31.532194 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532136 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/eb7bb257-2c2b-4416-8ccb-410dbea10db8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.532194 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532167 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.532387 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twqt5\" (UniqueName: \"kubernetes.io/projected/86e4489c-1de2-480d-9bd9-0277bd259d17-kube-api-access-twqt5\") pod \"managed-serviceaccount-addon-agent-7c7db646cb-5cgjk\" (UID: \"86e4489c-1de2-480d-9bd9-0277bd259d17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" May 23 22:05:31.532387 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:31.532260 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 23 22:05:31.532387 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:31.532286 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77787fc544-t6lmp: secret "image-registry-tls" not found May 23 22:05:31.532387 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-hub\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.532387 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532316 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.532387 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532336 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbrgg\" (UniqueName: \"kubernetes.io/projected/558c2bc9-c73f-499a-8f87-c61449d47c8b-kube-api-access-dbrgg\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.532387 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532342 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6396088-510a-48b9-a212-3a91a1facc75-ca-trust-extracted\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.532387 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:31.532368 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls podName:d6396088-510a-48b9-a212-3a91a1facc75 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:32.032345479 +0000 UTC m=+35.637520871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls") pod "image-registry-77787fc544-t6lmp" (UID: "d6396088-510a-48b9-a212-3a91a1facc75") : secret "image-registry-tls" not found May 23 22:05:31.532792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532412 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-registry-certificates\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.532792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532436 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7sh6\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-kube-api-access-t7sh6\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.532792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532461 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.532792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/558c2bc9-c73f-499a-8f87-c61449d47c8b-config-volume\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.532792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532504 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/558c2bc9-c73f-499a-8f87-c61449d47c8b-tmp-dir\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.532792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532547 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-trusted-ca\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.532792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532572 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-installation-pull-secrets\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.532792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532606 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-bound-sa-token\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.532792 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532746 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd3f210-a6bb-4a2e-add5-42cbb626d556-tmp\") pod \"klusterlet-addon-workmgr-67f48dd96f-8qp7m\" (UID: \"6cd3f210-a6bb-4a2e-add5-42cbb626d556\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.533224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532803 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-495vh\" (UniqueName: \"kubernetes.io/projected/32c3d90a-f07f-4a74-aed1-627db82ad4c4-kube-api-access-495vh\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:31.533224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-ca\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.533224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb5j7\" (UniqueName: \"kubernetes.io/projected/eb7bb257-2c2b-4416-8ccb-410dbea10db8-kube-api-access-cb5j7\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.533224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532910 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-image-registry-private-configuration\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.533224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86e4489c-1de2-480d-9bd9-0277bd259d17-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c7db646cb-5cgjk\" (UID: \"86e4489c-1de2-480d-9bd9-0277bd259d17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" May 23 22:05:31.533224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532970 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-registry-certificates\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.533224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.532976 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.533224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.533154 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd3f210-a6bb-4a2e-add5-42cbb626d556-tmp\") pod \"klusterlet-addon-workmgr-67f48dd96f-8qp7m\" (UID: \"6cd3f210-a6bb-4a2e-add5-42cbb626d556\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.533629 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.533476 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-trusted-ca\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.537063 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.536899 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-installation-pull-secrets\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.537180 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.536919 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-image-registry-private-configuration\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.537180 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.537007 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cd3f210-a6bb-4a2e-add5-42cbb626d556-klusterlet-config\") pod \"klusterlet-addon-workmgr-67f48dd96f-8qp7m\" (UID: \"6cd3f210-a6bb-4a2e-add5-42cbb626d556\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.541068 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.541041 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7sh6\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-kube-api-access-t7sh6\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.541251 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.541231 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-bound-sa-token\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:31.541428 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.541407 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd4jj\" (UniqueName: \"kubernetes.io/projected/6cd3f210-a6bb-4a2e-add5-42cbb626d556-kube-api-access-xd4jj\") pod \"klusterlet-addon-workmgr-67f48dd96f-8qp7m\" (UID: \"6cd3f210-a6bb-4a2e-add5-42cbb626d556\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.633733 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.633696 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86e4489c-1de2-480d-9bd9-0277bd259d17-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c7db646cb-5cgjk\" (UID: \"86e4489c-1de2-480d-9bd9-0277bd259d17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.633762 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.633806 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.633829 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/eb7bb257-2c2b-4416-8ccb-410dbea10db8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.633882 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twqt5\" (UniqueName: \"kubernetes.io/projected/86e4489c-1de2-480d-9bd9-0277bd259d17-kube-api-access-twqt5\") pod \"managed-serviceaccount-addon-agent-7c7db646cb-5cgjk\" (UID: \"86e4489c-1de2-480d-9bd9-0277bd259d17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:31.633941 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:31.634017 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert podName:32c3d90a-f07f-4a74-aed1-627db82ad4c4 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:32.133991844 +0000 UTC m=+35.739167239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert") pod "ingress-canary-m82sl" (UID: "32c3d90a-f07f-4a74-aed1-627db82ad4c4") : secret "canary-serving-cert" not found May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634132 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-hub\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634164 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634192 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbrgg\" (UniqueName: \"kubernetes.io/projected/558c2bc9-c73f-499a-8f87-c61449d47c8b-kube-api-access-dbrgg\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.634218 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634227 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634254 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/558c2bc9-c73f-499a-8f87-c61449d47c8b-config-volume\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634277 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/558c2bc9-c73f-499a-8f87-c61449d47c8b-tmp-dir\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:31.634296 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634348 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-495vh\" (UniqueName: \"kubernetes.io/projected/32c3d90a-f07f-4a74-aed1-627db82ad4c4-kube-api-access-495vh\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:31.634359 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls podName:558c2bc9-c73f-499a-8f87-c61449d47c8b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:32.134341364 +0000 UTC m=+35.739516760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls") pod "dns-default-st2tr" (UID: "558c2bc9-c73f-499a-8f87-c61449d47c8b") : secret "dns-default-metrics-tls" not found May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634391 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-ca\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634423 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cb5j7\" (UniqueName: \"kubernetes.io/projected/eb7bb257-2c2b-4416-8ccb-410dbea10db8-kube-api-access-cb5j7\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.634845 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/eb7bb257-2c2b-4416-8ccb-410dbea10db8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.635117 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/558c2bc9-c73f-499a-8f87-c61449d47c8b-tmp-dir\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.635569 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.635293 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/558c2bc9-c73f-499a-8f87-c61449d47c8b-config-volume\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.637162 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.637119 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86e4489c-1de2-480d-9bd9-0277bd259d17-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c7db646cb-5cgjk\" (UID: \"86e4489c-1de2-480d-9bd9-0277bd259d17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" May 23 22:05:31.637448 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.637425 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-ca\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.637600 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.637584 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-hub\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.637671 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.637642 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.638165 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.638141 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eb7bb257-2c2b-4416-8ccb-410dbea10db8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.641041 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.641019 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:31.645344 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.645300 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb5j7\" (UniqueName: \"kubernetes.io/projected/eb7bb257-2c2b-4416-8ccb-410dbea10db8-kube-api-access-cb5j7\") pod \"cluster-proxy-proxy-agent-66668d9cfd-qbdc9\" (UID: \"eb7bb257-2c2b-4416-8ccb-410dbea10db8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:31.645592 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.645532 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twqt5\" (UniqueName: \"kubernetes.io/projected/86e4489c-1de2-480d-9bd9-0277bd259d17-kube-api-access-twqt5\") pod \"managed-serviceaccount-addon-agent-7c7db646cb-5cgjk\" (UID: \"86e4489c-1de2-480d-9bd9-0277bd259d17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" May 23 22:05:31.645838 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.645820 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbrgg\" (UniqueName: \"kubernetes.io/projected/558c2bc9-c73f-499a-8f87-c61449d47c8b-kube-api-access-dbrgg\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:31.646343 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.646322 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-495vh\" (UniqueName: \"kubernetes.io/projected/32c3d90a-f07f-4a74-aed1-627db82ad4c4-kube-api-access-495vh\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:31.680138 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.680106 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" May 23 22:05:31.687961 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:31.687939 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:05:32.038284 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.038243 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:32.038471 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:32.038375 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 23 22:05:32.038471 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:32.038394 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77787fc544-t6lmp: secret "image-registry-tls" not found May 23 22:05:32.038588 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:32.038482 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls podName:d6396088-510a-48b9-a212-3a91a1facc75 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:33.038461344 +0000 UTC m=+36.643636749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls") pod "image-registry-77787fc544-t6lmp" (UID: "d6396088-510a-48b9-a212-3a91a1facc75") : secret "image-registry-tls" not found May 23 22:05:32.139384 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.139351 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:32.139548 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.139417 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:32.139548 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:32.139493 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 23 22:05:32.139681 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:32.139560 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert podName:32c3d90a-f07f-4a74-aed1-627db82ad4c4 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:33.139539253 +0000 UTC m=+36.744714640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert") pod "ingress-canary-m82sl" (UID: "32c3d90a-f07f-4a74-aed1-627db82ad4c4") : secret "canary-serving-cert" not found May 23 22:05:32.139681 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:32.139574 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 23 22:05:32.139681 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:32.139633 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls podName:558c2bc9-c73f-499a-8f87-c61449d47c8b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:33.139613926 +0000 UTC m=+36.744789320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls") pod "dns-default-st2tr" (UID: "558c2bc9-c73f-499a-8f87-c61449d47c8b") : secret "dns-default-metrics-tls" not found May 23 22:05:32.970574 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.970537 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:05:32.971002 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.970537 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:05:32.971474 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.970537 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:32.973384 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.973364 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 23 22:05:32.973632 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.973612 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 23 22:05:32.973733 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.973622 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 23 22:05:32.974305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.974268 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h5srv\"" May 23 22:05:32.974305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.974283 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-624w8\"" May 23 22:05:32.974946 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:32.974926 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 23 22:05:33.048045 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:33.048014 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:33.048188 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:33.048147 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 23 22:05:33.048188 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:33.048162 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77787fc544-t6lmp: secret "image-registry-tls" not found May 23 22:05:33.048295 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:33.048228 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls podName:d6396088-510a-48b9-a212-3a91a1facc75 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:35.048207884 +0000 UTC m=+38.653383270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls") pod "image-registry-77787fc544-t6lmp" (UID: "d6396088-510a-48b9-a212-3a91a1facc75") : secret "image-registry-tls" not found May 23 22:05:33.148812 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:33.148774 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:33.149016 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:33.148907 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:33.149016 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:33.148950 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 23 22:05:33.149137 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:33.149025 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls podName:558c2bc9-c73f-499a-8f87-c61449d47c8b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:35.149003429 +0000 UTC m=+38.754178833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls") pod "dns-default-st2tr" (UID: "558c2bc9-c73f-499a-8f87-c61449d47c8b") : secret "dns-default-metrics-tls" not found May 23 22:05:33.149137 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:33.149102 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 23 22:05:33.149248 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:33.149158 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert podName:32c3d90a-f07f-4a74-aed1-627db82ad4c4 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:35.149141759 +0000 UTC m=+38.754317143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert") pod "ingress-canary-m82sl" (UID: "32c3d90a-f07f-4a74-aed1-627db82ad4c4") : secret "canary-serving-cert" not found May 23 22:05:33.727497 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:33.727468 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m"] May 23 22:05:33.729965 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:33.729944 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk"] May 23 22:05:33.731418 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:05:33.731371 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd3f210_a6bb_4a2e_add5_42cbb626d556.slice/crio-e1ec16dba6216228e1e6395ec55cfc642a50cb9d40c377378755716397979238 WatchSource:0}: Error finding container e1ec16dba6216228e1e6395ec55cfc642a50cb9d40c377378755716397979238: Status 404 returned error can't find the container with id e1ec16dba6216228e1e6395ec55cfc642a50cb9d40c377378755716397979238 May 23 22:05:33.733342 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:05:33.733263 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86e4489c_1de2_480d_9bd9_0277bd259d17.slice/crio-86b15abe266eaa2706300b6d5de1bee8071efc28ae096baa02dd989bbde640e5 WatchSource:0}: Error finding container 86b15abe266eaa2706300b6d5de1bee8071efc28ae096baa02dd989bbde640e5: Status 404 returned error can't find the container with id 86b15abe266eaa2706300b6d5de1bee8071efc28ae096baa02dd989bbde640e5 May 23 22:05:33.748774 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:33.748752 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9"] May 23 22:05:33.751984 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:05:33.751954 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb7bb257_2c2b_4416_8ccb_410dbea10db8.slice/crio-ad8b1780035cd1aae25d96570000b8cb22f7cd7c3f5e282a8a3ebbe587805fcd WatchSource:0}: Error finding container ad8b1780035cd1aae25d96570000b8cb22f7cd7c3f5e282a8a3ebbe587805fcd: Status 404 returned error can't find the container with id ad8b1780035cd1aae25d96570000b8cb22f7cd7c3f5e282a8a3ebbe587805fcd May 23 22:05:34.130216 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:34.129975 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" event={"ID":"6cd3f210-a6bb-4a2e-add5-42cbb626d556","Type":"ContainerStarted","Data":"e1ec16dba6216228e1e6395ec55cfc642a50cb9d40c377378755716397979238"} May 23 22:05:34.130914 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:34.130891 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" event={"ID":"86e4489c-1de2-480d-9bd9-0277bd259d17","Type":"ContainerStarted","Data":"86b15abe266eaa2706300b6d5de1bee8071efc28ae096baa02dd989bbde640e5"} May 23 22:05:34.133098 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:34.133076 2556 generic.go:358] "Generic (PLEG): container finished" podID="53b84289-d5e8-41de-b21c-3793bf8bf775" containerID="f2f08304f24dbb4d26ff6e49c89609f2370d261beb2fedf6809d45d9a35e14de" exitCode=0 May 23 22:05:34.133209 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:34.133103 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" event={"ID":"53b84289-d5e8-41de-b21c-3793bf8bf775","Type":"ContainerDied","Data":"f2f08304f24dbb4d26ff6e49c89609f2370d261beb2fedf6809d45d9a35e14de"} May 23 22:05:34.134177 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:34.134157 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" event={"ID":"eb7bb257-2c2b-4416-8ccb-410dbea10db8","Type":"ContainerStarted","Data":"ad8b1780035cd1aae25d96570000b8cb22f7cd7c3f5e282a8a3ebbe587805fcd"} May 23 22:05:35.066508 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:35.066377 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:35.066754 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:35.066551 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 23 22:05:35.066754 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:35.066574 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77787fc544-t6lmp: secret "image-registry-tls" not found May 23 22:05:35.066754 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:35.066645 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls podName:d6396088-510a-48b9-a212-3a91a1facc75 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:39.066623759 +0000 UTC m=+42.671799154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls") pod "image-registry-77787fc544-t6lmp" (UID: "d6396088-510a-48b9-a212-3a91a1facc75") : secret "image-registry-tls" not found May 23 22:05:35.144984 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:35.144941 2556 generic.go:358] "Generic (PLEG): container finished" podID="53b84289-d5e8-41de-b21c-3793bf8bf775" containerID="6ee4c58d5eb1263fe1b68728a4c7ff6ecb553265bd2b76c61baa4dd32e535cc4" exitCode=0 May 23 22:05:35.145425 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:35.145007 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" event={"ID":"53b84289-d5e8-41de-b21c-3793bf8bf775","Type":"ContainerDied","Data":"6ee4c58d5eb1263fe1b68728a4c7ff6ecb553265bd2b76c61baa4dd32e535cc4"} May 23 22:05:35.167157 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:35.167126 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:35.167329 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:35.167314 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:35.167454 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:35.167439 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 23 22:05:35.167515 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:35.167494 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert podName:32c3d90a-f07f-4a74-aed1-627db82ad4c4 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:39.167476808 +0000 UTC m=+42.772652204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert") pod "ingress-canary-m82sl" (UID: "32c3d90a-f07f-4a74-aed1-627db82ad4c4") : secret "canary-serving-cert" not found May 23 22:05:35.167869 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:35.167850 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 23 22:05:35.168002 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:35.167906 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls podName:558c2bc9-c73f-499a-8f87-c61449d47c8b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:39.167888738 +0000 UTC m=+42.773064133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls") pod "dns-default-st2tr" (UID: "558c2bc9-c73f-499a-8f87-c61449d47c8b") : secret "dns-default-metrics-tls" not found May 23 22:05:36.151775 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:36.151737 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" event={"ID":"53b84289-d5e8-41de-b21c-3793bf8bf775","Type":"ContainerStarted","Data":"747e0ab06d6fed3bf7dfa30e1511ab602e1596204aa44a5ab56d6adbe21f6aff"} May 23 22:05:36.180254 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:36.180154 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ndkjb" podStartSLOduration=5.174682905 podStartE2EDuration="39.180135436s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:04:59.604008724 +0000 UTC m=+3.209184118" lastFinishedPulling="2026-05-23 22:05:33.609461254 +0000 UTC m=+37.214636649" observedRunningTime="2026-05-23 22:05:36.17930602 +0000 UTC m=+39.784481415" watchObservedRunningTime="2026-05-23 22:05:36.180135436 +0000 UTC m=+39.785310841" May 23 22:05:39.004515 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:39.004483 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:39.008560 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:39.008527 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca1690e5-e0b4-451e-a0c8-5c626f0c5352-original-pull-secret\") pod \"global-pull-secret-syncer-4xkr7\" (UID: \"ca1690e5-e0b4-451e-a0c8-5c626f0c5352\") " pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:39.105813 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:39.105775 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:39.105972 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:39.105948 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 23 22:05:39.106038 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:39.105974 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77787fc544-t6lmp: secret "image-registry-tls" not found May 23 22:05:39.106077 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:39.106038 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls podName:d6396088-510a-48b9-a212-3a91a1facc75 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:47.106020599 +0000 UTC m=+50.711195980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls") pod "image-registry-77787fc544-t6lmp" (UID: "d6396088-510a-48b9-a212-3a91a1facc75") : secret "image-registry-tls" not found May 23 22:05:39.206829 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:39.206778 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:39.207022 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:39.206931 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:39.207022 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:39.206939 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 23 22:05:39.207022 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:39.207009 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert podName:32c3d90a-f07f-4a74-aed1-627db82ad4c4 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:47.206990026 +0000 UTC m=+50.812165428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert") pod "ingress-canary-m82sl" (UID: "32c3d90a-f07f-4a74-aed1-627db82ad4c4") : secret "canary-serving-cert" not found May 23 22:05:39.207186 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:39.207072 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 23 22:05:39.207186 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:39.207120 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls podName:558c2bc9-c73f-499a-8f87-c61449d47c8b nodeName:}" failed. No retries permitted until 2026-05-23 22:05:47.207104207 +0000 UTC m=+50.812279593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls") pod "dns-default-st2tr" (UID: "558c2bc9-c73f-499a-8f87-c61449d47c8b") : secret "dns-default-metrics-tls" not found May 23 22:05:39.297024 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:39.296987 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xkr7" May 23 22:05:40.592832 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:40.592797 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4xkr7"] May 23 22:05:40.596349 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:05:40.596320 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca1690e5_e0b4_451e_a0c8_5c626f0c5352.slice/crio-059611b9ab2087372c24c73f1e7445a2cd60dcb881d25ae3e4bd267bddf2ba19 WatchSource:0}: Error finding container 059611b9ab2087372c24c73f1e7445a2cd60dcb881d25ae3e4bd267bddf2ba19: Status 404 returned error can't find the container with id 059611b9ab2087372c24c73f1e7445a2cd60dcb881d25ae3e4bd267bddf2ba19 May 23 22:05:41.162701 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:41.162650 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4xkr7" event={"ID":"ca1690e5-e0b4-451e-a0c8-5c626f0c5352","Type":"ContainerStarted","Data":"059611b9ab2087372c24c73f1e7445a2cd60dcb881d25ae3e4bd267bddf2ba19"} May 23 22:05:41.163848 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:41.163823 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" event={"ID":"86e4489c-1de2-480d-9bd9-0277bd259d17","Type":"ContainerStarted","Data":"239b4fe532d35ba976c853a92d73b2855e2d3bd7695843b510d0f17657841093"} May 23 22:05:41.165018 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:41.164991 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" event={"ID":"eb7bb257-2c2b-4416-8ccb-410dbea10db8","Type":"ContainerStarted","Data":"8c39b57e1aa1aab6b50cd694fd26826dcf96e78287cc171cdfdd4bc820c5cd18"} May 23 22:05:41.166100 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:41.166081 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" event={"ID":"6cd3f210-a6bb-4a2e-add5-42cbb626d556","Type":"ContainerStarted","Data":"d66c1a65aaa5c38059604aaf69b0d02d9d27d7f70c2948874d46d86afb2187ce"} May 23 22:05:41.166304 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:41.166283 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:41.167839 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:41.167823 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:05:41.177423 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:41.177383 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" podStartSLOduration=36.458118498 podStartE2EDuration="43.177372237s" podCreationTimestamp="2026-05-23 22:04:58 +0000 UTC" firstStartedPulling="2026-05-23 22:05:33.735897404 +0000 UTC m=+37.341072790" lastFinishedPulling="2026-05-23 22:05:40.455151143 +0000 UTC m=+44.060326529" observedRunningTime="2026-05-23 22:05:41.176828434 +0000 UTC m=+44.782003829" watchObservedRunningTime="2026-05-23 22:05:41.177372237 +0000 UTC m=+44.782547667" May 23 22:05:41.194239 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:41.194201 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" podStartSLOduration=36.447583249 podStartE2EDuration="43.194188233s" podCreationTimestamp="2026-05-23 22:04:58 +0000 UTC" firstStartedPulling="2026-05-23 22:05:33.733603502 +0000 UTC m=+37.338778883" lastFinishedPulling="2026-05-23 22:05:40.480208484 +0000 UTC m=+44.085383867" observedRunningTime="2026-05-23 22:05:41.193645282 +0000 UTC m=+44.798820687" watchObservedRunningTime="2026-05-23 22:05:41.194188233 +0000 UTC m=+44.799363638" May 23 22:05:43.173054 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:43.172972 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" event={"ID":"eb7bb257-2c2b-4416-8ccb-410dbea10db8","Type":"ContainerStarted","Data":"ffc26ad0648b814e34659b48520960a3cd61b809f79163c3a896a04909390b2c"} May 23 22:05:43.173054 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:43.173015 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" event={"ID":"eb7bb257-2c2b-4416-8ccb-410dbea10db8","Type":"ContainerStarted","Data":"08ecf8f20a5dc0f85a95f1093738bab23936f87f0eb58c3052fd0b4008707c3a"} May 23 22:05:43.190851 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:43.190804 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" podStartSLOduration=36.179493534 podStartE2EDuration="45.190789996s" podCreationTimestamp="2026-05-23 22:04:58 +0000 UTC" firstStartedPulling="2026-05-23 22:05:33.75356716 +0000 UTC m=+37.358742543" lastFinishedPulling="2026-05-23 22:05:42.764863619 +0000 UTC m=+46.370039005" observedRunningTime="2026-05-23 22:05:43.190250227 +0000 UTC m=+46.795425658" watchObservedRunningTime="2026-05-23 22:05:43.190789996 +0000 UTC m=+46.795965400" May 23 22:05:45.178675 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:45.178558 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4xkr7" event={"ID":"ca1690e5-e0b4-451e-a0c8-5c626f0c5352","Type":"ContainerStarted","Data":"8c53a63108cc2c085863b5cff8d04dc4ce12ddcbbf75f6b2a22a42ddb29ab338"} May 23 22:05:45.194276 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:45.194224 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4xkr7" podStartSLOduration=33.879439617 podStartE2EDuration="38.194209494s" podCreationTimestamp="2026-05-23 22:05:07 +0000 UTC" firstStartedPulling="2026-05-23 22:05:40.598179808 +0000 UTC m=+44.203355191" lastFinishedPulling="2026-05-23 22:05:44.912949681 +0000 UTC m=+48.518125068" observedRunningTime="2026-05-23 22:05:45.193235942 +0000 UTC m=+48.798411342" watchObservedRunningTime="2026-05-23 22:05:45.194209494 +0000 UTC m=+48.799384899" May 23 22:05:47.167812 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:47.167773 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:05:47.168229 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:47.167914 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 23 22:05:47.168229 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:47.167931 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77787fc544-t6lmp: secret "image-registry-tls" not found May 23 22:05:47.168229 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:47.167984 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls podName:d6396088-510a-48b9-a212-3a91a1facc75 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:03.167968654 +0000 UTC m=+66.773144035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls") pod "image-registry-77787fc544-t6lmp" (UID: "d6396088-510a-48b9-a212-3a91a1facc75") : secret "image-registry-tls" not found May 23 22:05:47.269065 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:47.269028 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:05:47.269296 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:47.269134 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:05:47.269296 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:47.269171 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 23 22:05:47.269296 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:47.269228 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls podName:558c2bc9-c73f-499a-8f87-c61449d47c8b nodeName:}" failed. No retries permitted until 2026-05-23 22:06:03.269214312 +0000 UTC m=+66.874389693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls") pod "dns-default-st2tr" (UID: "558c2bc9-c73f-499a-8f87-c61449d47c8b") : secret "dns-default-metrics-tls" not found May 23 22:05:47.269296 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:47.269240 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 23 22:05:47.269296 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:05:47.269291 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert podName:32c3d90a-f07f-4a74-aed1-627db82ad4c4 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:03.269274765 +0000 UTC m=+66.874450161 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert") pod "ingress-canary-m82sl" (UID: "32c3d90a-f07f-4a74-aed1-627db82ad4c4") : secret "canary-serving-cert" not found May 23 22:05:55.128407 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:05:55.128378 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-chpxl" May 23 22:06:02.682070 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:02.682026 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:06:02.684654 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:02.684626 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 23 22:06:02.692788 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:02.692761 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 23 22:06:02.692852 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:02.692837 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs podName:bb43ba8a-7020-4f4a-8c3e-ed619161fc6b nodeName:}" failed. No retries permitted until 2026-05-23 22:07:06.692818435 +0000 UTC m=+130.297993823 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs") pod "network-metrics-daemon-h5tlh" (UID: "bb43ba8a-7020-4f4a-8c3e-ed619161fc6b") : secret "metrics-daemon-secret" not found May 23 22:06:02.883233 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:02.883194 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:06:02.885772 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:02.885752 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 23 22:06:02.895542 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:02.895526 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 23 22:06:02.906358 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:02.906331 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb8jj\" (UniqueName: \"kubernetes.io/projected/2cf68606-cd54-4b99-8b79-7401b14a4f26-kube-api-access-rb8jj\") pod \"network-check-target-72r52\" (UID: \"2cf68606-cd54-4b99-8b79-7401b14a4f26\") " pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:06:02.993175 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:02.993149 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-624w8\"" May 23 22:06:03.001159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:03.001142 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:06:03.117967 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:03.117937 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-72r52"] May 23 22:06:03.120729 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:06:03.120703 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf68606_cd54_4b99_8b79_7401b14a4f26.slice/crio-d17999235de1006a6ec0a0610713948cd1047f9b9fcc5862f6b6acb6cbc587cd WatchSource:0}: Error finding container d17999235de1006a6ec0a0610713948cd1047f9b9fcc5862f6b6acb6cbc587cd: Status 404 returned error can't find the container with id d17999235de1006a6ec0a0610713948cd1047f9b9fcc5862f6b6acb6cbc587cd May 23 22:06:03.184940 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:03.184913 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:06:03.185060 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:03.185046 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 23 22:06:03.185101 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:03.185063 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77787fc544-t6lmp: secret "image-registry-tls" not found May 23 22:06:03.185136 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:03.185112 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls podName:d6396088-510a-48b9-a212-3a91a1facc75 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:35.185098328 +0000 UTC m=+98.790273710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls") pod "image-registry-77787fc544-t6lmp" (UID: "d6396088-510a-48b9-a212-3a91a1facc75") : secret "image-registry-tls" not found May 23 22:06:03.222145 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:03.222120 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-72r52" event={"ID":"2cf68606-cd54-4b99-8b79-7401b14a4f26","Type":"ContainerStarted","Data":"d17999235de1006a6ec0a0610713948cd1047f9b9fcc5862f6b6acb6cbc587cd"} May 23 22:06:03.285930 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:03.285865 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:06:03.285930 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:03.285911 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:06:03.286065 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:03.285997 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 23 22:06:03.286065 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:03.286051 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls podName:558c2bc9-c73f-499a-8f87-c61449d47c8b nodeName:}" failed. No retries permitted until 2026-05-23 22:06:35.286033935 +0000 UTC m=+98.891209318 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls") pod "dns-default-st2tr" (UID: "558c2bc9-c73f-499a-8f87-c61449d47c8b") : secret "dns-default-metrics-tls" not found May 23 22:06:03.286065 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:03.285998 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 23 22:06:03.286171 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:03.286083 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert podName:32c3d90a-f07f-4a74-aed1-627db82ad4c4 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:35.286076592 +0000 UTC m=+98.891251974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert") pod "ingress-canary-m82sl" (UID: "32c3d90a-f07f-4a74-aed1-627db82ad4c4") : secret "canary-serving-cert" not found May 23 22:06:07.233724 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:07.233684 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-72r52" event={"ID":"2cf68606-cd54-4b99-8b79-7401b14a4f26","Type":"ContainerStarted","Data":"7697346e62ea16faa70db8c9af1e97130ad82c7b358c7d44cf7c0108ebf06330"} May 23 22:06:07.234137 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:07.233780 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:06:07.249879 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:07.249836 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-72r52" podStartSLOduration=67.189063143 podStartE2EDuration="1m10.249824205s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:06:03.123109844 +0000 UTC m=+66.728285228" lastFinishedPulling="2026-05-23 22:06:06.183870908 +0000 UTC m=+69.789046290" observedRunningTime="2026-05-23 22:06:07.249489186 +0000 UTC m=+70.854664591" watchObservedRunningTime="2026-05-23 22:06:07.249824205 +0000 UTC m=+70.854999664" May 23 22:06:35.222348 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:35.222313 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:06:35.222793 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:35.222466 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 23 22:06:35.222793 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:35.222485 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77787fc544-t6lmp: secret "image-registry-tls" not found May 23 22:06:35.222793 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:35.222552 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls podName:d6396088-510a-48b9-a212-3a91a1facc75 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:39.222535986 +0000 UTC m=+162.827711367 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls") pod "image-registry-77787fc544-t6lmp" (UID: "d6396088-510a-48b9-a212-3a91a1facc75") : secret "image-registry-tls" not found May 23 22:06:35.323641 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:35.323601 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:06:35.323855 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:35.323656 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:06:35.323855 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:35.323765 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 23 22:06:35.323855 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:35.323772 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 23 22:06:35.323855 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:35.323822 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls podName:558c2bc9-c73f-499a-8f87-c61449d47c8b nodeName:}" failed. No retries permitted until 2026-05-23 22:07:39.323808829 +0000 UTC m=+162.928984211 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls") pod "dns-default-st2tr" (UID: "558c2bc9-c73f-499a-8f87-c61449d47c8b") : secret "dns-default-metrics-tls" not found May 23 22:06:35.323855 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:06:35.323836 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert podName:32c3d90a-f07f-4a74-aed1-627db82ad4c4 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:39.323830543 +0000 UTC m=+162.929005925 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert") pod "ingress-canary-m82sl" (UID: "32c3d90a-f07f-4a74-aed1-627db82ad4c4") : secret "canary-serving-cert" not found May 23 22:06:38.237821 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:06:38.237792 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-72r52" May 23 22:07:06.752294 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:06.752257 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:07:06.752895 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:07:06.752423 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 23 22:07:06.752895 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:07:06.752493 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs podName:bb43ba8a-7020-4f4a-8c3e-ed619161fc6b nodeName:}" failed. No retries permitted until 2026-05-23 22:09:08.752474614 +0000 UTC m=+252.357649999 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs") pod "network-metrics-daemon-h5tlh" (UID: "bb43ba8a-7020-4f4a-8c3e-ed619161fc6b") : secret "metrics-daemon-secret" not found May 23 22:07:32.393338 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:32.393308 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5jmxg_c52a45fc-b5ef-4a29-886d-24a731b34cd3/dns-node-resolver/0.log" May 23 22:07:33.593145 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:33.593117 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gm8x9_8995c7c9-bd2c-4658-bb7e-e79c5e42ba48/node-ca/0.log" May 23 22:07:34.321231 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:07:34.321171 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" podUID="d6396088-510a-48b9-a212-3a91a1facc75" May 23 22:07:34.407379 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:07:34.407342 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-st2tr" podUID="558c2bc9-c73f-499a-8f87-c61449d47c8b" May 23 22:07:34.428634 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:07:34.428596 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-m82sl" podUID="32c3d90a-f07f-4a74-aed1-627db82ad4c4" May 23 22:07:34.434367 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:34.434343 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:07:34.434531 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:34.434345 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:07:35.983027 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:07:35.982965 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h5tlh" podUID="bb43ba8a-7020-4f4a-8c3e-ed619161fc6b" May 23 22:07:39.295178 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.295084 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:07:39.297393 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.297372 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"image-registry-77787fc544-t6lmp\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:07:39.395464 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.395426 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:07:39.395464 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.395470 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:07:39.397950 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.397924 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/558c2bc9-c73f-499a-8f87-c61449d47c8b-metrics-tls\") pod \"dns-default-st2tr\" (UID: \"558c2bc9-c73f-499a-8f87-c61449d47c8b\") " pod="openshift-dns/dns-default-st2tr" May 23 22:07:39.398010 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.397978 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c3d90a-f07f-4a74-aed1-627db82ad4c4-cert\") pod \"ingress-canary-m82sl\" (UID: \"32c3d90a-f07f-4a74-aed1-627db82ad4c4\") " pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:07:39.538058 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.538029 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mnn9s\"" May 23 22:07:39.538058 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.538029 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9j6m4\"" May 23 22:07:39.545253 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.545209 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m82sl" May 23 22:07:39.545253 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.545231 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:07:39.676228 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.676079 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77787fc544-t6lmp"] May 23 22:07:39.678700 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:07:39.678643 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6396088_510a_48b9_a212_3a91a1facc75.slice/crio-7d20acd33a3eecbe928c00e7542ec5ad95d6900b97808a3f0f494bc9859a4c6e WatchSource:0}: Error finding container 7d20acd33a3eecbe928c00e7542ec5ad95d6900b97808a3f0f494bc9859a4c6e: Status 404 returned error can't find the container with id 7d20acd33a3eecbe928c00e7542ec5ad95d6900b97808a3f0f494bc9859a4c6e May 23 22:07:39.686877 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:39.686847 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m82sl"] May 23 22:07:39.691784 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:07:39.691758 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c3d90a_f07f_4a74_aed1_627db82ad4c4.slice/crio-57cea2091585720d4c691d7422323f525b9c2996050faf6f21d3b510f301a694 WatchSource:0}: Error finding container 57cea2091585720d4c691d7422323f525b9c2996050faf6f21d3b510f301a694: Status 404 returned error can't find the container with id 57cea2091585720d4c691d7422323f525b9c2996050faf6f21d3b510f301a694 May 23 22:07:40.449419 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:40.449377 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m82sl" event={"ID":"32c3d90a-f07f-4a74-aed1-627db82ad4c4","Type":"ContainerStarted","Data":"57cea2091585720d4c691d7422323f525b9c2996050faf6f21d3b510f301a694"} May 23 22:07:40.450827 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:40.450795 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" event={"ID":"d6396088-510a-48b9-a212-3a91a1facc75","Type":"ContainerStarted","Data":"39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d"} May 23 22:07:40.450827 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:40.450827 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" event={"ID":"d6396088-510a-48b9-a212-3a91a1facc75","Type":"ContainerStarted","Data":"7d20acd33a3eecbe928c00e7542ec5ad95d6900b97808a3f0f494bc9859a4c6e"} May 23 22:07:40.451017 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:40.450926 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:07:40.470487 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:40.470433 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" podStartSLOduration=163.470418842 podStartE2EDuration="2m43.470418842s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:07:40.469009106 +0000 UTC m=+164.074184511" watchObservedRunningTime="2026-05-23 22:07:40.470418842 +0000 UTC m=+164.075594246" May 23 22:07:41.167523 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:41.167465 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" podUID="6cd3f210-a6bb-4a2e-add5-42cbb626d556" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused" May 23 22:07:41.454302 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:41.454273 2556 generic.go:358] "Generic (PLEG): container finished" podID="86e4489c-1de2-480d-9bd9-0277bd259d17" containerID="239b4fe532d35ba976c853a92d73b2855e2d3bd7695843b510d0f17657841093" exitCode=255 May 23 22:07:41.454750 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:41.454343 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" event={"ID":"86e4489c-1de2-480d-9bd9-0277bd259d17","Type":"ContainerDied","Data":"239b4fe532d35ba976c853a92d73b2855e2d3bd7695843b510d0f17657841093"} May 23 22:07:41.454750 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:41.454686 2556 scope.go:117] "RemoveContainer" containerID="239b4fe532d35ba976c853a92d73b2855e2d3bd7695843b510d0f17657841093" May 23 22:07:41.455756 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:41.455738 2556 generic.go:358] "Generic (PLEG): container finished" podID="6cd3f210-a6bb-4a2e-add5-42cbb626d556" containerID="d66c1a65aaa5c38059604aaf69b0d02d9d27d7f70c2948874d46d86afb2187ce" exitCode=1 May 23 22:07:41.455840 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:41.455761 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" event={"ID":"6cd3f210-a6bb-4a2e-add5-42cbb626d556","Type":"ContainerDied","Data":"d66c1a65aaa5c38059604aaf69b0d02d9d27d7f70c2948874d46d86afb2187ce"} May 23 22:07:41.456181 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:41.456168 2556 scope.go:117] "RemoveContainer" containerID="d66c1a65aaa5c38059604aaf69b0d02d9d27d7f70c2948874d46d86afb2187ce" May 23 22:07:41.641470 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:41.641434 2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:07:41.680555 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:41.680514 2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" May 23 22:07:42.459431 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:42.459396 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" event={"ID":"6cd3f210-a6bb-4a2e-add5-42cbb626d556","Type":"ContainerStarted","Data":"bef26808d3c38a845ad878437e576c96989fc40efd3a2b17f4b44eb9477c33af"} May 23 22:07:42.459916 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:42.459568 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:07:42.460782 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:42.460750 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f48dd96f-8qp7m" May 23 22:07:42.464561 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:42.461000 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m82sl" event={"ID":"32c3d90a-f07f-4a74-aed1-627db82ad4c4","Type":"ContainerStarted","Data":"f93542bf0c604c1ec9a3e7449d7cc7f4d5ad8a22a711a873fddc1f3b133cfd6c"} May 23 22:07:42.466163 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:42.466139 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c7db646cb-5cgjk" event={"ID":"86e4489c-1de2-480d-9bd9-0277bd259d17","Type":"ContainerStarted","Data":"0900586fe22989faecac729178602edc3a205ff50937838c925567e420434698"} May 23 22:07:42.515010 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:42.514958 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m82sl" podStartSLOduration=129.700717068 podStartE2EDuration="2m11.514944464s" podCreationTimestamp="2026-05-23 22:05:31 +0000 UTC" firstStartedPulling="2026-05-23 22:07:39.693570227 +0000 UTC m=+163.298745624" lastFinishedPulling="2026-05-23 22:07:41.507797635 +0000 UTC m=+165.112973020" observedRunningTime="2026-05-23 22:07:42.514447567 +0000 UTC m=+166.119622971" watchObservedRunningTime="2026-05-23 22:07:42.514944464 +0000 UTC m=+166.120119882" May 23 22:07:45.970490 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:45.970454 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-st2tr" May 23 22:07:45.973258 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:45.973238 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5kjmz\"" May 23 22:07:45.981074 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:45.981057 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-st2tr" May 23 22:07:46.102101 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:46.102073 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-st2tr"] May 23 22:07:46.105166 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:07:46.105131 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558c2bc9_c73f_499a_8f87_c61449d47c8b.slice/crio-c665c32aba51d60d634515ed02144bbce76707737d8dfa52ac6789ecbe4589f7 WatchSource:0}: Error finding container c665c32aba51d60d634515ed02144bbce76707737d8dfa52ac6789ecbe4589f7: Status 404 returned error can't find the container with id c665c32aba51d60d634515ed02144bbce76707737d8dfa52ac6789ecbe4589f7 May 23 22:07:46.475480 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:46.475447 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-st2tr" event={"ID":"558c2bc9-c73f-499a-8f87-c61449d47c8b","Type":"ContainerStarted","Data":"c665c32aba51d60d634515ed02144bbce76707737d8dfa52ac6789ecbe4589f7"} May 23 22:07:48.481690 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:48.481636 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-st2tr" event={"ID":"558c2bc9-c73f-499a-8f87-c61449d47c8b","Type":"ContainerStarted","Data":"905c6a19ea131d7e8ea013c577eef1f5e77ff1c98b707a85049da1e2a9dd7339"} May 23 22:07:48.481690 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:48.481691 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-st2tr" event={"ID":"558c2bc9-c73f-499a-8f87-c61449d47c8b","Type":"ContainerStarted","Data":"a99dca7483ec3d1b58f6d0018f1739954ab88f51651fd83412bb0d88f6cf9a84"} May 23 22:07:48.482170 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:48.481789 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-st2tr" May 23 22:07:48.498568 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:48.498524 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-st2tr" podStartSLOduration=136.101336659 podStartE2EDuration="2m17.498512903s" podCreationTimestamp="2026-05-23 22:05:31 +0000 UTC" firstStartedPulling="2026-05-23 22:07:46.107157674 +0000 UTC m=+169.712333059" lastFinishedPulling="2026-05-23 22:07:47.504333908 +0000 UTC m=+171.109509303" observedRunningTime="2026-05-23 22:07:48.498402236 +0000 UTC m=+172.103577641" watchObservedRunningTime="2026-05-23 22:07:48.498512903 +0000 UTC m=+172.103688356" May 23 22:07:50.970424 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:50.970384 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:07:53.696397 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.696367 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-crblc"] May 23 22:07:53.699516 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.699497 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.704641 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.704621 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 23 22:07:53.704911 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.704894 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 23 22:07:53.705810 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.705788 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 23 22:07:53.705895 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.705824 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 23 22:07:53.705954 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.705828 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8g8ml\"" May 23 22:07:53.710420 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.710402 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-crblc"] May 23 22:07:53.802892 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.802862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13d12510-5d51-48a4-b295-44d6c18f2543-crio-socket\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.803034 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.802911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v56fq\" (UniqueName: \"kubernetes.io/projected/13d12510-5d51-48a4-b295-44d6c18f2543-kube-api-access-v56fq\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.803034 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.802973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d12510-5d51-48a4-b295-44d6c18f2543-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.803034 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.803014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d12510-5d51-48a4-b295-44d6c18f2543-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.803130 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.803066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d12510-5d51-48a4-b295-44d6c18f2543-data-volume\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.903853 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.903816 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v56fq\" (UniqueName: \"kubernetes.io/projected/13d12510-5d51-48a4-b295-44d6c18f2543-kube-api-access-v56fq\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.904042 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.903861 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d12510-5d51-48a4-b295-44d6c18f2543-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.904042 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.903893 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d12510-5d51-48a4-b295-44d6c18f2543-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.904042 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.903938 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d12510-5d51-48a4-b295-44d6c18f2543-data-volume\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.904042 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.903970 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13d12510-5d51-48a4-b295-44d6c18f2543-crio-socket\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.904201 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.904072 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13d12510-5d51-48a4-b295-44d6c18f2543-crio-socket\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.904350 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.904330 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d12510-5d51-48a4-b295-44d6c18f2543-data-volume\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.904514 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.904497 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d12510-5d51-48a4-b295-44d6c18f2543-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.906238 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.906223 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d12510-5d51-48a4-b295-44d6c18f2543-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:53.912256 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:53.912236 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v56fq\" (UniqueName: \"kubernetes.io/projected/13d12510-5d51-48a4-b295-44d6c18f2543-kube-api-access-v56fq\") pod \"insights-runtime-extractor-crblc\" (UID: \"13d12510-5d51-48a4-b295-44d6c18f2543\") " pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:54.007818 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:54.007735 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-crblc" May 23 22:07:54.126263 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:54.126233 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-crblc"] May 23 22:07:54.129499 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:07:54.129469 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d12510_5d51_48a4_b295_44d6c18f2543.slice/crio-cd5200f641359ec426cd4c0fa41cecfea3ad7f45b5f6a5fccd5f8de30252eea0 WatchSource:0}: Error finding container cd5200f641359ec426cd4c0fa41cecfea3ad7f45b5f6a5fccd5f8de30252eea0: Status 404 returned error can't find the container with id cd5200f641359ec426cd4c0fa41cecfea3ad7f45b5f6a5fccd5f8de30252eea0 May 23 22:07:54.497491 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:54.497458 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-crblc" event={"ID":"13d12510-5d51-48a4-b295-44d6c18f2543","Type":"ContainerStarted","Data":"a8e0497baa8ec99dda9fec22e142c525717d83e0fce0b0c67fc328a6953c373e"} May 23 22:07:54.497491 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:54.497491 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-crblc" event={"ID":"13d12510-5d51-48a4-b295-44d6c18f2543","Type":"ContainerStarted","Data":"cd5200f641359ec426cd4c0fa41cecfea3ad7f45b5f6a5fccd5f8de30252eea0"} May 23 22:07:55.502337 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:55.502301 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-crblc" event={"ID":"13d12510-5d51-48a4-b295-44d6c18f2543","Type":"ContainerStarted","Data":"46fd67e70aa507a91b40cd20cf1a24cdf16d0abc0f4efeca159edd358adbeacc"} May 23 22:07:57.509497 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:57.509455 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-crblc" event={"ID":"13d12510-5d51-48a4-b295-44d6c18f2543","Type":"ContainerStarted","Data":"c561f723b18c0deb5d2fc04ca6aa737a859e13dad7fb7c92132dbf65c52cd2d0"} May 23 22:07:57.529463 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:57.529422 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-crblc" podStartSLOduration=2.19490429 podStartE2EDuration="4.529408326s" podCreationTimestamp="2026-05-23 22:07:53 +0000 UTC" firstStartedPulling="2026-05-23 22:07:54.181954449 +0000 UTC m=+177.787129835" lastFinishedPulling="2026-05-23 22:07:56.516458475 +0000 UTC m=+180.121633871" observedRunningTime="2026-05-23 22:07:57.528129673 +0000 UTC m=+181.133305080" watchObservedRunningTime="2026-05-23 22:07:57.529408326 +0000 UTC m=+181.134583729" May 23 22:07:58.486755 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:58.486724 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-st2tr" May 23 22:07:59.549979 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:59.549946 2556 patch_prober.go:28] interesting pod/image-registry-77787fc544-t6lmp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 23 22:07:59.550399 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:07:59.550003 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" podUID="d6396088-510a-48b9-a212-3a91a1facc75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 23 22:08:01.459603 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:01.459576 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:08:01.689638 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:01.689599 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" podUID="eb7bb257-2c2b-4416-8ccb-410dbea10db8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 23 22:08:11.689429 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:11.689383 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" podUID="eb7bb257-2c2b-4416-8ccb-410dbea10db8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 23 22:08:14.900974 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.900939 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-95nww"] May 23 22:08:14.904165 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.904149 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:14.906967 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.906939 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 23 22:08:14.907109 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.907029 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 23 22:08:14.907824 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.907801 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 23 22:08:14.907824 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.907821 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 23 22:08:14.907974 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.907838 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vbmh6\"" May 23 22:08:14.908015 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.907997 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 23 22:08:14.908084 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.908069 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 23 22:08:14.962119 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.962085 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-wtmp\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:14.962119 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.962119 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6396329-d36a-4e99-ab55-750f053a1ca9-root\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:14.962305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.962137 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-textfile\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:14.962305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.962177 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-tls\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:14.962305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.962214 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:14.962305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.962237 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6396329-d36a-4e99-ab55-750f053a1ca9-sys\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:14.962305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.962253 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6396329-d36a-4e99-ab55-750f053a1ca9-metrics-client-ca\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:14.962305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.962291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-accelerators-collector-config\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:14.962484 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:14.962324 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq2lk\" (UniqueName: \"kubernetes.io/projected/a6396329-d36a-4e99-ab55-750f053a1ca9-kube-api-access-jq2lk\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063160 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063120 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq2lk\" (UniqueName: \"kubernetes.io/projected/a6396329-d36a-4e99-ab55-750f053a1ca9-kube-api-access-jq2lk\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063160 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063162 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-wtmp\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063372 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063186 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6396329-d36a-4e99-ab55-750f053a1ca9-root\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063372 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063203 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-textfile\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063372 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063227 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-tls\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063372 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063266 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6396329-d36a-4e99-ab55-750f053a1ca9-root\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063372 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063274 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063372 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063323 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-wtmp\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063576 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063379 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6396329-d36a-4e99-ab55-750f053a1ca9-sys\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063576 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063402 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6396329-d36a-4e99-ab55-750f053a1ca9-metrics-client-ca\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063576 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063466 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-accelerators-collector-config\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063576 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063470 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6396329-d36a-4e99-ab55-750f053a1ca9-sys\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063789 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063608 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-textfile\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.063951 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.063933 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6396329-d36a-4e99-ab55-750f053a1ca9-metrics-client-ca\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.064042 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.064002 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-accelerators-collector-config\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.065689 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.065649 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.065780 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.065708 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6396329-d36a-4e99-ab55-750f053a1ca9-node-exporter-tls\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.071164 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.071138 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq2lk\" (UniqueName: \"kubernetes.io/projected/a6396329-d36a-4e99-ab55-750f053a1ca9-kube-api-access-jq2lk\") pod \"node-exporter-95nww\" (UID: \"a6396329-d36a-4e99-ab55-750f053a1ca9\") " pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.213549 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.213515 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95nww" May 23 22:08:15.221373 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:08:15.221343 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6396329_d36a_4e99_ab55_750f053a1ca9.slice/crio-e538a83346a47bb55f6a80aa3f3731f71a5c0cb5411d75a8117acf52f2fe01c7 WatchSource:0}: Error finding container e538a83346a47bb55f6a80aa3f3731f71a5c0cb5411d75a8117acf52f2fe01c7: Status 404 returned error can't find the container with id e538a83346a47bb55f6a80aa3f3731f71a5c0cb5411d75a8117acf52f2fe01c7 May 23 22:08:15.555583 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:15.555498 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nww" event={"ID":"a6396329-d36a-4e99-ab55-750f053a1ca9","Type":"ContainerStarted","Data":"e538a83346a47bb55f6a80aa3f3731f71a5c0cb5411d75a8117acf52f2fe01c7"} May 23 22:08:16.049162 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:16.049129 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77787fc544-t6lmp"] May 23 22:08:16.559453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:16.559419 2556 generic.go:358] "Generic (PLEG): container finished" podID="a6396329-d36a-4e99-ab55-750f053a1ca9" containerID="ff2149c000d1109570a1e0c7373c701394735be589c7432be0844225a3d899d7" exitCode=0 May 23 22:08:16.559453 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:16.559457 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nww" event={"ID":"a6396329-d36a-4e99-ab55-750f053a1ca9","Type":"ContainerDied","Data":"ff2149c000d1109570a1e0c7373c701394735be589c7432be0844225a3d899d7"} May 23 22:08:17.564125 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:17.564089 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nww" event={"ID":"a6396329-d36a-4e99-ab55-750f053a1ca9","Type":"ContainerStarted","Data":"a710998c22a3926ff3f84439fac43b51f64e5b8e39eb96aa53389bc565974470"} May 23 22:08:17.564125 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:17.564126 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nww" event={"ID":"a6396329-d36a-4e99-ab55-750f053a1ca9","Type":"ContainerStarted","Data":"bae7d2ffcb12e6a56af94a06dbc67e5baf8c6e80307422de27cb191e14445160"} May 23 22:08:17.583406 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:17.583353 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-95nww" podStartSLOduration=2.650649437 podStartE2EDuration="3.583337092s" podCreationTimestamp="2026-05-23 22:08:14 +0000 UTC" firstStartedPulling="2026-05-23 22:08:15.223118524 +0000 UTC m=+198.828293909" lastFinishedPulling="2026-05-23 22:08:16.155806182 +0000 UTC m=+199.760981564" observedRunningTime="2026-05-23 22:08:17.581809726 +0000 UTC m=+201.186985135" watchObservedRunningTime="2026-05-23 22:08:17.583337092 +0000 UTC m=+201.188512496" May 23 22:08:21.689481 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:21.689442 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" podUID="eb7bb257-2c2b-4416-8ccb-410dbea10db8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 23 22:08:21.689881 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:21.689519 2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" May 23 22:08:21.690031 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:21.690002 2556 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ffc26ad0648b814e34659b48520960a3cd61b809f79163c3a896a04909390b2c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 23 22:08:21.690066 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:21.690051 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" podUID="eb7bb257-2c2b-4416-8ccb-410dbea10db8" containerName="service-proxy" containerID="cri-o://ffc26ad0648b814e34659b48520960a3cd61b809f79163c3a896a04909390b2c" gracePeriod=30 May 23 22:08:22.578634 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:22.578602 2556 generic.go:358] "Generic (PLEG): container finished" podID="eb7bb257-2c2b-4416-8ccb-410dbea10db8" containerID="ffc26ad0648b814e34659b48520960a3cd61b809f79163c3a896a04909390b2c" exitCode=2 May 23 22:08:22.578898 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:22.578684 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" event={"ID":"eb7bb257-2c2b-4416-8ccb-410dbea10db8","Type":"ContainerDied","Data":"ffc26ad0648b814e34659b48520960a3cd61b809f79163c3a896a04909390b2c"} May 23 22:08:22.578898 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:22.578726 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66668d9cfd-qbdc9" event={"ID":"eb7bb257-2c2b-4416-8ccb-410dbea10db8","Type":"ContainerStarted","Data":"53c30e7e64703d278f0dba5a81fe32f94ab89d0b08d9912e73db0ef7e155223f"} May 23 22:08:41.071573 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.071515 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" podUID="d6396088-510a-48b9-a212-3a91a1facc75" containerName="registry" containerID="cri-o://39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d" gracePeriod=30 May 23 22:08:41.317316 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.317292 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:08:41.365031 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.364945 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-bound-sa-token\") pod \"d6396088-510a-48b9-a212-3a91a1facc75\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " May 23 22:08:41.365031 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.364984 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6396088-510a-48b9-a212-3a91a1facc75-ca-trust-extracted\") pod \"d6396088-510a-48b9-a212-3a91a1facc75\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " May 23 22:08:41.365450 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.365065 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7sh6\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-kube-api-access-t7sh6\") pod \"d6396088-510a-48b9-a212-3a91a1facc75\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " May 23 22:08:41.365450 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.365086 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") pod \"d6396088-510a-48b9-a212-3a91a1facc75\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " May 23 22:08:41.365450 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.365116 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-image-registry-private-configuration\") pod \"d6396088-510a-48b9-a212-3a91a1facc75\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " May 23 22:08:41.365450 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.365145 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-trusted-ca\") pod \"d6396088-510a-48b9-a212-3a91a1facc75\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " May 23 22:08:41.365450 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.365174 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-installation-pull-secrets\") pod \"d6396088-510a-48b9-a212-3a91a1facc75\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " May 23 22:08:41.365450 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.365200 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-registry-certificates\") pod \"d6396088-510a-48b9-a212-3a91a1facc75\" (UID: \"d6396088-510a-48b9-a212-3a91a1facc75\") " May 23 22:08:41.365830 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.365706 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d6396088-510a-48b9-a212-3a91a1facc75" (UID: "d6396088-510a-48b9-a212-3a91a1facc75"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 23 22:08:41.366044 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.366013 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d6396088-510a-48b9-a212-3a91a1facc75" (UID: "d6396088-510a-48b9-a212-3a91a1facc75"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 23 22:08:41.367614 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.367584 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d6396088-510a-48b9-a212-3a91a1facc75" (UID: "d6396088-510a-48b9-a212-3a91a1facc75"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 23 22:08:41.367742 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.367619 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d6396088-510a-48b9-a212-3a91a1facc75" (UID: "d6396088-510a-48b9-a212-3a91a1facc75"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 23 22:08:41.367894 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.367857 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d6396088-510a-48b9-a212-3a91a1facc75" (UID: "d6396088-510a-48b9-a212-3a91a1facc75"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 23 22:08:41.367894 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.367889 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-kube-api-access-t7sh6" (OuterVolumeSpecName: "kube-api-access-t7sh6") pod "d6396088-510a-48b9-a212-3a91a1facc75" (UID: "d6396088-510a-48b9-a212-3a91a1facc75"). InnerVolumeSpecName "kube-api-access-t7sh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 23 22:08:41.368037 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.367899 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d6396088-510a-48b9-a212-3a91a1facc75" (UID: "d6396088-510a-48b9-a212-3a91a1facc75"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 23 22:08:41.375921 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.375898 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6396088-510a-48b9-a212-3a91a1facc75-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d6396088-510a-48b9-a212-3a91a1facc75" (UID: "d6396088-510a-48b9-a212-3a91a1facc75"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 23 22:08:41.466162 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.466126 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7sh6\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-kube-api-access-t7sh6\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:08:41.466162 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.466152 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-registry-tls\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:08:41.466162 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.466163 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-image-registry-private-configuration\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:08:41.466359 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.466173 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-trusted-ca\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:08:41.466359 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.466182 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6396088-510a-48b9-a212-3a91a1facc75-installation-pull-secrets\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:08:41.466359 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.466190 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6396088-510a-48b9-a212-3a91a1facc75-registry-certificates\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:08:41.466359 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.466199 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6396088-510a-48b9-a212-3a91a1facc75-bound-sa-token\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:08:41.466359 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.466207 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6396088-510a-48b9-a212-3a91a1facc75-ca-trust-extracted\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:08:41.627092 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.627011 2556 generic.go:358] "Generic (PLEG): container finished" podID="d6396088-510a-48b9-a212-3a91a1facc75" containerID="39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d" exitCode=0 May 23 22:08:41.627092 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.627065 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" event={"ID":"d6396088-510a-48b9-a212-3a91a1facc75","Type":"ContainerDied","Data":"39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d"} May 23 22:08:41.627092 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.627073 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" May 23 22:08:41.627092 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.627087 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77787fc544-t6lmp" event={"ID":"d6396088-510a-48b9-a212-3a91a1facc75","Type":"ContainerDied","Data":"7d20acd33a3eecbe928c00e7542ec5ad95d6900b97808a3f0f494bc9859a4c6e"} May 23 22:08:41.627347 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.627101 2556 scope.go:117] "RemoveContainer" containerID="39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d" May 23 22:08:41.637043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.637026 2556 scope.go:117] "RemoveContainer" containerID="39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d" May 23 22:08:41.637299 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:08:41.637280 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d\": container with ID starting with 39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d not found: ID does not exist" containerID="39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d" May 23 22:08:41.637360 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.637308 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d"} err="failed to get container status \"39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d\": rpc error: code = NotFound desc = could not find container \"39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d\": container with ID starting with 39447d582b84767557518ffed6f082ba30df28cc60fcea977caa7119f8473b6d not found: ID does not exist" May 23 22:08:41.647241 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.647220 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77787fc544-t6lmp"] May 23 22:08:41.651017 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:41.650995 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77787fc544-t6lmp"] May 23 22:08:42.974154 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:08:42.974121 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6396088-510a-48b9-a212-3a91a1facc75" path="/var/lib/kubelet/pods/d6396088-510a-48b9-a212-3a91a1facc75/volumes" May 23 22:09:08.771039 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:08.770938 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:09:08.773235 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:08.773210 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb43ba8a-7020-4f4a-8c3e-ed619161fc6b-metrics-certs\") pod \"network-metrics-daemon-h5tlh\" (UID: \"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b\") " pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:09:08.973361 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:08.973330 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h5srv\"" May 23 22:09:08.981216 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:08.981192 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5tlh" May 23 22:09:09.097433 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:09.097383 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5tlh"] May 23 22:09:09.101016 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:09:09.100991 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb43ba8a_7020_4f4a_8c3e_ed619161fc6b.slice/crio-770f0bb164e4f426d74aa116f8ba038af7f0d731aa932b54d5fc62450a53fc60 WatchSource:0}: Error finding container 770f0bb164e4f426d74aa116f8ba038af7f0d731aa932b54d5fc62450a53fc60: Status 404 returned error can't find the container with id 770f0bb164e4f426d74aa116f8ba038af7f0d731aa932b54d5fc62450a53fc60 May 23 22:09:09.697273 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:09.697237 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5tlh" event={"ID":"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b","Type":"ContainerStarted","Data":"770f0bb164e4f426d74aa116f8ba038af7f0d731aa932b54d5fc62450a53fc60"} May 23 22:09:10.703353 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:10.703320 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5tlh" event={"ID":"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b","Type":"ContainerStarted","Data":"338d3085e564601c6c157c15bf8b8aa67d4f70b4384b7339b83e9be79a7940f8"} May 23 22:09:10.703353 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:10.703353 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5tlh" event={"ID":"bb43ba8a-7020-4f4a-8c3e-ed619161fc6b","Type":"ContainerStarted","Data":"f4ad7d8658d0f9a1d5378c13c09a706e47928daaa315ab4d0e762f14db826d08"} May 23 22:09:10.719787 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:10.719739 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h5tlh" podStartSLOduration=252.668785335 podStartE2EDuration="4m13.719726997s" podCreationTimestamp="2026-05-23 22:04:57 +0000 UTC" firstStartedPulling="2026-05-23 22:09:09.102747597 +0000 UTC m=+252.707922982" lastFinishedPulling="2026-05-23 22:09:10.153689257 +0000 UTC m=+253.758864644" observedRunningTime="2026-05-23 22:09:10.718116049 +0000 UTC m=+254.323291452" watchObservedRunningTime="2026-05-23 22:09:10.719726997 +0000 UTC m=+254.324902400" May 23 22:09:56.874045 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:56.874012 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:09:56.874721 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:56.874702 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:09:56.881902 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:09:56.881878 2556 kubelet.go:1628] "Image garbage collection succeeded" May 23 22:11:48.157334 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.157294 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn"] May 23 22:11:48.157801 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.157519 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6396088-510a-48b9-a212-3a91a1facc75" containerName="registry" May 23 22:11:48.157801 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.157531 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6396088-510a-48b9-a212-3a91a1facc75" containerName="registry" May 23 22:11:48.157801 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.157587 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6396088-510a-48b9-a212-3a91a1facc75" containerName="registry" May 23 22:11:48.160302 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.160283 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" May 23 22:11:48.162891 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.162873 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 23 22:11:48.163483 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.163461 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fgw78\"" May 23 22:11:48.163593 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.163467 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 23 22:11:48.167670 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.167641 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn"] May 23 22:11:48.261484 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.261445 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phc68\" (UniqueName: \"kubernetes.io/projected/db68ce76-4d6a-448e-8358-1bb126b25df3-kube-api-access-phc68\") pod \"openshift-lws-operator-bfc7f696d-dbwqn\" (UID: \"db68ce76-4d6a-448e-8358-1bb126b25df3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" May 23 22:11:48.261647 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.261508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db68ce76-4d6a-448e-8358-1bb126b25df3-tmp\") pod \"openshift-lws-operator-bfc7f696d-dbwqn\" (UID: \"db68ce76-4d6a-448e-8358-1bb126b25df3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" May 23 22:11:48.361960 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.361925 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phc68\" (UniqueName: \"kubernetes.io/projected/db68ce76-4d6a-448e-8358-1bb126b25df3-kube-api-access-phc68\") pod \"openshift-lws-operator-bfc7f696d-dbwqn\" (UID: \"db68ce76-4d6a-448e-8358-1bb126b25df3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" May 23 22:11:48.362095 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.361972 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db68ce76-4d6a-448e-8358-1bb126b25df3-tmp\") pod \"openshift-lws-operator-bfc7f696d-dbwqn\" (UID: \"db68ce76-4d6a-448e-8358-1bb126b25df3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" May 23 22:11:48.362305 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.362289 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db68ce76-4d6a-448e-8358-1bb126b25df3-tmp\") pod \"openshift-lws-operator-bfc7f696d-dbwqn\" (UID: \"db68ce76-4d6a-448e-8358-1bb126b25df3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" May 23 22:11:48.369934 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.369904 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phc68\" (UniqueName: \"kubernetes.io/projected/db68ce76-4d6a-448e-8358-1bb126b25df3-kube-api-access-phc68\") pod \"openshift-lws-operator-bfc7f696d-dbwqn\" (UID: \"db68ce76-4d6a-448e-8358-1bb126b25df3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" May 23 22:11:48.469353 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.469323 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" May 23 22:11:48.589401 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.589368 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn"] May 23 22:11:48.592513 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:11:48.592491 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb68ce76_4d6a_448e_8358_1bb126b25df3.slice/crio-02be386b18bde61cca5c5c85b741255dcd0dbc12a6cc3f13c846b36eba06fcf6 WatchSource:0}: Error finding container 02be386b18bde61cca5c5c85b741255dcd0dbc12a6cc3f13c846b36eba06fcf6: Status 404 returned error can't find the container with id 02be386b18bde61cca5c5c85b741255dcd0dbc12a6cc3f13c846b36eba06fcf6 May 23 22:11:48.594371 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:48.594352 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 23 22:11:49.090892 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:49.090858 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" event={"ID":"db68ce76-4d6a-448e-8358-1bb126b25df3","Type":"ContainerStarted","Data":"02be386b18bde61cca5c5c85b741255dcd0dbc12a6cc3f13c846b36eba06fcf6"} May 23 22:11:56.108519 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:56.108484 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" event={"ID":"db68ce76-4d6a-448e-8358-1bb126b25df3","Type":"ContainerStarted","Data":"bf1b9e68b30d5d351cd071c59f312b658c72fbef05329ddca7bac6a1ce2d92ef"} May 23 22:11:56.126612 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:11:56.126560 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbwqn" podStartSLOduration=1.301594288 podStartE2EDuration="8.126542953s" podCreationTimestamp="2026-05-23 22:11:48 +0000 UTC" firstStartedPulling="2026-05-23 22:11:48.594474289 +0000 UTC m=+412.199649672" lastFinishedPulling="2026-05-23 22:11:55.419422937 +0000 UTC m=+419.024598337" observedRunningTime="2026-05-23 22:11:56.125063674 +0000 UTC m=+419.730239078" watchObservedRunningTime="2026-05-23 22:11:56.126542953 +0000 UTC m=+419.731718359" May 23 22:12:15.296473 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.296436 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq"] May 23 22:12:15.299443 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.299423 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.301992 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.301968 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mkb7m\"" May 23 22:12:15.301992 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.301985 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 23 22:12:15.302187 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.302000 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 23 22:12:15.302187 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.302075 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 23 22:12:15.302568 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.302554 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 23 22:12:15.315573 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.315550 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq"] May 23 22:12:15.353043 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.353009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bac7e23b-1ffc-4d89-8965-ad8914ab86ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-5wpmq\" (UID: \"bac7e23b-1ffc-4d89-8965-ad8914ab86ff\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.353189 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.353053 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bac7e23b-1ffc-4d89-8965-ad8914ab86ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-5wpmq\" (UID: \"bac7e23b-1ffc-4d89-8965-ad8914ab86ff\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.353189 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.353072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjmf7\" (UniqueName: \"kubernetes.io/projected/bac7e23b-1ffc-4d89-8965-ad8914ab86ff-kube-api-access-wjmf7\") pod \"opendatahub-operator-controller-manager-696794d4d9-5wpmq\" (UID: \"bac7e23b-1ffc-4d89-8965-ad8914ab86ff\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.454021 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.453983 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bac7e23b-1ffc-4d89-8965-ad8914ab86ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-5wpmq\" (UID: \"bac7e23b-1ffc-4d89-8965-ad8914ab86ff\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.454021 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.454021 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjmf7\" (UniqueName: \"kubernetes.io/projected/bac7e23b-1ffc-4d89-8965-ad8914ab86ff-kube-api-access-wjmf7\") pod \"opendatahub-operator-controller-manager-696794d4d9-5wpmq\" (UID: \"bac7e23b-1ffc-4d89-8965-ad8914ab86ff\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.454268 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.454065 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bac7e23b-1ffc-4d89-8965-ad8914ab86ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-5wpmq\" (UID: \"bac7e23b-1ffc-4d89-8965-ad8914ab86ff\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.456436 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.456407 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bac7e23b-1ffc-4d89-8965-ad8914ab86ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-5wpmq\" (UID: \"bac7e23b-1ffc-4d89-8965-ad8914ab86ff\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.456542 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.456439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bac7e23b-1ffc-4d89-8965-ad8914ab86ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-5wpmq\" (UID: \"bac7e23b-1ffc-4d89-8965-ad8914ab86ff\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.462068 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.462046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjmf7\" (UniqueName: \"kubernetes.io/projected/bac7e23b-1ffc-4d89-8965-ad8914ab86ff-kube-api-access-wjmf7\") pod \"opendatahub-operator-controller-manager-696794d4d9-5wpmq\" (UID: \"bac7e23b-1ffc-4d89-8965-ad8914ab86ff\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.609817 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.609733 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:15.758329 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:15.758305 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq"] May 23 22:12:15.761059 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:12:15.761031 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac7e23b_1ffc_4d89_8965_ad8914ab86ff.slice/crio-ded68cafa1ca79f9cc0d1a9351e9e62b1310b925742df3cb5ae7a3b16b9b39c5 WatchSource:0}: Error finding container ded68cafa1ca79f9cc0d1a9351e9e62b1310b925742df3cb5ae7a3b16b9b39c5: Status 404 returned error can't find the container with id ded68cafa1ca79f9cc0d1a9351e9e62b1310b925742df3cb5ae7a3b16b9b39c5 May 23 22:12:16.156990 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:16.156949 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" event={"ID":"bac7e23b-1ffc-4d89-8965-ad8914ab86ff","Type":"ContainerStarted","Data":"ded68cafa1ca79f9cc0d1a9351e9e62b1310b925742df3cb5ae7a3b16b9b39c5"} May 23 22:12:19.167235 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:19.167198 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" event={"ID":"bac7e23b-1ffc-4d89-8965-ad8914ab86ff","Type":"ContainerStarted","Data":"c2afaeb517cc1b0707669cca16b0856a5972a8e0320842bc4b81eb16b26b44b2"} May 23 22:12:19.167691 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:19.167365 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:19.188893 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:19.188842 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" podStartSLOduration=1.729463312 podStartE2EDuration="4.188828388s" podCreationTimestamp="2026-05-23 22:12:15 +0000 UTC" firstStartedPulling="2026-05-23 22:12:15.762785683 +0000 UTC m=+439.367961065" lastFinishedPulling="2026-05-23 22:12:18.222150759 +0000 UTC m=+441.827326141" observedRunningTime="2026-05-23 22:12:19.188031823 +0000 UTC m=+442.793207227" watchObservedRunningTime="2026-05-23 22:12:19.188828388 +0000 UTC m=+442.794003791" May 23 22:12:30.172797 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:30.172767 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-5wpmq" May 23 22:12:33.675709 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.675673 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv"] May 23 22:12:33.680682 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.680648 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.682890 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.682868 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 23 22:12:33.683005 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.682927 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 23 22:12:33.683791 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.683769 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 23 22:12:33.683903 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.683836 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rhbsg\"" May 23 22:12:33.683955 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.683897 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 23 22:12:33.688180 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.688160 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv"] May 23 22:12:33.793991 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.793962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn95m\" (UniqueName: \"kubernetes.io/projected/c1745b13-47e6-4206-97d1-676aea47822f-kube-api-access-kn95m\") pod \"kube-auth-proxy-59f475c6cf-d8xtv\" (UID: \"c1745b13-47e6-4206-97d1-676aea47822f\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.793991 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.793992 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1745b13-47e6-4206-97d1-676aea47822f-tls-certs\") pod \"kube-auth-proxy-59f475c6cf-d8xtv\" (UID: \"c1745b13-47e6-4206-97d1-676aea47822f\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.794190 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.794016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1745b13-47e6-4206-97d1-676aea47822f-tmp\") pod \"kube-auth-proxy-59f475c6cf-d8xtv\" (UID: \"c1745b13-47e6-4206-97d1-676aea47822f\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.894877 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.894848 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kn95m\" (UniqueName: \"kubernetes.io/projected/c1745b13-47e6-4206-97d1-676aea47822f-kube-api-access-kn95m\") pod \"kube-auth-proxy-59f475c6cf-d8xtv\" (UID: \"c1745b13-47e6-4206-97d1-676aea47822f\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.895055 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.894895 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1745b13-47e6-4206-97d1-676aea47822f-tls-certs\") pod \"kube-auth-proxy-59f475c6cf-d8xtv\" (UID: \"c1745b13-47e6-4206-97d1-676aea47822f\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.895055 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.894935 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1745b13-47e6-4206-97d1-676aea47822f-tmp\") pod \"kube-auth-proxy-59f475c6cf-d8xtv\" (UID: \"c1745b13-47e6-4206-97d1-676aea47822f\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.897246 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.897212 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1745b13-47e6-4206-97d1-676aea47822f-tmp\") pod \"kube-auth-proxy-59f475c6cf-d8xtv\" (UID: \"c1745b13-47e6-4206-97d1-676aea47822f\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.897374 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.897345 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1745b13-47e6-4206-97d1-676aea47822f-tls-certs\") pod \"kube-auth-proxy-59f475c6cf-d8xtv\" (UID: \"c1745b13-47e6-4206-97d1-676aea47822f\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.904000 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.903976 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn95m\" (UniqueName: \"kubernetes.io/projected/c1745b13-47e6-4206-97d1-676aea47822f-kube-api-access-kn95m\") pod \"kube-auth-proxy-59f475c6cf-d8xtv\" (UID: \"c1745b13-47e6-4206-97d1-676aea47822f\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:33.990778 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:33.990743 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" May 23 22:12:34.125946 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:34.125913 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv"] May 23 22:12:34.129464 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:12:34.129426 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1745b13_47e6_4206_97d1_676aea47822f.slice/crio-322f287d99ae5bcd9c2d86d86b4cd8745414958e69880aada7c004cba96ce9f4 WatchSource:0}: Error finding container 322f287d99ae5bcd9c2d86d86b4cd8745414958e69880aada7c004cba96ce9f4: Status 404 returned error can't find the container with id 322f287d99ae5bcd9c2d86d86b4cd8745414958e69880aada7c004cba96ce9f4 May 23 22:12:34.208571 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:34.208539 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" event={"ID":"c1745b13-47e6-4206-97d1-676aea47822f","Type":"ContainerStarted","Data":"322f287d99ae5bcd9c2d86d86b4cd8745414958e69880aada7c004cba96ce9f4"} May 23 22:12:36.079977 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.079938 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-p8k59"] May 23 22:12:36.084086 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.084059 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:36.086843 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.086817 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 23 22:12:36.087122 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.087104 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8s8dq\"" May 23 22:12:36.091356 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.091315 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-p8k59"] May 23 22:12:36.212482 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.212443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/317ca33b-2038-4dc4-98e9-1b72bfca6529-cert\") pod \"odh-model-controller-858dbf95b8-p8k59\" (UID: \"317ca33b-2038-4dc4-98e9-1b72bfca6529\") " pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:36.212717 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.212553 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hj85\" (UniqueName: \"kubernetes.io/projected/317ca33b-2038-4dc4-98e9-1b72bfca6529-kube-api-access-4hj85\") pod \"odh-model-controller-858dbf95b8-p8k59\" (UID: \"317ca33b-2038-4dc4-98e9-1b72bfca6529\") " pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:36.313202 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.313159 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/317ca33b-2038-4dc4-98e9-1b72bfca6529-cert\") pod \"odh-model-controller-858dbf95b8-p8k59\" (UID: \"317ca33b-2038-4dc4-98e9-1b72bfca6529\") " pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:36.313375 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.313230 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hj85\" (UniqueName: \"kubernetes.io/projected/317ca33b-2038-4dc4-98e9-1b72bfca6529-kube-api-access-4hj85\") pod \"odh-model-controller-858dbf95b8-p8k59\" (UID: \"317ca33b-2038-4dc4-98e9-1b72bfca6529\") " pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:36.313375 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:12:36.313322 2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 23 22:12:36.313447 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:12:36.313397 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317ca33b-2038-4dc4-98e9-1b72bfca6529-cert podName:317ca33b-2038-4dc4-98e9-1b72bfca6529 nodeName:}" failed. No retries permitted until 2026-05-23 22:12:36.813376282 +0000 UTC m=+460.418551664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/317ca33b-2038-4dc4-98e9-1b72bfca6529-cert") pod "odh-model-controller-858dbf95b8-p8k59" (UID: "317ca33b-2038-4dc4-98e9-1b72bfca6529") : secret "odh-model-controller-webhook-cert" not found May 23 22:12:36.322118 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.322081 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hj85\" (UniqueName: \"kubernetes.io/projected/317ca33b-2038-4dc4-98e9-1b72bfca6529-kube-api-access-4hj85\") pod \"odh-model-controller-858dbf95b8-p8k59\" (UID: \"317ca33b-2038-4dc4-98e9-1b72bfca6529\") " pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:36.817881 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.817841 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/317ca33b-2038-4dc4-98e9-1b72bfca6529-cert\") pod \"odh-model-controller-858dbf95b8-p8k59\" (UID: \"317ca33b-2038-4dc4-98e9-1b72bfca6529\") " pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:36.820361 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.820338 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/317ca33b-2038-4dc4-98e9-1b72bfca6529-cert\") pod \"odh-model-controller-858dbf95b8-p8k59\" (UID: \"317ca33b-2038-4dc4-98e9-1b72bfca6529\") " pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:36.997944 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:36.997912 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:37.614008 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:37.613980 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-p8k59"] May 23 22:12:37.617151 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:12:37.617124 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317ca33b_2038_4dc4_98e9_1b72bfca6529.slice/crio-7d3fab1dbf06d49e2b624d983ef3687684f49524b3ef15e41bcc559c03e8ab65 WatchSource:0}: Error finding container 7d3fab1dbf06d49e2b624d983ef3687684f49524b3ef15e41bcc559c03e8ab65: Status 404 returned error can't find the container with id 7d3fab1dbf06d49e2b624d983ef3687684f49524b3ef15e41bcc559c03e8ab65 May 23 22:12:38.220424 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:38.220384 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" event={"ID":"317ca33b-2038-4dc4-98e9-1b72bfca6529","Type":"ContainerStarted","Data":"7d3fab1dbf06d49e2b624d983ef3687684f49524b3ef15e41bcc559c03e8ab65"} May 23 22:12:38.221988 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:38.221959 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" event={"ID":"c1745b13-47e6-4206-97d1-676aea47822f","Type":"ContainerStarted","Data":"933abba830ade8b6d2bfa17d1bbeab9b3896d8c81a982ab14d91887f986e0466"} May 23 22:12:38.239580 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:38.239524 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-d8xtv" podStartSLOduration=1.814948759 podStartE2EDuration="5.239506332s" podCreationTimestamp="2026-05-23 22:12:33 +0000 UTC" firstStartedPulling="2026-05-23 22:12:34.131279712 +0000 UTC m=+457.736455094" lastFinishedPulling="2026-05-23 22:12:37.555837282 +0000 UTC m=+461.161012667" observedRunningTime="2026-05-23 22:12:38.238037613 +0000 UTC m=+461.843213019" watchObservedRunningTime="2026-05-23 22:12:38.239506332 +0000 UTC m=+461.844681737" May 23 22:12:41.232360 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.232326 2556 generic.go:358] "Generic (PLEG): container finished" podID="317ca33b-2038-4dc4-98e9-1b72bfca6529" containerID="2f422437bf882f4f9293983de1c11f6d1fe7e80783c583844eea2c53f98d6653" exitCode=1 May 23 22:12:41.232806 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.232379 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" event={"ID":"317ca33b-2038-4dc4-98e9-1b72bfca6529","Type":"ContainerDied","Data":"2f422437bf882f4f9293983de1c11f6d1fe7e80783c583844eea2c53f98d6653"} May 23 22:12:41.232806 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.232695 2556 scope.go:117] "RemoveContainer" containerID="2f422437bf882f4f9293983de1c11f6d1fe7e80783c583844eea2c53f98d6653" May 23 22:12:41.831173 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.831099 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-59qpf"] May 23 22:12:41.834129 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.834109 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:41.836504 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.836480 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-96rr6\"" May 23 22:12:41.836767 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.836749 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 23 22:12:41.842580 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.842556 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-59qpf"] May 23 22:12:41.959589 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.959558 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl4r9\" (UniqueName: \"kubernetes.io/projected/74cd78a9-5c49-46e9-85a0-a65679825b85-kube-api-access-cl4r9\") pod \"kserve-controller-manager-856948b99f-59qpf\" (UID: \"74cd78a9-5c49-46e9-85a0-a65679825b85\") " pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:41.959589 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:41.959590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74cd78a9-5c49-46e9-85a0-a65679825b85-cert\") pod \"kserve-controller-manager-856948b99f-59qpf\" (UID: \"74cd78a9-5c49-46e9-85a0-a65679825b85\") " pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:42.060895 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:42.060865 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cl4r9\" (UniqueName: \"kubernetes.io/projected/74cd78a9-5c49-46e9-85a0-a65679825b85-kube-api-access-cl4r9\") pod \"kserve-controller-manager-856948b99f-59qpf\" (UID: \"74cd78a9-5c49-46e9-85a0-a65679825b85\") " pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:42.060895 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:42.060901 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74cd78a9-5c49-46e9-85a0-a65679825b85-cert\") pod \"kserve-controller-manager-856948b99f-59qpf\" (UID: \"74cd78a9-5c49-46e9-85a0-a65679825b85\") " pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:42.061090 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:12:42.061007 2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 23 22:12:42.061090 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:12:42.061059 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74cd78a9-5c49-46e9-85a0-a65679825b85-cert podName:74cd78a9-5c49-46e9-85a0-a65679825b85 nodeName:}" failed. No retries permitted until 2026-05-23 22:12:42.561041225 +0000 UTC m=+466.166216611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74cd78a9-5c49-46e9-85a0-a65679825b85-cert") pod "kserve-controller-manager-856948b99f-59qpf" (UID: "74cd78a9-5c49-46e9-85a0-a65679825b85") : secret "kserve-webhook-server-cert" not found May 23 22:12:42.070182 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:42.070150 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl4r9\" (UniqueName: \"kubernetes.io/projected/74cd78a9-5c49-46e9-85a0-a65679825b85-kube-api-access-cl4r9\") pod \"kserve-controller-manager-856948b99f-59qpf\" (UID: \"74cd78a9-5c49-46e9-85a0-a65679825b85\") " pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:42.236726 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:42.236690 2556 generic.go:358] "Generic (PLEG): container finished" podID="317ca33b-2038-4dc4-98e9-1b72bfca6529" containerID="fd54260ea98c4707290d3e0ab76d41902a435e6069552a79f9c607efff166da6" exitCode=1 May 23 22:12:42.237166 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:42.236755 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" event={"ID":"317ca33b-2038-4dc4-98e9-1b72bfca6529","Type":"ContainerDied","Data":"fd54260ea98c4707290d3e0ab76d41902a435e6069552a79f9c607efff166da6"} May 23 22:12:42.237166 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:42.236794 2556 scope.go:117] "RemoveContainer" containerID="2f422437bf882f4f9293983de1c11f6d1fe7e80783c583844eea2c53f98d6653" May 23 22:12:42.237166 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:42.237020 2556 scope.go:117] "RemoveContainer" containerID="fd54260ea98c4707290d3e0ab76d41902a435e6069552a79f9c607efff166da6" May 23 22:12:42.237290 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:12:42.237232 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-p8k59_opendatahub(317ca33b-2038-4dc4-98e9-1b72bfca6529)\"" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" podUID="317ca33b-2038-4dc4-98e9-1b72bfca6529" May 23 22:12:42.564206 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:42.564114 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74cd78a9-5c49-46e9-85a0-a65679825b85-cert\") pod \"kserve-controller-manager-856948b99f-59qpf\" (UID: \"74cd78a9-5c49-46e9-85a0-a65679825b85\") " pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:42.564379 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:12:42.564274 2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 23 22:12:42.564379 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:12:42.564348 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74cd78a9-5c49-46e9-85a0-a65679825b85-cert podName:74cd78a9-5c49-46e9-85a0-a65679825b85 nodeName:}" failed. No retries permitted until 2026-05-23 22:12:43.564326428 +0000 UTC m=+467.169501824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74cd78a9-5c49-46e9-85a0-a65679825b85-cert") pod "kserve-controller-manager-856948b99f-59qpf" (UID: "74cd78a9-5c49-46e9-85a0-a65679825b85") : secret "kserve-webhook-server-cert" not found May 23 22:12:43.240863 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:43.240834 2556 scope.go:117] "RemoveContainer" containerID="fd54260ea98c4707290d3e0ab76d41902a435e6069552a79f9c607efff166da6" May 23 22:12:43.241258 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:12:43.240995 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-p8k59_opendatahub(317ca33b-2038-4dc4-98e9-1b72bfca6529)\"" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" podUID="317ca33b-2038-4dc4-98e9-1b72bfca6529" May 23 22:12:43.572262 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:43.572157 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74cd78a9-5c49-46e9-85a0-a65679825b85-cert\") pod \"kserve-controller-manager-856948b99f-59qpf\" (UID: \"74cd78a9-5c49-46e9-85a0-a65679825b85\") " pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:43.574510 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:43.574489 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74cd78a9-5c49-46e9-85a0-a65679825b85-cert\") pod \"kserve-controller-manager-856948b99f-59qpf\" (UID: \"74cd78a9-5c49-46e9-85a0-a65679825b85\") " pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:43.645283 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:43.645245 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:43.763983 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:43.763955 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-59qpf"] May 23 22:12:43.766098 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:12:43.766072 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74cd78a9_5c49_46e9_85a0_a65679825b85.slice/crio-1264c5f76ce5e6c73f51443ff2ca9a4c6b34bdf1b0c17cc13f2084ca0a1b2ba8 WatchSource:0}: Error finding container 1264c5f76ce5e6c73f51443ff2ca9a4c6b34bdf1b0c17cc13f2084ca0a1b2ba8: Status 404 returned error can't find the container with id 1264c5f76ce5e6c73f51443ff2ca9a4c6b34bdf1b0c17cc13f2084ca0a1b2ba8 May 23 22:12:44.244673 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:44.244634 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" event={"ID":"74cd78a9-5c49-46e9-85a0-a65679825b85","Type":"ContainerStarted","Data":"1264c5f76ce5e6c73f51443ff2ca9a4c6b34bdf1b0c17cc13f2084ca0a1b2ba8"} May 23 22:12:46.998760 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:46.998726 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:46.999269 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:46.999172 2556 scope.go:117] "RemoveContainer" containerID="fd54260ea98c4707290d3e0ab76d41902a435e6069552a79f9c607efff166da6" May 23 22:12:46.999411 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:12:46.999386 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-p8k59_opendatahub(317ca33b-2038-4dc4-98e9-1b72bfca6529)\"" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" podUID="317ca33b-2038-4dc4-98e9-1b72bfca6529" May 23 22:12:47.253994 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:47.253909 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" event={"ID":"74cd78a9-5c49-46e9-85a0-a65679825b85","Type":"ContainerStarted","Data":"ec08cabc674d47193049b740c2932f18bde6ae59cc16f1b86d11737b04c03cdd"} May 23 22:12:47.254154 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:47.254014 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:12:47.269804 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:47.269748 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" podStartSLOduration=3.407781271 podStartE2EDuration="6.269732787s" podCreationTimestamp="2026-05-23 22:12:41 +0000 UTC" firstStartedPulling="2026-05-23 22:12:43.767798536 +0000 UTC m=+467.372973918" lastFinishedPulling="2026-05-23 22:12:46.629750048 +0000 UTC m=+470.234925434" observedRunningTime="2026-05-23 22:12:47.268894956 +0000 UTC m=+470.874070361" watchObservedRunningTime="2026-05-23 22:12:47.269732787 +0000 UTC m=+470.874908191" May 23 22:12:50.889928 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:50.889894 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-rt6px"] May 23 22:12:50.892545 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:50.892528 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:12:50.894967 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:50.894907 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 23 22:12:50.894967 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:50.894920 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 23 22:12:50.895138 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:50.894927 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-qzmpn\"" May 23 22:12:50.904012 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:50.903990 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-rt6px"] May 23 22:12:51.030949 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:51.030912 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e03f21c1-c1eb-4849-807a-8f1cf09d23d1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-rt6px\" (UID: \"e03f21c1-c1eb-4849-807a-8f1cf09d23d1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:12:51.031119 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:51.030967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88gt\" (UniqueName: \"kubernetes.io/projected/e03f21c1-c1eb-4849-807a-8f1cf09d23d1-kube-api-access-z88gt\") pod \"servicemesh-operator3-55f49c5f94-rt6px\" (UID: \"e03f21c1-c1eb-4849-807a-8f1cf09d23d1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:12:51.131959 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:51.131922 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e03f21c1-c1eb-4849-807a-8f1cf09d23d1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-rt6px\" (UID: \"e03f21c1-c1eb-4849-807a-8f1cf09d23d1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:12:51.132126 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:51.131969 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z88gt\" (UniqueName: \"kubernetes.io/projected/e03f21c1-c1eb-4849-807a-8f1cf09d23d1-kube-api-access-z88gt\") pod \"servicemesh-operator3-55f49c5f94-rt6px\" (UID: \"e03f21c1-c1eb-4849-807a-8f1cf09d23d1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:12:51.134391 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:51.134366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e03f21c1-c1eb-4849-807a-8f1cf09d23d1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-rt6px\" (UID: \"e03f21c1-c1eb-4849-807a-8f1cf09d23d1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:12:51.143273 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:51.143214 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88gt\" (UniqueName: \"kubernetes.io/projected/e03f21c1-c1eb-4849-807a-8f1cf09d23d1-kube-api-access-z88gt\") pod \"servicemesh-operator3-55f49c5f94-rt6px\" (UID: \"e03f21c1-c1eb-4849-807a-8f1cf09d23d1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:12:51.201966 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:51.201921 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:12:51.331116 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:51.331086 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-rt6px"] May 23 22:12:51.333788 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:12:51.333763 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03f21c1_c1eb_4849_807a_8f1cf09d23d1.slice/crio-fe22bffd336d9835ddc1cf50e621f8240aa99cac4999869799142b5c77ab9606 WatchSource:0}: Error finding container fe22bffd336d9835ddc1cf50e621f8240aa99cac4999869799142b5c77ab9606: Status 404 returned error can't find the container with id fe22bffd336d9835ddc1cf50e621f8240aa99cac4999869799142b5c77ab9606 May 23 22:12:52.271855 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:52.271822 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" event={"ID":"e03f21c1-c1eb-4849-807a-8f1cf09d23d1","Type":"ContainerStarted","Data":"fe22bffd336d9835ddc1cf50e621f8240aa99cac4999869799142b5c77ab9606"} May 23 22:12:54.280278 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:54.280241 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" event={"ID":"e03f21c1-c1eb-4849-807a-8f1cf09d23d1","Type":"ContainerStarted","Data":"fb0f3ccb3a76d51c5cb6deafb6266b66bd712396170e12f960ba05ae5c610801"} May 23 22:12:54.280677 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:54.280350 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:12:54.301636 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:54.301591 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" podStartSLOduration=1.855697323 podStartE2EDuration="4.301576851s" podCreationTimestamp="2026-05-23 22:12:50 +0000 UTC" firstStartedPulling="2026-05-23 22:12:51.336435518 +0000 UTC m=+474.941610900" lastFinishedPulling="2026-05-23 22:12:53.782315037 +0000 UTC m=+477.387490428" observedRunningTime="2026-05-23 22:12:54.299496285 +0000 UTC m=+477.904671690" watchObservedRunningTime="2026-05-23 22:12:54.301576851 +0000 UTC m=+477.906752254" May 23 22:12:56.998539 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:56.998509 2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:56.998899 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:56.998886 2556 scope.go:117] "RemoveContainer" containerID="fd54260ea98c4707290d3e0ab76d41902a435e6069552a79f9c607efff166da6" May 23 22:12:58.295806 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:58.295770 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" event={"ID":"317ca33b-2038-4dc4-98e9-1b72bfca6529","Type":"ContainerStarted","Data":"3f9ae9e10b2d2915017a588769e83b51b9bc3119c1fe2368c5250c6d8f620b09"} May 23 22:12:58.296197 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:58.295992 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:12:58.314526 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:12:58.314479 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" podStartSLOduration=2.674843873 podStartE2EDuration="22.31446699s" podCreationTimestamp="2026-05-23 22:12:36 +0000 UTC" firstStartedPulling="2026-05-23 22:12:37.618906851 +0000 UTC m=+461.224082234" lastFinishedPulling="2026-05-23 22:12:57.258529955 +0000 UTC m=+480.863705351" observedRunningTime="2026-05-23 22:12:58.314460379 +0000 UTC m=+481.919635782" watchObservedRunningTime="2026-05-23 22:12:58.31446699 +0000 UTC m=+481.919642399" May 23 22:13:01.275074 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.275036 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd"] May 23 22:13:01.278157 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.278134 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.280189 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.280170 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 23 22:13:01.280311 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.280188 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 23 22:13:01.280311 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.280245 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 23 22:13:01.280443 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.280408 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 23 22:13:01.280801 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.280787 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z7fk4\"" May 23 22:13:01.288607 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.288582 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd"] May 23 22:13:01.415194 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.415157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e60ff324-858a-4358-a11c-68a46734c10a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.415380 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.415211 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e60ff324-858a-4358-a11c-68a46734c10a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.415380 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.415229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e60ff324-858a-4358-a11c-68a46734c10a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.415380 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.415249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e60ff324-858a-4358-a11c-68a46734c10a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.415380 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.415265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e60ff324-858a-4358-a11c-68a46734c10a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.415380 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.415290 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6zr\" (UniqueName: \"kubernetes.io/projected/e60ff324-858a-4358-a11c-68a46734c10a-kube-api-access-vc6zr\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.415380 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.415311 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e60ff324-858a-4358-a11c-68a46734c10a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.516261 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.516226 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e60ff324-858a-4358-a11c-68a46734c10a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.516440 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.516275 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e60ff324-858a-4358-a11c-68a46734c10a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.516440 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.516397 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e60ff324-858a-4358-a11c-68a46734c10a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.516554 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.516444 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e60ff324-858a-4358-a11c-68a46734c10a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.516554 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.516475 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e60ff324-858a-4358-a11c-68a46734c10a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.516554 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.516524 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6zr\" (UniqueName: \"kubernetes.io/projected/e60ff324-858a-4358-a11c-68a46734c10a-kube-api-access-vc6zr\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.516729 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.516569 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e60ff324-858a-4358-a11c-68a46734c10a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.517129 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.517107 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e60ff324-858a-4358-a11c-68a46734c10a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.518891 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.518849 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e60ff324-858a-4358-a11c-68a46734c10a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.519046 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.518949 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e60ff324-858a-4358-a11c-68a46734c10a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.519192 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.519174 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e60ff324-858a-4358-a11c-68a46734c10a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.519251 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.519195 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e60ff324-858a-4358-a11c-68a46734c10a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.524345 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.524318 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e60ff324-858a-4358-a11c-68a46734c10a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.524560 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.524543 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6zr\" (UniqueName: \"kubernetes.io/projected/e60ff324-858a-4358-a11c-68a46734c10a-kube-api-access-vc6zr\") pod \"istiod-openshift-gateway-798958bb55-dgwnd\" (UID: \"e60ff324-858a-4358-a11c-68a46734c10a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.590111 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.590023 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:01.726333 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:01.726302 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd"] May 23 22:13:01.730071 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:13:01.730028 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60ff324_858a_4358_a11c_68a46734c10a.slice/crio-0f7bda26d1d8d40bf3ab28db65a345430e297cf8a1195f5c4fddcb716ab20e29 WatchSource:0}: Error finding container 0f7bda26d1d8d40bf3ab28db65a345430e297cf8a1195f5c4fddcb716ab20e29: Status 404 returned error can't find the container with id 0f7bda26d1d8d40bf3ab28db65a345430e297cf8a1195f5c4fddcb716ab20e29 May 23 22:13:02.310152 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:02.310120 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" event={"ID":"e60ff324-858a-4358-a11c-68a46734c10a","Type":"ContainerStarted","Data":"0f7bda26d1d8d40bf3ab28db65a345430e297cf8a1195f5c4fddcb716ab20e29"} May 23 22:13:04.288229 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:04.288175 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 23 22:13:04.288505 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:04.288264 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 23 22:13:05.286196 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:05.286166 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rt6px" May 23 22:13:05.321073 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:05.321035 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" event={"ID":"e60ff324-858a-4358-a11c-68a46734c10a","Type":"ContainerStarted","Data":"856980aa955d76b5464efe41df0a905540c6908ec1d44a78b94b22b6114ffcde"} May 23 22:13:05.321532 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:05.321191 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:05.322710 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:05.322689 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" May 23 22:13:05.341765 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:05.341699 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dgwnd" podStartSLOduration=1.786222423 podStartE2EDuration="4.341679824s" podCreationTimestamp="2026-05-23 22:13:01 +0000 UTC" firstStartedPulling="2026-05-23 22:13:01.73248199 +0000 UTC m=+485.337657376" lastFinishedPulling="2026-05-23 22:13:04.287939381 +0000 UTC m=+487.893114777" observedRunningTime="2026-05-23 22:13:05.339972605 +0000 UTC m=+488.945148009" watchObservedRunningTime="2026-05-23 22:13:05.341679824 +0000 UTC m=+488.946855226" May 23 22:13:09.301758 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:09.301723 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-p8k59" May 23 22:13:18.262133 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:13:18.262101 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-59qpf" May 23 22:14:10.112527 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.112449 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq"] May 23 22:14:10.115540 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.115524 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:10.118162 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.118141 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 23 22:14:10.118162 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.118154 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hlwqb\"" May 23 22:14:10.118300 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.118154 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 23 22:14:10.127190 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.127168 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq"] May 23 22:14:10.222899 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.222867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqmw9\" (UniqueName: \"kubernetes.io/projected/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-kube-api-access-mqmw9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" (UID: \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:10.223089 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.222928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" (UID: \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:10.323599 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.323558 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqmw9\" (UniqueName: \"kubernetes.io/projected/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-kube-api-access-mqmw9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" (UID: \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:10.323817 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.323633 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" (UID: \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:10.324002 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.323981 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" (UID: \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:10.332794 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.332768 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqmw9\" (UniqueName: \"kubernetes.io/projected/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-kube-api-access-mqmw9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" (UID: \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:10.425145 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.425058 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:10.550426 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:10.550402 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq"] May 23 22:14:10.552891 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:14:10.552858 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01449c3_cdfd_4f90_b15d_6abfbd0f2fbd.slice/crio-758072d926ff6086c73856ab48bc9a01258b3f3039b4890db24f58566fcdb0ff WatchSource:0}: Error finding container 758072d926ff6086c73856ab48bc9a01258b3f3039b4890db24f58566fcdb0ff: Status 404 returned error can't find the container with id 758072d926ff6086c73856ab48bc9a01258b3f3039b4890db24f58566fcdb0ff May 23 22:14:11.523544 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:11.523510 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" event={"ID":"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd","Type":"ContainerStarted","Data":"758072d926ff6086c73856ab48bc9a01258b3f3039b4890db24f58566fcdb0ff"} May 23 22:14:15.898699 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:15.898606 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99"] May 23 22:14:15.901713 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:15.901693 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" May 23 22:14:15.904018 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:15.903997 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 23 22:14:15.904142 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:15.904118 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r29vm\"" May 23 22:14:15.911806 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:15.911788 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99"] May 23 22:14:15.968071 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:15.968035 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxvvj\" (UniqueName: \"kubernetes.io/projected/3d0623da-37b8-41d4-b761-c6d52a43dc32-kube-api-access-fxvvj\") pod \"dns-operator-controller-manager-648d5c98bc-ldd99\" (UID: \"3d0623da-37b8-41d4-b761-c6d52a43dc32\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" May 23 22:14:16.068823 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:16.068791 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxvvj\" (UniqueName: \"kubernetes.io/projected/3d0623da-37b8-41d4-b761-c6d52a43dc32-kube-api-access-fxvvj\") pod \"dns-operator-controller-manager-648d5c98bc-ldd99\" (UID: \"3d0623da-37b8-41d4-b761-c6d52a43dc32\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" May 23 22:14:16.081941 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:16.081911 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxvvj\" (UniqueName: \"kubernetes.io/projected/3d0623da-37b8-41d4-b761-c6d52a43dc32-kube-api-access-fxvvj\") pod \"dns-operator-controller-manager-648d5c98bc-ldd99\" (UID: \"3d0623da-37b8-41d4-b761-c6d52a43dc32\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" May 23 22:14:16.212293 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:16.212262 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" May 23 22:14:16.334591 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:16.334567 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99"] May 23 22:14:16.337480 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:14:16.337453 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0623da_37b8_41d4_b761_c6d52a43dc32.slice/crio-b66c924a63d03941daa0523315dbfe32f3f3b8bd86955ffc59f4bd6bf7bdb238 WatchSource:0}: Error finding container b66c924a63d03941daa0523315dbfe32f3f3b8bd86955ffc59f4bd6bf7bdb238: Status 404 returned error can't find the container with id b66c924a63d03941daa0523315dbfe32f3f3b8bd86955ffc59f4bd6bf7bdb238 May 23 22:14:16.540542 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:16.540436 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" event={"ID":"3d0623da-37b8-41d4-b761-c6d52a43dc32","Type":"ContainerStarted","Data":"b66c924a63d03941daa0523315dbfe32f3f3b8bd86955ffc59f4bd6bf7bdb238"} May 23 22:14:16.541967 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:16.541937 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" event={"ID":"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd","Type":"ContainerStarted","Data":"9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2"} May 23 22:14:16.542112 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:16.542041 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:16.560520 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:16.560471 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" podStartSLOduration=1.571121185 podStartE2EDuration="6.560437505s" podCreationTimestamp="2026-05-23 22:14:10 +0000 UTC" firstStartedPulling="2026-05-23 22:14:10.558176262 +0000 UTC m=+554.163351666" lastFinishedPulling="2026-05-23 22:14:15.5474926 +0000 UTC m=+559.152667986" observedRunningTime="2026-05-23 22:14:16.559067727 +0000 UTC m=+560.164243130" watchObservedRunningTime="2026-05-23 22:14:16.560437505 +0000 UTC m=+560.165612910" May 23 22:14:19.552747 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:19.552708 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" event={"ID":"3d0623da-37b8-41d4-b761-c6d52a43dc32","Type":"ContainerStarted","Data":"a1a968beace0ea1845fb5d9ea9034ad691eacec54bf498db26306d5a010bf6ab"} May 23 22:14:19.553125 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:19.552771 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" May 23 22:14:19.579343 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:19.579296 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" podStartSLOduration=2.320327005 podStartE2EDuration="4.579282635s" podCreationTimestamp="2026-05-23 22:14:15 +0000 UTC" firstStartedPulling="2026-05-23 22:14:16.339968273 +0000 UTC m=+559.945143655" lastFinishedPulling="2026-05-23 22:14:18.5989239 +0000 UTC m=+562.204099285" observedRunningTime="2026-05-23 22:14:19.577435416 +0000 UTC m=+563.182610820" watchObservedRunningTime="2026-05-23 22:14:19.579282635 +0000 UTC m=+563.184458039" May 23 22:14:27.547410 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:27.547375 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:29.032737 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.032685 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v"] May 23 22:14:29.035833 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.035817 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" May 23 22:14:29.052683 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.052633 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v"] May 23 22:14:29.171053 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.171016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djzkv\" (UniqueName: \"kubernetes.io/projected/1941515e-1206-459a-892b-11abc3df36ac-kube-api-access-djzkv\") pod \"kuadrant-operator-controller-manager-84b657d985-vh92v\" (UID: \"1941515e-1206-459a-892b-11abc3df36ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" May 23 22:14:29.171248 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.171083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1941515e-1206-459a-892b-11abc3df36ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-vh92v\" (UID: \"1941515e-1206-459a-892b-11abc3df36ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" May 23 22:14:29.233183 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.233148 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq"] May 23 22:14:29.233410 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.233385 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" containerName="manager" containerID="cri-o://9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2" gracePeriod=2 May 23 22:14:29.241548 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.241507 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq"] May 23 22:14:29.258910 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.258887 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v"] May 23 22:14:29.259132 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:14:29.259102 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-djzkv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" podUID="1941515e-1206-459a-892b-11abc3df36ac" May 23 22:14:29.270649 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.270619 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v"] May 23 22:14:29.271758 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.271700 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1941515e-1206-459a-892b-11abc3df36ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-vh92v\" (UID: \"1941515e-1206-459a-892b-11abc3df36ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" May 23 22:14:29.271876 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.271782 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djzkv\" (UniqueName: \"kubernetes.io/projected/1941515e-1206-459a-892b-11abc3df36ac-kube-api-access-djzkv\") pod \"kuadrant-operator-controller-manager-84b657d985-vh92v\" (UID: \"1941515e-1206-459a-892b-11abc3df36ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" May 23 22:14:29.272370 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.272345 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1941515e-1206-459a-892b-11abc3df36ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-vh92v\" (UID: \"1941515e-1206-459a-892b-11abc3df36ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" May 23 22:14:29.272477 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.272442 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc"] May 23 22:14:29.272859 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.272840 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" containerName="manager" May 23 22:14:29.272939 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.272861 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" containerName="manager" May 23 22:14:29.272980 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.272953 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" containerName="manager" May 23 22:14:29.275886 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:14:29.275865 2556 projected.go:194] Error preparing data for projected volume kube-api-access-djzkv for pod kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v: failed to fetch token: pod "kuadrant-operator-controller-manager-84b657d985-vh92v" not found May 23 22:14:29.275993 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:14:29.275933 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1941515e-1206-459a-892b-11abc3df36ac-kube-api-access-djzkv podName:1941515e-1206-459a-892b-11abc3df36ac nodeName:}" failed. No retries permitted until 2026-05-23 22:14:29.775918392 +0000 UTC m=+573.381093774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-djzkv" (UniqueName: "kubernetes.io/projected/1941515e-1206-459a-892b-11abc3df36ac-kube-api-access-djzkv") pod "kuadrant-operator-controller-manager-84b657d985-vh92v" (UID: "1941515e-1206-459a-892b-11abc3df36ac") : failed to fetch token: pod "kuadrant-operator-controller-manager-84b657d985-vh92v" not found May 23 22:14:29.276091 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.276075 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:29.291930 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.291859 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc"] May 23 22:14:29.318837 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.318798 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.320798 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.320773 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6"] May 23 22:14:29.323908 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.323887 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:29.326019 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.325996 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.342952 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.342924 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6"] May 23 22:14:29.372406 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.372372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3972f4f-189a-4d80-9b56-0b63cbb75f06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-52ggc\" (UID: \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:29.372577 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.372424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6prn7\" (UniqueName: \"kubernetes.io/projected/b3972f4f-189a-4d80-9b56-0b63cbb75f06-kube-api-access-6prn7\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-52ggc\" (UID: \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:29.472900 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.472872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca307595-31e4-41b8-b3ab-5c9d0490cd64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9lps6\" (UID: \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:29.473042 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.472952 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3972f4f-189a-4d80-9b56-0b63cbb75f06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-52ggc\" (UID: \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:29.473101 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.473032 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6prn7\" (UniqueName: \"kubernetes.io/projected/b3972f4f-189a-4d80-9b56-0b63cbb75f06-kube-api-access-6prn7\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-52ggc\" (UID: \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:29.473159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.473107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rllss\" (UniqueName: \"kubernetes.io/projected/ca307595-31e4-41b8-b3ab-5c9d0490cd64-kube-api-access-rllss\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9lps6\" (UID: \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:29.473333 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.473313 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3972f4f-189a-4d80-9b56-0b63cbb75f06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-52ggc\" (UID: \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:29.477458 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.477444 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:29.480193 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.480173 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.482338 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.482319 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6prn7\" (UniqueName: \"kubernetes.io/projected/b3972f4f-189a-4d80-9b56-0b63cbb75f06-kube-api-access-6prn7\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-52ggc\" (UID: \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:29.573489 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.573398 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqmw9\" (UniqueName: \"kubernetes.io/projected/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-kube-api-access-mqmw9\") pod \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\" (UID: \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\") " May 23 22:14:29.573632 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.573498 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-extensions-socket-volume\") pod \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\" (UID: \"b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd\") " May 23 22:14:29.573632 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.573559 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca307595-31e4-41b8-b3ab-5c9d0490cd64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9lps6\" (UID: \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:29.573738 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.573631 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rllss\" (UniqueName: \"kubernetes.io/projected/ca307595-31e4-41b8-b3ab-5c9d0490cd64-kube-api-access-rllss\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9lps6\" (UID: \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:29.574002 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.573981 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca307595-31e4-41b8-b3ab-5c9d0490cd64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9lps6\" (UID: \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:29.574081 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.574011 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" (UID: "b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 23 22:14:29.575720 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.575694 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-kube-api-access-mqmw9" (OuterVolumeSpecName: "kube-api-access-mqmw9") pod "b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" (UID: "b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd"). InnerVolumeSpecName "kube-api-access-mqmw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 23 22:14:29.581900 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.581882 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rllss\" (UniqueName: \"kubernetes.io/projected/ca307595-31e4-41b8-b3ab-5c9d0490cd64-kube-api-access-rllss\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9lps6\" (UID: \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:29.588159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.588136 2556 generic.go:358] "Generic (PLEG): container finished" podID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" containerID="9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2" exitCode=0 May 23 22:14:29.588256 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.588187 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" May 23 22:14:29.588256 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.588227 2556 scope.go:117] "RemoveContainer" containerID="9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2" May 23 22:14:29.588405 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.588388 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" May 23 22:14:29.590416 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.590384 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.592458 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.592432 2556 status_manager.go:895] "Failed to get status for pod" podUID="1941515e-1206-459a-892b-11abc3df36ac" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" err="pods \"kuadrant-operator-controller-manager-84b657d985-vh92v\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.593138 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.593118 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" May 23 22:14:29.594402 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.594368 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.596437 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.596330 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.596437 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.596351 2556 scope.go:117] "RemoveContainer" containerID="9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2" May 23 22:14:29.596628 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:14:29.596599 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2\": container with ID starting with 9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2 not found: ID does not exist" containerID="9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2" May 23 22:14:29.596725 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.596631 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2"} err="failed to get container status \"9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2\": rpc error: code = NotFound desc = could not find container \"9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2\": container with ID starting with 9c2d45844eab51826f0de7fb1f86114de8e0d441e9b2af03aaf95a012ee710e2 not found: ID does not exist" May 23 22:14:29.598215 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.598195 2556 status_manager.go:895] "Failed to get status for pod" podUID="1941515e-1206-459a-892b-11abc3df36ac" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" err="pods \"kuadrant-operator-controller-manager-84b657d985-vh92v\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.600007 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.599988 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.601822 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.601804 2556 status_manager.go:895] "Failed to get status for pod" podUID="1941515e-1206-459a-892b-11abc3df36ac" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" err="pods \"kuadrant-operator-controller-manager-84b657d985-vh92v\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:29.613025 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.612991 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:29.632702 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.632644 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:29.674212 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.674185 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1941515e-1206-459a-892b-11abc3df36ac-extensions-socket-volume\") pod \"1941515e-1206-459a-892b-11abc3df36ac\" (UID: \"1941515e-1206-459a-892b-11abc3df36ac\") " May 23 22:14:29.674393 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.674376 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqmw9\" (UniqueName: \"kubernetes.io/projected/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-kube-api-access-mqmw9\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:14:29.674452 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.674401 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djzkv\" (UniqueName: \"kubernetes.io/projected/1941515e-1206-459a-892b-11abc3df36ac-kube-api-access-djzkv\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:14:29.674452 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.674415 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd-extensions-socket-volume\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:14:29.674452 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.674418 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1941515e-1206-459a-892b-11abc3df36ac-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1941515e-1206-459a-892b-11abc3df36ac" (UID: "1941515e-1206-459a-892b-11abc3df36ac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 23 22:14:29.775228 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.775197 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1941515e-1206-459a-892b-11abc3df36ac-extensions-socket-volume\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:14:29.790169 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.790110 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc"] May 23 22:14:29.792805 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:14:29.792781 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3972f4f_189a_4d80_9b56_0b63cbb75f06.slice/crio-269fe9aa27da4e9a08817e59ebabb104ceab5bb74b0ba413cf0e9022b0a11b6d WatchSource:0}: Error finding container 269fe9aa27da4e9a08817e59ebabb104ceab5bb74b0ba413cf0e9022b0a11b6d: Status 404 returned error can't find the container with id 269fe9aa27da4e9a08817e59ebabb104ceab5bb74b0ba413cf0e9022b0a11b6d May 23 22:14:29.822629 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:29.822598 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6"] May 23 22:14:29.823732 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:14:29.823684 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca307595_31e4_41b8_b3ab_5c9d0490cd64.slice/crio-5a893c72c60e203a8bb4c80a897315e4058b9a4f8d66e540e5cf0de82ce37955 WatchSource:0}: Error finding container 5a893c72c60e203a8bb4c80a897315e4058b9a4f8d66e540e5cf0de82ce37955: Status 404 returned error can't find the container with id 5a893c72c60e203a8bb4c80a897315e4058b9a4f8d66e540e5cf0de82ce37955 May 23 22:14:30.558797 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.558769 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ldd99" May 23 22:14:30.560929 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.560902 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:30.583307 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.583272 2556 status_manager.go:895] "Failed to get status for pod" podUID="1941515e-1206-459a-892b-11abc3df36ac" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" err="pods \"kuadrant-operator-controller-manager-84b657d985-vh92v\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:30.594384 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.594193 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" event={"ID":"b3972f4f-189a-4d80-9b56-0b63cbb75f06","Type":"ContainerStarted","Data":"fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1"} May 23 22:14:30.594384 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.594270 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" event={"ID":"b3972f4f-189a-4d80-9b56-0b63cbb75f06","Type":"ContainerStarted","Data":"269fe9aa27da4e9a08817e59ebabb104ceab5bb74b0ba413cf0e9022b0a11b6d"} May 23 22:14:30.594384 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.594310 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:30.595930 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.595903 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" event={"ID":"ca307595-31e4-41b8-b3ab-5c9d0490cd64","Type":"ContainerStarted","Data":"1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e"} May 23 22:14:30.596070 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.595934 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" event={"ID":"ca307595-31e4-41b8-b3ab-5c9d0490cd64","Type":"ContainerStarted","Data":"5a893c72c60e203a8bb4c80a897315e4058b9a4f8d66e540e5cf0de82ce37955"} May 23 22:14:30.596070 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.595980 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:30.596825 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.596795 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" May 23 22:14:30.618901 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.618833 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" podStartSLOduration=1.618813413 podStartE2EDuration="1.618813413s" podCreationTimestamp="2026-05-23 22:14:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:14:30.618200369 +0000 UTC m=+574.223375788" watchObservedRunningTime="2026-05-23 22:14:30.618813413 +0000 UTC m=+574.223988817" May 23 22:14:30.620392 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.620362 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:30.623854 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.623689 2556 status_manager.go:895] "Failed to get status for pod" podUID="1941515e-1206-459a-892b-11abc3df36ac" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" err="pods \"kuadrant-operator-controller-manager-84b657d985-vh92v\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:30.646891 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.646835 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" podStartSLOduration=1.646817525 podStartE2EDuration="1.646817525s" podCreationTimestamp="2026-05-23 22:14:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:14:30.6458125 +0000 UTC m=+574.250987907" watchObservedRunningTime="2026-05-23 22:14:30.646817525 +0000 UTC m=+574.251992929" May 23 22:14:30.647922 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.647897 2556 status_manager.go:895] "Failed to get status for pod" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n2sgq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n2sgq\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:30.650210 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.650185 2556 status_manager.go:895] "Failed to get status for pod" podUID="1941515e-1206-459a-892b-11abc3df36ac" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-vh92v" err="pods \"kuadrant-operator-controller-manager-84b657d985-vh92v\" is forbidden: User \"system:node:ip-10-0-131-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-208.ec2.internal' and this object" May 23 22:14:30.976322 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.976278 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1941515e-1206-459a-892b-11abc3df36ac" path="/var/lib/kubelet/pods/1941515e-1206-459a-892b-11abc3df36ac/volumes" May 23 22:14:30.976648 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:30.976630 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd" path="/var/lib/kubelet/pods/b01449c3-cdfd-4f90-b15d-6abfbd0f2fbd/volumes" May 23 22:14:41.601996 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:41.601965 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:41.602448 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:41.602017 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:14:41.675934 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:41.675899 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc"] May 23 22:14:41.676149 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:41.676108 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" podUID="b3972f4f-189a-4d80-9b56-0b63cbb75f06" containerName="manager" containerID="cri-o://fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1" gracePeriod=10 May 23 22:14:41.918031 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:41.918008 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:42.069190 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.069154 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6prn7\" (UniqueName: \"kubernetes.io/projected/b3972f4f-189a-4d80-9b56-0b63cbb75f06-kube-api-access-6prn7\") pod \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\" (UID: \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\") " May 23 22:14:42.069357 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.069213 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3972f4f-189a-4d80-9b56-0b63cbb75f06-extensions-socket-volume\") pod \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\" (UID: \"b3972f4f-189a-4d80-9b56-0b63cbb75f06\") " May 23 22:14:42.069621 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.069587 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3972f4f-189a-4d80-9b56-0b63cbb75f06-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b3972f4f-189a-4d80-9b56-0b63cbb75f06" (UID: "b3972f4f-189a-4d80-9b56-0b63cbb75f06"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 23 22:14:42.071238 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.071217 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3972f4f-189a-4d80-9b56-0b63cbb75f06-kube-api-access-6prn7" (OuterVolumeSpecName: "kube-api-access-6prn7") pod "b3972f4f-189a-4d80-9b56-0b63cbb75f06" (UID: "b3972f4f-189a-4d80-9b56-0b63cbb75f06"). InnerVolumeSpecName "kube-api-access-6prn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 23 22:14:42.169869 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.169776 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6prn7\" (UniqueName: \"kubernetes.io/projected/b3972f4f-189a-4d80-9b56-0b63cbb75f06-kube-api-access-6prn7\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:14:42.169869 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.169817 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3972f4f-189a-4d80-9b56-0b63cbb75f06-extensions-socket-volume\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:14:42.634878 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.634842 2556 generic.go:358] "Generic (PLEG): container finished" podID="b3972f4f-189a-4d80-9b56-0b63cbb75f06" containerID="fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1" exitCode=0 May 23 22:14:42.635309 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.634903 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" May 23 22:14:42.635309 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.634902 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" event={"ID":"b3972f4f-189a-4d80-9b56-0b63cbb75f06","Type":"ContainerDied","Data":"fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1"} May 23 22:14:42.635309 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.635002 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc" event={"ID":"b3972f4f-189a-4d80-9b56-0b63cbb75f06","Type":"ContainerDied","Data":"269fe9aa27da4e9a08817e59ebabb104ceab5bb74b0ba413cf0e9022b0a11b6d"} May 23 22:14:42.635309 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.635016 2556 scope.go:117] "RemoveContainer" containerID="fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1" May 23 22:14:42.643050 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.643020 2556 scope.go:117] "RemoveContainer" containerID="fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1" May 23 22:14:42.643285 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:14:42.643253 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1\": container with ID starting with fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1 not found: ID does not exist" containerID="fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1" May 23 22:14:42.643364 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.643290 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1"} err="failed to get container status \"fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1\": rpc error: code = NotFound desc = could not find container \"fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1\": container with ID starting with fbb60cc09032a55c4391732c1dad5b17470ae8468030baab874f852ddc8531e1 not found: ID does not exist" May 23 22:14:42.656033 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.656006 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc"] May 23 22:14:42.664363 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.662798 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-52ggc"] May 23 22:14:42.974895 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:42.974860 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3972f4f-189a-4d80-9b56-0b63cbb75f06" path="/var/lib/kubelet/pods/b3972f4f-189a-4d80-9b56-0b63cbb75f06/volumes" May 23 22:14:56.903320 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:56.903297 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:14:56.903779 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:14:56.903512 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:15:01.712476 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.712440 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-lf4wp"] May 23 22:15:01.712869 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.712730 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3972f4f-189a-4d80-9b56-0b63cbb75f06" containerName="manager" May 23 22:15:01.712869 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.712741 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3972f4f-189a-4d80-9b56-0b63cbb75f06" containerName="manager" May 23 22:15:01.712869 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.712790 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3972f4f-189a-4d80-9b56-0b63cbb75f06" containerName="manager" May 23 22:15:01.721734 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.721218 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:01.723542 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.723514 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-lf4wp"] May 23 22:15:01.723713 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.723654 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 23 22:15:01.723788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.723727 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wvmxv\"" May 23 22:15:01.814232 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.814198 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-lf4wp"] May 23 22:15:01.821600 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.821568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-config-file\") pod \"limitador-limitador-7d549b5b-lf4wp\" (UID: \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:01.821744 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.821615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v42jw\" (UniqueName: \"kubernetes.io/projected/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-kube-api-access-v42jw\") pod \"limitador-limitador-7d549b5b-lf4wp\" (UID: \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:01.923020 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.922988 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-config-file\") pod \"limitador-limitador-7d549b5b-lf4wp\" (UID: \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:01.923190 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.923026 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v42jw\" (UniqueName: \"kubernetes.io/projected/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-kube-api-access-v42jw\") pod \"limitador-limitador-7d549b5b-lf4wp\" (UID: \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:01.923631 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.923609 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-config-file\") pod \"limitador-limitador-7d549b5b-lf4wp\" (UID: \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:01.931921 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:01.931895 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v42jw\" (UniqueName: \"kubernetes.io/projected/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-kube-api-access-v42jw\") pod \"limitador-limitador-7d549b5b-lf4wp\" (UID: \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:02.032717 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:02.032636 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:02.159937 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:02.159875 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-lf4wp"] May 23 22:15:02.162538 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:15:02.162509 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb15166f_9f64_4dbd_a4b2_77555c62ce1b.slice/crio-53fe392a0da768baa463eaec61d59ffa9423a221315a834246067a8a4c29e086 WatchSource:0}: Error finding container 53fe392a0da768baa463eaec61d59ffa9423a221315a834246067a8a4c29e086: Status 404 returned error can't find the container with id 53fe392a0da768baa463eaec61d59ffa9423a221315a834246067a8a4c29e086 May 23 22:15:02.700137 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:02.700098 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" event={"ID":"bb15166f-9f64-4dbd-a4b2-77555c62ce1b","Type":"ContainerStarted","Data":"53fe392a0da768baa463eaec61d59ffa9423a221315a834246067a8a4c29e086"} May 23 22:15:05.712936 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:05.712900 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" event={"ID":"bb15166f-9f64-4dbd-a4b2-77555c62ce1b","Type":"ContainerStarted","Data":"015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d"} May 23 22:15:05.713310 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:05.713012 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:05.730035 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:05.729993 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" podStartSLOduration=2.028451352 podStartE2EDuration="4.729981263s" podCreationTimestamp="2026-05-23 22:15:01 +0000 UTC" firstStartedPulling="2026-05-23 22:15:02.16432961 +0000 UTC m=+605.769504999" lastFinishedPulling="2026-05-23 22:15:04.865859529 +0000 UTC m=+608.471034910" observedRunningTime="2026-05-23 22:15:05.729001524 +0000 UTC m=+609.334176930" watchObservedRunningTime="2026-05-23 22:15:05.729981263 +0000 UTC m=+609.335156667" May 23 22:15:16.178012 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.177964 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-lf4wp"] May 23 22:15:16.178504 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.178215 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" podUID="bb15166f-9f64-4dbd-a4b2-77555c62ce1b" containerName="limitador" containerID="cri-o://015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d" gracePeriod=30 May 23 22:15:16.178910 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.178891 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:16.718812 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.718788 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:16.748509 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.748352 2556 generic.go:358] "Generic (PLEG): container finished" podID="bb15166f-9f64-4dbd-a4b2-77555c62ce1b" containerID="015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d" exitCode=0 May 23 22:15:16.748509 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.748502 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" May 23 22:15:16.748709 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.748480 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" event={"ID":"bb15166f-9f64-4dbd-a4b2-77555c62ce1b","Type":"ContainerDied","Data":"015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d"} May 23 22:15:16.748709 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.748621 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-lf4wp" event={"ID":"bb15166f-9f64-4dbd-a4b2-77555c62ce1b","Type":"ContainerDied","Data":"53fe392a0da768baa463eaec61d59ffa9423a221315a834246067a8a4c29e086"} May 23 22:15:16.748709 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.748646 2556 scope.go:117] "RemoveContainer" containerID="015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d" May 23 22:15:16.757001 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.756981 2556 scope.go:117] "RemoveContainer" containerID="015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d" May 23 22:15:16.757278 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:15:16.757255 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d\": container with ID starting with 015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d not found: ID does not exist" containerID="015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d" May 23 22:15:16.757386 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.757285 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d"} err="failed to get container status \"015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d\": rpc error: code = NotFound desc = could not find container \"015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d\": container with ID starting with 015d3ea68efbd8243713bf9199a5a74d31a8278798071c92088de0045743943d not found: ID does not exist" May 23 22:15:16.840197 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.840168 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-config-file\") pod \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\" (UID: \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\") " May 23 22:15:16.840361 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.840213 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v42jw\" (UniqueName: \"kubernetes.io/projected/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-kube-api-access-v42jw\") pod \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\" (UID: \"bb15166f-9f64-4dbd-a4b2-77555c62ce1b\") " May 23 22:15:16.840547 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.840524 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-config-file" (OuterVolumeSpecName: "config-file") pod "bb15166f-9f64-4dbd-a4b2-77555c62ce1b" (UID: "bb15166f-9f64-4dbd-a4b2-77555c62ce1b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 23 22:15:16.842231 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.842203 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-kube-api-access-v42jw" (OuterVolumeSpecName: "kube-api-access-v42jw") pod "bb15166f-9f64-4dbd-a4b2-77555c62ce1b" (UID: "bb15166f-9f64-4dbd-a4b2-77555c62ce1b"). InnerVolumeSpecName "kube-api-access-v42jw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 23 22:15:16.940732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.940693 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-config-file\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:15:16.940732 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:16.940726 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v42jw\" (UniqueName: \"kubernetes.io/projected/bb15166f-9f64-4dbd-a4b2-77555c62ce1b-kube-api-access-v42jw\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:15:17.064795 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.064690 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-lf4wp"] May 23 22:15:17.066451 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.066428 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-lf4wp"] May 23 22:15:17.816884 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.816851 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-kmvsn"] May 23 22:15:17.817327 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.817243 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb15166f-9f64-4dbd-a4b2-77555c62ce1b" containerName="limitador" May 23 22:15:17.817327 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.817260 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb15166f-9f64-4dbd-a4b2-77555c62ce1b" containerName="limitador" May 23 22:15:17.817435 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.817348 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb15166f-9f64-4dbd-a4b2-77555c62ce1b" containerName="limitador" May 23 22:15:17.821614 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.821595 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:17.823726 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.823703 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-76f7b\"" May 23 22:15:17.823847 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.823703 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 23 22:15:17.827596 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.827558 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-kmvsn"] May 23 22:15:17.949711 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.949648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ffd2b956-889c-45e6-87a5-f0b8137d71df-data\") pod \"postgres-68c4fbbd6f-kmvsn\" (UID: \"ffd2b956-889c-45e6-87a5-f0b8137d71df\") " pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:17.949858 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:17.949717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9xc\" (UniqueName: \"kubernetes.io/projected/ffd2b956-889c-45e6-87a5-f0b8137d71df-kube-api-access-9t9xc\") pod \"postgres-68c4fbbd6f-kmvsn\" (UID: \"ffd2b956-889c-45e6-87a5-f0b8137d71df\") " pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:18.050715 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:18.050677 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ffd2b956-889c-45e6-87a5-f0b8137d71df-data\") pod \"postgres-68c4fbbd6f-kmvsn\" (UID: \"ffd2b956-889c-45e6-87a5-f0b8137d71df\") " pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:18.050715 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:18.050719 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9xc\" (UniqueName: \"kubernetes.io/projected/ffd2b956-889c-45e6-87a5-f0b8137d71df-kube-api-access-9t9xc\") pod \"postgres-68c4fbbd6f-kmvsn\" (UID: \"ffd2b956-889c-45e6-87a5-f0b8137d71df\") " pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:18.051070 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:18.051049 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ffd2b956-889c-45e6-87a5-f0b8137d71df-data\") pod \"postgres-68c4fbbd6f-kmvsn\" (UID: \"ffd2b956-889c-45e6-87a5-f0b8137d71df\") " pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:18.060370 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:18.060343 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9xc\" (UniqueName: \"kubernetes.io/projected/ffd2b956-889c-45e6-87a5-f0b8137d71df-kube-api-access-9t9xc\") pod \"postgres-68c4fbbd6f-kmvsn\" (UID: \"ffd2b956-889c-45e6-87a5-f0b8137d71df\") " pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:18.132856 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:18.132768 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:18.255557 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:18.255532 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-kmvsn"] May 23 22:15:18.257997 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:15:18.257967 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd2b956_889c_45e6_87a5_f0b8137d71df.slice/crio-246072f3a4df642b840bd9039160e3569632dd68c483ac7b09d2339acce19505 WatchSource:0}: Error finding container 246072f3a4df642b840bd9039160e3569632dd68c483ac7b09d2339acce19505: Status 404 returned error can't find the container with id 246072f3a4df642b840bd9039160e3569632dd68c483ac7b09d2339acce19505 May 23 22:15:18.757380 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:18.757343 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-kmvsn" event={"ID":"ffd2b956-889c-45e6-87a5-f0b8137d71df","Type":"ContainerStarted","Data":"246072f3a4df642b840bd9039160e3569632dd68c483ac7b09d2339acce19505"} May 23 22:15:18.977605 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:18.977242 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb15166f-9f64-4dbd-a4b2-77555c62ce1b" path="/var/lib/kubelet/pods/bb15166f-9f64-4dbd-a4b2-77555c62ce1b/volumes" May 23 22:15:23.774458 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:23.774423 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-kmvsn" event={"ID":"ffd2b956-889c-45e6-87a5-f0b8137d71df","Type":"ContainerStarted","Data":"8c789dc2d8ebb626e8e8efe78f458bfd7da0f79ef78044eda6e666eec6a77141"} May 23 22:15:23.774867 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:23.774508 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:23.796261 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:23.796214 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-kmvsn" podStartSLOduration=2.194105091 podStartE2EDuration="6.796202113s" podCreationTimestamp="2026-05-23 22:15:17 +0000 UTC" firstStartedPulling="2026-05-23 22:15:18.25932922 +0000 UTC m=+621.864504602" lastFinishedPulling="2026-05-23 22:15:22.861426242 +0000 UTC m=+626.466601624" observedRunningTime="2026-05-23 22:15:23.79564396 +0000 UTC m=+627.400819365" watchObservedRunningTime="2026-05-23 22:15:23.796202113 +0000 UTC m=+627.401377517" May 23 22:15:29.805623 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:29.805586 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-kmvsn" May 23 22:15:35.483089 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.483057 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b7f66fc88-sqfg6"] May 23 22:15:35.551696 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.551649 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b7f66fc88-sqfg6"] May 23 22:15:35.551820 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.551801 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" May 23 22:15:35.554221 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.554201 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 23 22:15:35.554346 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.554201 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hsbt9\"" May 23 22:15:35.613059 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.613031 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-659745fdd9-hztfp"] May 23 22:15:35.647026 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.646995 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659745fdd9-hztfp"] May 23 22:15:35.647150 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.647050 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659745fdd9-hztfp" May 23 22:15:35.696477 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.696450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gmml\" (UniqueName: \"kubernetes.io/projected/dd5a892d-835f-4ec6-8866-d7b331970221-kube-api-access-5gmml\") pod \"maas-controller-5b7f66fc88-sqfg6\" (UID: \"dd5a892d-835f-4ec6-8866-d7b331970221\") " pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" May 23 22:15:35.797615 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.797539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx6xp\" (UniqueName: \"kubernetes.io/projected/523442a5-705a-4e4c-a653-341b666855c8-kube-api-access-mx6xp\") pod \"maas-controller-659745fdd9-hztfp\" (UID: \"523442a5-705a-4e4c-a653-341b666855c8\") " pod="opendatahub/maas-controller-659745fdd9-hztfp" May 23 22:15:35.797615 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.797590 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gmml\" (UniqueName: \"kubernetes.io/projected/dd5a892d-835f-4ec6-8866-d7b331970221-kube-api-access-5gmml\") pod \"maas-controller-5b7f66fc88-sqfg6\" (UID: \"dd5a892d-835f-4ec6-8866-d7b331970221\") " pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" May 23 22:15:35.806345 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.806308 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gmml\" (UniqueName: \"kubernetes.io/projected/dd5a892d-835f-4ec6-8866-d7b331970221-kube-api-access-5gmml\") pod \"maas-controller-5b7f66fc88-sqfg6\" (UID: \"dd5a892d-835f-4ec6-8866-d7b331970221\") " pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" May 23 22:15:35.861479 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.861438 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" May 23 22:15:35.899066 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.899029 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mx6xp\" (UniqueName: \"kubernetes.io/projected/523442a5-705a-4e4c-a653-341b666855c8-kube-api-access-mx6xp\") pod \"maas-controller-659745fdd9-hztfp\" (UID: \"523442a5-705a-4e4c-a653-341b666855c8\") " pod="opendatahub/maas-controller-659745fdd9-hztfp" May 23 22:15:35.909086 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.909055 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx6xp\" (UniqueName: \"kubernetes.io/projected/523442a5-705a-4e4c-a653-341b666855c8-kube-api-access-mx6xp\") pod \"maas-controller-659745fdd9-hztfp\" (UID: \"523442a5-705a-4e4c-a653-341b666855c8\") " pod="opendatahub/maas-controller-659745fdd9-hztfp" May 23 22:15:35.956996 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.956963 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659745fdd9-hztfp" May 23 22:15:35.993511 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:35.993479 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b7f66fc88-sqfg6"] May 23 22:15:35.997948 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:15:35.997916 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5a892d_835f_4ec6_8866_d7b331970221.slice/crio-af076d54b5b05df169da0062ac141e20b487bbdcb40516cd144d02463a95ee23 WatchSource:0}: Error finding container af076d54b5b05df169da0062ac141e20b487bbdcb40516cd144d02463a95ee23: Status 404 returned error can't find the container with id af076d54b5b05df169da0062ac141e20b487bbdcb40516cd144d02463a95ee23 May 23 22:15:36.086474 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:36.086400 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659745fdd9-hztfp"] May 23 22:15:36.089348 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:15:36.089325 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523442a5_705a_4e4c_a653_341b666855c8.slice/crio-2e074134d8460f82f3970b5f892d62898a818154fcd2c5beda61e384f0cc72df WatchSource:0}: Error finding container 2e074134d8460f82f3970b5f892d62898a818154fcd2c5beda61e384f0cc72df: Status 404 returned error can't find the container with id 2e074134d8460f82f3970b5f892d62898a818154fcd2c5beda61e384f0cc72df May 23 22:15:36.821371 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:36.821159 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" event={"ID":"dd5a892d-835f-4ec6-8866-d7b331970221","Type":"ContainerStarted","Data":"af076d54b5b05df169da0062ac141e20b487bbdcb40516cd144d02463a95ee23"} May 23 22:15:36.823716 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:36.823626 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659745fdd9-hztfp" event={"ID":"523442a5-705a-4e4c-a653-341b666855c8","Type":"ContainerStarted","Data":"2e074134d8460f82f3970b5f892d62898a818154fcd2c5beda61e384f0cc72df"} May 23 22:15:39.838407 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:39.838370 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" event={"ID":"dd5a892d-835f-4ec6-8866-d7b331970221","Type":"ContainerStarted","Data":"5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01"} May 23 22:15:39.838865 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:39.838442 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" May 23 22:15:39.839626 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:39.839605 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659745fdd9-hztfp" event={"ID":"523442a5-705a-4e4c-a653-341b666855c8","Type":"ContainerStarted","Data":"70965803648bea5a1c821c62c281e489b3185563e81135fa31525ec1d6dc814c"} May 23 22:15:39.839790 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:39.839777 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-659745fdd9-hztfp" May 23 22:15:39.858783 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:39.858732 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" podStartSLOduration=1.8962524649999999 podStartE2EDuration="4.858717772s" podCreationTimestamp="2026-05-23 22:15:35 +0000 UTC" firstStartedPulling="2026-05-23 22:15:35.999088841 +0000 UTC m=+639.604264223" lastFinishedPulling="2026-05-23 22:15:38.961554145 +0000 UTC m=+642.566729530" observedRunningTime="2026-05-23 22:15:39.85616234 +0000 UTC m=+643.461337746" watchObservedRunningTime="2026-05-23 22:15:39.858717772 +0000 UTC m=+643.463893178" May 23 22:15:39.874802 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:39.874755 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-659745fdd9-hztfp" podStartSLOduration=1.9936194999999999 podStartE2EDuration="4.874743649s" podCreationTimestamp="2026-05-23 22:15:35 +0000 UTC" firstStartedPulling="2026-05-23 22:15:36.090605694 +0000 UTC m=+639.695781076" lastFinishedPulling="2026-05-23 22:15:38.971729839 +0000 UTC m=+642.576905225" observedRunningTime="2026-05-23 22:15:39.874051374 +0000 UTC m=+643.479226778" watchObservedRunningTime="2026-05-23 22:15:39.874743649 +0000 UTC m=+643.479919054" May 23 22:15:50.848951 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:50.848923 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" May 23 22:15:50.849486 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:50.849466 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-659745fdd9-hztfp" May 23 22:15:50.911153 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:50.911124 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b7f66fc88-sqfg6"] May 23 22:15:50.911332 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:50.911313 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" podUID="dd5a892d-835f-4ec6-8866-d7b331970221" containerName="manager" containerID="cri-o://5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01" gracePeriod=30 May 23 22:15:51.153379 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.153356 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" May 23 22:15:51.219631 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.219604 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gmml\" (UniqueName: \"kubernetes.io/projected/dd5a892d-835f-4ec6-8866-d7b331970221-kube-api-access-5gmml\") pod \"dd5a892d-835f-4ec6-8866-d7b331970221\" (UID: \"dd5a892d-835f-4ec6-8866-d7b331970221\") " May 23 22:15:51.221701 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.221675 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd5a892d-835f-4ec6-8866-d7b331970221-kube-api-access-5gmml" (OuterVolumeSpecName: "kube-api-access-5gmml") pod "dd5a892d-835f-4ec6-8866-d7b331970221" (UID: "dd5a892d-835f-4ec6-8866-d7b331970221"). InnerVolumeSpecName "kube-api-access-5gmml". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 23 22:15:51.320413 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.320378 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gmml\" (UniqueName: \"kubernetes.io/projected/dd5a892d-835f-4ec6-8866-d7b331970221-kube-api-access-5gmml\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:15:51.882334 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.882293 2556 generic.go:358] "Generic (PLEG): container finished" podID="dd5a892d-835f-4ec6-8866-d7b331970221" containerID="5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01" exitCode=0 May 23 22:15:51.882847 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.882362 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" May 23 22:15:51.882847 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.882381 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" event={"ID":"dd5a892d-835f-4ec6-8866-d7b331970221","Type":"ContainerDied","Data":"5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01"} May 23 22:15:51.882847 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.882430 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b7f66fc88-sqfg6" event={"ID":"dd5a892d-835f-4ec6-8866-d7b331970221","Type":"ContainerDied","Data":"af076d54b5b05df169da0062ac141e20b487bbdcb40516cd144d02463a95ee23"} May 23 22:15:51.882847 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.882454 2556 scope.go:117] "RemoveContainer" containerID="5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01" May 23 22:15:51.890366 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.890346 2556 scope.go:117] "RemoveContainer" containerID="5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01" May 23 22:15:51.890654 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:15:51.890635 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01\": container with ID starting with 5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01 not found: ID does not exist" containerID="5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01" May 23 22:15:51.890752 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.890688 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01"} err="failed to get container status \"5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01\": rpc error: code = NotFound desc = could not find container \"5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01\": container with ID starting with 5b38658ed211404a24d3b360a3bcace3850cf0cf9b48d86def6558a5c91e2e01 not found: ID does not exist" May 23 22:15:51.903331 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.903310 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b7f66fc88-sqfg6"] May 23 22:15:51.907938 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:51.907920 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b7f66fc88-sqfg6"] May 23 22:15:52.974820 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:15:52.974788 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd5a892d-835f-4ec6-8866-d7b331970221" path="/var/lib/kubelet/pods/dd5a892d-835f-4ec6-8866-d7b331970221/volumes" May 23 22:16:10.230312 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.230281 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8695c7d64c-78tvm"] May 23 22:16:10.230788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.230571 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd5a892d-835f-4ec6-8866-d7b331970221" containerName="manager" May 23 22:16:10.230788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.230583 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd5a892d-835f-4ec6-8866-d7b331970221" containerName="manager" May 23 22:16:10.230788 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.230636 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd5a892d-835f-4ec6-8866-d7b331970221" containerName="manager" May 23 22:16:10.235992 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.235971 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:10.238355 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.238338 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 23 22:16:10.238428 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.238382 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-b8w92\"" May 23 22:16:10.244161 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.244129 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8695c7d64c-78tvm"] May 23 22:16:10.257380 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.257359 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cda12eb2-3352-4540-b771-d58b7c13a3e6-maas-api-tls\") pod \"maas-api-8695c7d64c-78tvm\" (UID: \"cda12eb2-3352-4540-b771-d58b7c13a3e6\") " pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:10.257487 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.257407 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft7hn\" (UniqueName: \"kubernetes.io/projected/cda12eb2-3352-4540-b771-d58b7c13a3e6-kube-api-access-ft7hn\") pod \"maas-api-8695c7d64c-78tvm\" (UID: \"cda12eb2-3352-4540-b771-d58b7c13a3e6\") " pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:10.358028 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.357991 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cda12eb2-3352-4540-b771-d58b7c13a3e6-maas-api-tls\") pod \"maas-api-8695c7d64c-78tvm\" (UID: \"cda12eb2-3352-4540-b771-d58b7c13a3e6\") " pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:10.358206 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.358054 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft7hn\" (UniqueName: \"kubernetes.io/projected/cda12eb2-3352-4540-b771-d58b7c13a3e6-kube-api-access-ft7hn\") pod \"maas-api-8695c7d64c-78tvm\" (UID: \"cda12eb2-3352-4540-b771-d58b7c13a3e6\") " pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:10.360419 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.360397 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cda12eb2-3352-4540-b771-d58b7c13a3e6-maas-api-tls\") pod \"maas-api-8695c7d64c-78tvm\" (UID: \"cda12eb2-3352-4540-b771-d58b7c13a3e6\") " pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:10.367651 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.367629 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft7hn\" (UniqueName: \"kubernetes.io/projected/cda12eb2-3352-4540-b771-d58b7c13a3e6-kube-api-access-ft7hn\") pod \"maas-api-8695c7d64c-78tvm\" (UID: \"cda12eb2-3352-4540-b771-d58b7c13a3e6\") " pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:10.547010 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.546926 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:10.693457 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.693432 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8695c7d64c-78tvm"] May 23 22:16:10.696243 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:16:10.696210 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda12eb2_3352_4540_b771_d58b7c13a3e6.slice/crio-8e12aaedb21095fed7d32b88a5a9671a717611832a2bf2fe703d490ffc206df8 WatchSource:0}: Error finding container 8e12aaedb21095fed7d32b88a5a9671a717611832a2bf2fe703d490ffc206df8: Status 404 returned error can't find the container with id 8e12aaedb21095fed7d32b88a5a9671a717611832a2bf2fe703d490ffc206df8 May 23 22:16:10.947181 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:10.947144 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8695c7d64c-78tvm" event={"ID":"cda12eb2-3352-4540-b771-d58b7c13a3e6","Type":"ContainerStarted","Data":"8e12aaedb21095fed7d32b88a5a9671a717611832a2bf2fe703d490ffc206df8"} May 23 22:16:12.953862 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:12.953823 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8695c7d64c-78tvm" event={"ID":"cda12eb2-3352-4540-b771-d58b7c13a3e6","Type":"ContainerStarted","Data":"08a1489f9dcfcdd5c3dc517a6bf96b936c24865821dab6c1a6a3269718d982e8"} May 23 22:16:12.954232 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:12.953921 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:12.973712 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:12.973647 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-8695c7d64c-78tvm" podStartSLOduration=1.679130175 podStartE2EDuration="2.973633546s" podCreationTimestamp="2026-05-23 22:16:10 +0000 UTC" firstStartedPulling="2026-05-23 22:16:10.697470625 +0000 UTC m=+674.302646006" lastFinishedPulling="2026-05-23 22:16:11.991973986 +0000 UTC m=+675.597149377" observedRunningTime="2026-05-23 22:16:12.972264661 +0000 UTC m=+676.577440065" watchObservedRunningTime="2026-05-23 22:16:12.973633546 +0000 UTC m=+676.578808950" May 23 22:16:18.962235 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:18.962201 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8695c7d64c-78tvm" May 23 22:16:32.489293 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.489258 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm"] May 23 22:16:32.492910 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.492890 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.496040 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.496021 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6ncnt\"" May 23 22:16:32.496040 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.496033 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 23 22:16:32.496216 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.496052 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 23 22:16:32.496216 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.496069 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 23 22:16:32.509327 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.509302 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm"] May 23 22:16:32.633069 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.633032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.633223 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.633078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhqpc\" (UniqueName: \"kubernetes.io/projected/d6a53b79-d45e-4fab-a736-a144401938ac-kube-api-access-zhqpc\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.633223 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.633117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.633223 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.633190 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.633330 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.633233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6a53b79-d45e-4fab-a736-a144401938ac-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.633330 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.633257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.734488 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.734449 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.734488 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.734496 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhqpc\" (UniqueName: \"kubernetes.io/projected/d6a53b79-d45e-4fab-a736-a144401938ac-kube-api-access-zhqpc\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.734744 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.734531 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.734744 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.734569 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.734744 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.734725 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6a53b79-d45e-4fab-a736-a144401938ac-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.734915 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.734787 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.734982 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.734933 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.735054 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.735030 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.735159 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.735140 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.736854 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.736834 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6a53b79-d45e-4fab-a736-a144401938ac-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.737006 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.736988 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6a53b79-d45e-4fab-a736-a144401938ac-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.743420 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.743365 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhqpc\" (UniqueName: \"kubernetes.io/projected/d6a53b79-d45e-4fab-a736-a144401938ac-kube-api-access-zhqpc\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm\" (UID: \"d6a53b79-d45e-4fab-a736-a144401938ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.803464 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.803428 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:32.937058 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:32.937028 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm"] May 23 22:16:32.939756 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:16:32.939713 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a53b79_d45e_4fab_a736_a144401938ac.slice/crio-6d9419e8a6a230230667014d339dc9f95542e2aadbe56cbffd6631cc1a2b8b9d WatchSource:0}: Error finding container 6d9419e8a6a230230667014d339dc9f95542e2aadbe56cbffd6631cc1a2b8b9d: Status 404 returned error can't find the container with id 6d9419e8a6a230230667014d339dc9f95542e2aadbe56cbffd6631cc1a2b8b9d May 23 22:16:33.014837 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:33.014737 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" event={"ID":"d6a53b79-d45e-4fab-a736-a144401938ac","Type":"ContainerStarted","Data":"6d9419e8a6a230230667014d339dc9f95542e2aadbe56cbffd6631cc1a2b8b9d"} May 23 22:16:39.046558 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:39.046523 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" event={"ID":"d6a53b79-d45e-4fab-a736-a144401938ac","Type":"ContainerStarted","Data":"c90b56ab8a88da0313a423d9e6abbc1835ae188f8f9ace523755ce8614631394"} May 23 22:16:45.064339 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:45.064303 2556 generic.go:358] "Generic (PLEG): container finished" podID="d6a53b79-d45e-4fab-a736-a144401938ac" containerID="c90b56ab8a88da0313a423d9e6abbc1835ae188f8f9ace523755ce8614631394" exitCode=0 May 23 22:16:45.064753 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:45.064377 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" event={"ID":"d6a53b79-d45e-4fab-a736-a144401938ac","Type":"ContainerDied","Data":"c90b56ab8a88da0313a423d9e6abbc1835ae188f8f9ace523755ce8614631394"} May 23 22:16:46.767410 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.767372 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7"] May 23 22:16:46.770900 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.770877 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.773289 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.773265 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 23 22:16:46.781829 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.781800 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7"] May 23 22:16:46.867743 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.867706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.867743 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.867756 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.867957 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.867797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bftrk\" (UniqueName: \"kubernetes.io/projected/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-kube-api-access-bftrk\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.867957 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.867876 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.867957 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.867915 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.868129 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.867961 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.968925 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.968873 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.969091 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.968942 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.969091 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.969003 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bftrk\" (UniqueName: \"kubernetes.io/projected/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-kube-api-access-bftrk\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.969091 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.969048 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.969091 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.969075 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.969319 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.969114 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.969438 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.969415 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.969521 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.969447 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.969521 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.969505 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.971882 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.971848 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.972103 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.972084 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:46.976590 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:46.976563 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bftrk\" (UniqueName: \"kubernetes.io/projected/7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6-kube-api-access-bftrk\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-nljc7\" (UID: \"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:47.074694 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:47.074582 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" event={"ID":"d6a53b79-d45e-4fab-a736-a144401938ac","Type":"ContainerStarted","Data":"8c7a175cc06ca5eb90ff6a058b0ff3661b22f0fd4aa82549691c1bd2e8df876f"} May 23 22:16:47.074878 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:47.074825 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:16:47.082320 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:47.082298 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:47.095498 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:47.095419 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" podStartSLOduration=1.852287559 podStartE2EDuration="15.095365332s" podCreationTimestamp="2026-05-23 22:16:32 +0000 UTC" firstStartedPulling="2026-05-23 22:16:32.941544468 +0000 UTC m=+696.546719864" lastFinishedPulling="2026-05-23 22:16:46.184622247 +0000 UTC m=+709.789797637" observedRunningTime="2026-05-23 22:16:47.09392572 +0000 UTC m=+710.699101142" watchObservedRunningTime="2026-05-23 22:16:47.095365332 +0000 UTC m=+710.700540738" May 23 22:16:47.217328 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:47.217301 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7"] May 23 22:16:47.219136 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:16:47.219111 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbfdda0_c7c7_44aa_b509_6f4b812ff7e6.slice/crio-dcbd5216cd5ce8222882282b008fd933a39d2d82ff0cf83994e317e8b6797c98 WatchSource:0}: Error finding container dcbd5216cd5ce8222882282b008fd933a39d2d82ff0cf83994e317e8b6797c98: Status 404 returned error can't find the container with id dcbd5216cd5ce8222882282b008fd933a39d2d82ff0cf83994e317e8b6797c98 May 23 22:16:48.080861 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:48.080823 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" event={"ID":"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6","Type":"ContainerStarted","Data":"68feda435eae29193705e79ae5ad50327eceedb7acf5fe93e90a3013e0137986"} May 23 22:16:48.080861 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:48.080866 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" event={"ID":"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6","Type":"ContainerStarted","Data":"dcbd5216cd5ce8222882282b008fd933a39d2d82ff0cf83994e317e8b6797c98"} May 23 22:16:49.259709 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.259652 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4"] May 23 22:16:49.264505 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.264478 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.267125 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.267102 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 23 22:16:49.272922 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.272897 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4"] May 23 22:16:49.389003 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.388963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjt7r\" (UniqueName: \"kubernetes.io/projected/2e19573c-6791-4599-ba17-f6628901cf93-kube-api-access-tjt7r\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.389003 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.389016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.389267 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.389048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.389267 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.389070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.389267 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.389096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.389267 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.389118 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e19573c-6791-4599-ba17-f6628901cf93-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.490391 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.490349 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.490579 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.490406 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.490579 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.490439 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.490579 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.490470 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.490579 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.490492 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e19573c-6791-4599-ba17-f6628901cf93-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.490579 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.490517 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjt7r\" (UniqueName: \"kubernetes.io/projected/2e19573c-6791-4599-ba17-f6628901cf93-kube-api-access-tjt7r\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.491089 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.491063 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.491164 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.491126 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.491221 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.491162 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.492798 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.492771 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e19573c-6791-4599-ba17-f6628901cf93-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.493057 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.493039 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e19573c-6791-4599-ba17-f6628901cf93-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.501529 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.501501 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjt7r\" (UniqueName: \"kubernetes.io/projected/2e19573c-6791-4599-ba17-f6628901cf93-kube-api-access-tjt7r\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4\" (UID: \"2e19573c-6791-4599-ba17-f6628901cf93\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.575478 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.575390 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:49.726677 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.721695 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4"] May 23 22:16:49.732348 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:49.732326 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 23 22:16:50.091331 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:50.091290 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" event={"ID":"2e19573c-6791-4599-ba17-f6628901cf93","Type":"ContainerStarted","Data":"9ddf2830f42d673b2dab094da1a4e60a723b0fde2e824263166f279829551a40"} May 23 22:16:50.091331 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:50.091330 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" event={"ID":"2e19573c-6791-4599-ba17-f6628901cf93","Type":"ContainerStarted","Data":"e1d8c64bf4ebcfdd1bd4710bec64b823fcdeccb72df8795965722f73aba6f788"} May 23 22:16:53.108873 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:53.108784 2556 generic.go:358] "Generic (PLEG): container finished" podID="7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6" containerID="68feda435eae29193705e79ae5ad50327eceedb7acf5fe93e90a3013e0137986" exitCode=0 May 23 22:16:53.108873 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:53.108834 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" event={"ID":"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6","Type":"ContainerDied","Data":"68feda435eae29193705e79ae5ad50327eceedb7acf5fe93e90a3013e0137986"} May 23 22:16:54.114570 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:54.114537 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" event={"ID":"7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6","Type":"ContainerStarted","Data":"e9d84b61b52dc5602cb05d98da8fb2ac74136e55e73511d0377e7f898c3b3604"} May 23 22:16:54.114976 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:54.114811 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:16:54.135018 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:54.134969 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" podStartSLOduration=7.962349109 podStartE2EDuration="8.13495617s" podCreationTimestamp="2026-05-23 22:16:46 +0000 UTC" firstStartedPulling="2026-05-23 22:16:53.109547309 +0000 UTC m=+716.714722691" lastFinishedPulling="2026-05-23 22:16:53.282154366 +0000 UTC m=+716.887329752" observedRunningTime="2026-05-23 22:16:54.132610082 +0000 UTC m=+717.737785490" watchObservedRunningTime="2026-05-23 22:16:54.13495617 +0000 UTC m=+717.740131572" May 23 22:16:56.124395 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:56.123057 2556 generic.go:358] "Generic (PLEG): container finished" podID="2e19573c-6791-4599-ba17-f6628901cf93" containerID="9ddf2830f42d673b2dab094da1a4e60a723b0fde2e824263166f279829551a40" exitCode=0 May 23 22:16:56.124395 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:56.123179 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" event={"ID":"2e19573c-6791-4599-ba17-f6628901cf93","Type":"ContainerDied","Data":"9ddf2830f42d673b2dab094da1a4e60a723b0fde2e824263166f279829551a40"} May 23 22:16:57.131329 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:57.131292 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" event={"ID":"2e19573c-6791-4599-ba17-f6628901cf93","Type":"ContainerStarted","Data":"c63a41604fb29bce29dfe7370b11d7e4d394b6c418cac4e3f5a57c89acc748aa"} May 23 22:16:57.131866 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:57.131533 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:16:57.149796 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:57.149750 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" podStartSLOduration=7.971398665 podStartE2EDuration="8.149736365s" podCreationTimestamp="2026-05-23 22:16:49 +0000 UTC" firstStartedPulling="2026-05-23 22:16:56.123945233 +0000 UTC m=+719.729120618" lastFinishedPulling="2026-05-23 22:16:56.302282932 +0000 UTC m=+719.907458318" observedRunningTime="2026-05-23 22:16:57.148791616 +0000 UTC m=+720.753967019" watchObservedRunningTime="2026-05-23 22:16:57.149736365 +0000 UTC m=+720.754911769" May 23 22:16:58.094257 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:16:58.094228 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm" May 23 22:17:05.138278 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:05.138247 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-nljc7" May 23 22:17:08.148588 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:08.148554 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4" May 23 22:17:12.266725 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.266687 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t"] May 23 22:17:12.280415 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.280390 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t"] May 23 22:17:12.280561 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.280477 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.282816 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.282794 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 23 22:17:12.383031 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.382998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.383031 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.383031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.383237 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.383086 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.383237 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.383105 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501b6293-3c22-4117-820a-701d5f376f6b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.383237 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.383134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.383237 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.383154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2fjr\" (UniqueName: \"kubernetes.io/projected/501b6293-3c22-4117-820a-701d5f376f6b-kube-api-access-s2fjr\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.483677 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.483634 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501b6293-3c22-4117-820a-701d5f376f6b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.483834 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.483702 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.483834 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.483724 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2fjr\" (UniqueName: \"kubernetes.io/projected/501b6293-3c22-4117-820a-701d5f376f6b-kube-api-access-s2fjr\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.483834 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.483780 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.483834 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.483806 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.484079 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.483859 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.484189 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.484167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.484252 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.484200 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.484290 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.484263 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.486019 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.485997 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/501b6293-3c22-4117-820a-701d5f376f6b-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.486133 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.486110 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501b6293-3c22-4117-820a-701d5f376f6b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.491521 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.491491 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2fjr\" (UniqueName: \"kubernetes.io/projected/501b6293-3c22-4117-820a-701d5f376f6b-kube-api-access-s2fjr\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t\" (UID: \"501b6293-3c22-4117-820a-701d5f376f6b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.591784 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.591471 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:12.736350 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:12.736323 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t"] May 23 22:17:12.739167 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:17:12.739133 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501b6293_3c22_4117_820a_701d5f376f6b.slice/crio-3fff5a0a2ecd748acf3469366681a7cfc82b40e08072bea619d8003f7efc062f WatchSource:0}: Error finding container 3fff5a0a2ecd748acf3469366681a7cfc82b40e08072bea619d8003f7efc062f: Status 404 returned error can't find the container with id 3fff5a0a2ecd748acf3469366681a7cfc82b40e08072bea619d8003f7efc062f May 23 22:17:13.187421 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:13.187328 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" event={"ID":"501b6293-3c22-4117-820a-701d5f376f6b","Type":"ContainerStarted","Data":"dd592d066029a0446ef53b7d452e1a82cad71e081ccb3d568e917f5e3aa06260"} May 23 22:17:13.187421 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:13.187365 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" event={"ID":"501b6293-3c22-4117-820a-701d5f376f6b","Type":"ContainerStarted","Data":"3fff5a0a2ecd748acf3469366681a7cfc82b40e08072bea619d8003f7efc062f"} May 23 22:17:18.204607 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:18.204576 2556 generic.go:358] "Generic (PLEG): container finished" podID="501b6293-3c22-4117-820a-701d5f376f6b" containerID="dd592d066029a0446ef53b7d452e1a82cad71e081ccb3d568e917f5e3aa06260" exitCode=0 May 23 22:17:18.204940 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:18.204624 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" event={"ID":"501b6293-3c22-4117-820a-701d5f376f6b","Type":"ContainerDied","Data":"dd592d066029a0446ef53b7d452e1a82cad71e081ccb3d568e917f5e3aa06260"} May 23 22:17:19.209184 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:19.209150 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" event={"ID":"501b6293-3c22-4117-820a-701d5f376f6b","Type":"ContainerStarted","Data":"abda2735865564086acca5c2654283e4d0298b301cb068af0e7cee6d55d42768"} May 23 22:17:19.209559 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:19.209362 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:17:19.228345 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:19.228280 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" podStartSLOduration=7.053811936 podStartE2EDuration="7.228263882s" podCreationTimestamp="2026-05-23 22:17:12 +0000 UTC" firstStartedPulling="2026-05-23 22:17:18.205235368 +0000 UTC m=+741.810410750" lastFinishedPulling="2026-05-23 22:17:18.379687311 +0000 UTC m=+741.984862696" observedRunningTime="2026-05-23 22:17:19.226634967 +0000 UTC m=+742.831810376" watchObservedRunningTime="2026-05-23 22:17:19.228263882 +0000 UTC m=+742.833439283" May 23 22:17:30.226353 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:17:30.226315 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t" May 23 22:18:59.381081 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:18:59.381049 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659745fdd9-hztfp"] May 23 22:18:59.381516 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:18:59.381274 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-659745fdd9-hztfp" podUID="523442a5-705a-4e4c-a653-341b666855c8" containerName="manager" containerID="cri-o://70965803648bea5a1c821c62c281e489b3185563e81135fa31525ec1d6dc814c" gracePeriod=30 May 23 22:18:59.545230 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:18:59.545198 2556 generic.go:358] "Generic (PLEG): container finished" podID="523442a5-705a-4e4c-a653-341b666855c8" containerID="70965803648bea5a1c821c62c281e489b3185563e81135fa31525ec1d6dc814c" exitCode=0 May 23 22:18:59.545403 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:18:59.545267 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659745fdd9-hztfp" event={"ID":"523442a5-705a-4e4c-a653-341b666855c8","Type":"ContainerDied","Data":"70965803648bea5a1c821c62c281e489b3185563e81135fa31525ec1d6dc814c"} May 23 22:18:59.616496 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:18:59.616472 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659745fdd9-hztfp" May 23 22:18:59.693381 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:18:59.693300 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx6xp\" (UniqueName: \"kubernetes.io/projected/523442a5-705a-4e4c-a653-341b666855c8-kube-api-access-mx6xp\") pod \"523442a5-705a-4e4c-a653-341b666855c8\" (UID: \"523442a5-705a-4e4c-a653-341b666855c8\") " May 23 22:18:59.695280 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:18:59.695254 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/523442a5-705a-4e4c-a653-341b666855c8-kube-api-access-mx6xp" (OuterVolumeSpecName: "kube-api-access-mx6xp") pod "523442a5-705a-4e4c-a653-341b666855c8" (UID: "523442a5-705a-4e4c-a653-341b666855c8"). InnerVolumeSpecName "kube-api-access-mx6xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 23 22:18:59.794087 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:18:59.794053 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx6xp\" (UniqueName: \"kubernetes.io/projected/523442a5-705a-4e4c-a653-341b666855c8-kube-api-access-mx6xp\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:19:00.549520 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:00.549465 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659745fdd9-hztfp" event={"ID":"523442a5-705a-4e4c-a653-341b666855c8","Type":"ContainerDied","Data":"2e074134d8460f82f3970b5f892d62898a818154fcd2c5beda61e384f0cc72df"} May 23 22:19:00.549520 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:00.549497 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659745fdd9-hztfp" May 23 22:19:00.550009 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:00.549532 2556 scope.go:117] "RemoveContainer" containerID="70965803648bea5a1c821c62c281e489b3185563e81135fa31525ec1d6dc814c" May 23 22:19:00.571859 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:00.571834 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659745fdd9-hztfp"] May 23 22:19:00.575179 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:00.575160 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-659745fdd9-hztfp"] May 23 22:19:00.975066 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:00.975035 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="523442a5-705a-4e4c-a653-341b666855c8" path="/var/lib/kubelet/pods/523442a5-705a-4e4c-a653-341b666855c8/volumes" May 23 22:19:01.291622 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.291528 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-659745fdd9-j84pk"] May 23 22:19:01.291964 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.291945 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="523442a5-705a-4e4c-a653-341b666855c8" containerName="manager" May 23 22:19:01.292046 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.291966 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="523442a5-705a-4e4c-a653-341b666855c8" containerName="manager" May 23 22:19:01.292098 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.292063 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="523442a5-705a-4e4c-a653-341b666855c8" containerName="manager" May 23 22:19:01.296588 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.296564 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659745fdd9-j84pk" May 23 22:19:01.298726 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.298703 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 23 22:19:01.298819 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.298741 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hsbt9\"" May 23 22:19:01.302014 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.301992 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659745fdd9-j84pk"] May 23 22:19:01.407537 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.407494 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xkgr\" (UniqueName: \"kubernetes.io/projected/ee13d651-b871-49dd-82df-1a837de327da-kube-api-access-7xkgr\") pod \"maas-controller-659745fdd9-j84pk\" (UID: \"ee13d651-b871-49dd-82df-1a837de327da\") " pod="opendatahub/maas-controller-659745fdd9-j84pk" May 23 22:19:01.508541 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.508509 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xkgr\" (UniqueName: \"kubernetes.io/projected/ee13d651-b871-49dd-82df-1a837de327da-kube-api-access-7xkgr\") pod \"maas-controller-659745fdd9-j84pk\" (UID: \"ee13d651-b871-49dd-82df-1a837de327da\") " pod="opendatahub/maas-controller-659745fdd9-j84pk" May 23 22:19:01.517027 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.516998 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xkgr\" (UniqueName: \"kubernetes.io/projected/ee13d651-b871-49dd-82df-1a837de327da-kube-api-access-7xkgr\") pod \"maas-controller-659745fdd9-j84pk\" (UID: \"ee13d651-b871-49dd-82df-1a837de327da\") " pod="opendatahub/maas-controller-659745fdd9-j84pk" May 23 22:19:01.607760 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.607646 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659745fdd9-j84pk" May 23 22:19:01.736733 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:01.736707 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659745fdd9-j84pk"] May 23 22:19:01.739176 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:19:01.739148 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee13d651_b871_49dd_82df_1a837de327da.slice/crio-3a23da0011f3288c7aedc05f49a8b092e30df301bf821df22eb5a602c09cc37c WatchSource:0}: Error finding container 3a23da0011f3288c7aedc05f49a8b092e30df301bf821df22eb5a602c09cc37c: Status 404 returned error can't find the container with id 3a23da0011f3288c7aedc05f49a8b092e30df301bf821df22eb5a602c09cc37c May 23 22:19:02.558387 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:02.558348 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659745fdd9-j84pk" event={"ID":"ee13d651-b871-49dd-82df-1a837de327da","Type":"ContainerStarted","Data":"0e6ff1759563a458fbf27e11fc77e1fb48b1d191c77f8accab5b661c59c05a9a"} May 23 22:19:02.558552 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:02.558394 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659745fdd9-j84pk" event={"ID":"ee13d651-b871-49dd-82df-1a837de327da","Type":"ContainerStarted","Data":"3a23da0011f3288c7aedc05f49a8b092e30df301bf821df22eb5a602c09cc37c"} May 23 22:19:02.558552 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:02.558421 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-659745fdd9-j84pk" May 23 22:19:02.575121 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:02.575074 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-659745fdd9-j84pk" podStartSLOduration=1.143225586 podStartE2EDuration="1.575059692s" podCreationTimestamp="2026-05-23 22:19:01 +0000 UTC" firstStartedPulling="2026-05-23 22:19:01.740563074 +0000 UTC m=+845.345738474" lastFinishedPulling="2026-05-23 22:19:02.172397198 +0000 UTC m=+845.777572580" observedRunningTime="2026-05-23 22:19:02.573135487 +0000 UTC m=+846.178310890" watchObservedRunningTime="2026-05-23 22:19:02.575059692 +0000 UTC m=+846.180235095" May 23 22:19:13.567768 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:13.567734 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-659745fdd9-j84pk" May 23 22:19:56.930042 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:56.929968 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:19:56.930582 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:19:56.930433 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:24:56.955102 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:24:56.955077 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:24:56.955679 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:24:56.955113 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:29:16.460745 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:16.460711 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6"] May 23 22:29:16.463279 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:16.460956 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" podUID="ca307595-31e4-41b8-b3ab-5c9d0490cd64" containerName="manager" containerID="cri-o://1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e" gracePeriod=10 May 23 22:29:17.211852 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.211825 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:29:17.337500 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.337416 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca307595-31e4-41b8-b3ab-5c9d0490cd64-extensions-socket-volume\") pod \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\" (UID: \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\") " May 23 22:29:17.337500 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.337450 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rllss\" (UniqueName: \"kubernetes.io/projected/ca307595-31e4-41b8-b3ab-5c9d0490cd64-kube-api-access-rllss\") pod \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\" (UID: \"ca307595-31e4-41b8-b3ab-5c9d0490cd64\") " May 23 22:29:17.337823 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.337800 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca307595-31e4-41b8-b3ab-5c9d0490cd64-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca307595-31e4-41b8-b3ab-5c9d0490cd64" (UID: "ca307595-31e4-41b8-b3ab-5c9d0490cd64"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 23 22:29:17.339510 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.339485 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca307595-31e4-41b8-b3ab-5c9d0490cd64-kube-api-access-rllss" (OuterVolumeSpecName: "kube-api-access-rllss") pod "ca307595-31e4-41b8-b3ab-5c9d0490cd64" (UID: "ca307595-31e4-41b8-b3ab-5c9d0490cd64"). InnerVolumeSpecName "kube-api-access-rllss". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 23 22:29:17.438797 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.438762 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca307595-31e4-41b8-b3ab-5c9d0490cd64-extensions-socket-volume\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:29:17.438797 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.438796 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rllss\" (UniqueName: \"kubernetes.io/projected/ca307595-31e4-41b8-b3ab-5c9d0490cd64-kube-api-access-rllss\") on node \"ip-10-0-131-208.ec2.internal\" DevicePath \"\"" May 23 22:29:17.623528 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.623440 2556 generic.go:358] "Generic (PLEG): container finished" podID="ca307595-31e4-41b8-b3ab-5c9d0490cd64" containerID="1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e" exitCode=0 May 23 22:29:17.623528 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.623496 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" May 23 22:29:17.624010 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.623530 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" event={"ID":"ca307595-31e4-41b8-b3ab-5c9d0490cd64","Type":"ContainerDied","Data":"1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e"} May 23 22:29:17.624010 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.623572 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6" event={"ID":"ca307595-31e4-41b8-b3ab-5c9d0490cd64","Type":"ContainerDied","Data":"5a893c72c60e203a8bb4c80a897315e4058b9a4f8d66e540e5cf0de82ce37955"} May 23 22:29:17.624010 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.623592 2556 scope.go:117] "RemoveContainer" containerID="1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e" May 23 22:29:17.632534 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.632516 2556 scope.go:117] "RemoveContainer" containerID="1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e" May 23 22:29:17.632822 ip-10-0-131-208 kubenswrapper[2556]: E0523 22:29:17.632801 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e\": container with ID starting with 1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e not found: ID does not exist" containerID="1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e" May 23 22:29:17.632902 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.632829 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e"} err="failed to get container status \"1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e\": rpc error: code = NotFound desc = could not find container \"1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e\": container with ID starting with 1f93c39ecb733984261bc4918bf20fe9107b70de60e14458cdd767a03c1cf30e not found: ID does not exist" May 23 22:29:17.643644 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.643624 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6"] May 23 22:29:17.646993 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:17.646971 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9lps6"] May 23 22:29:18.975033 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:18.975000 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca307595-31e4-41b8-b3ab-5c9d0490cd64" path="/var/lib/kubelet/pods/ca307595-31e4-41b8-b3ab-5c9d0490cd64/volumes" May 23 22:29:56.977972 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:56.977945 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:29:56.979975 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:29:56.979957 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:30:22.478708 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.478671 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww"] May 23 22:30:22.479245 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.479222 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca307595-31e4-41b8-b3ab-5c9d0490cd64" containerName="manager" May 23 22:30:22.479245 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.479242 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca307595-31e4-41b8-b3ab-5c9d0490cd64" containerName="manager" May 23 22:30:22.479378 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.479346 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca307595-31e4-41b8-b3ab-5c9d0490cd64" containerName="manager" May 23 22:30:22.482226 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.482211 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:30:22.484590 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.484560 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hlwqb\"" May 23 22:30:22.492105 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.492077 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww"] May 23 22:30:22.595542 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.595505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbwsb\" (UniqueName: \"kubernetes.io/projected/82fe2ec2-3456-4248-b995-09d625fcc2f2-kube-api-access-pbwsb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8jqww\" (UID: \"82fe2ec2-3456-4248-b995-09d625fcc2f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:30:22.595734 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.595549 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82fe2ec2-3456-4248-b995-09d625fcc2f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8jqww\" (UID: \"82fe2ec2-3456-4248-b995-09d625fcc2f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:30:22.696999 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.696960 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbwsb\" (UniqueName: \"kubernetes.io/projected/82fe2ec2-3456-4248-b995-09d625fcc2f2-kube-api-access-pbwsb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8jqww\" (UID: \"82fe2ec2-3456-4248-b995-09d625fcc2f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:30:22.696999 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.697000 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82fe2ec2-3456-4248-b995-09d625fcc2f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8jqww\" (UID: \"82fe2ec2-3456-4248-b995-09d625fcc2f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:30:22.697368 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.697352 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82fe2ec2-3456-4248-b995-09d625fcc2f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8jqww\" (UID: \"82fe2ec2-3456-4248-b995-09d625fcc2f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:30:22.705428 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.705398 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbwsb\" (UniqueName: \"kubernetes.io/projected/82fe2ec2-3456-4248-b995-09d625fcc2f2-kube-api-access-pbwsb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8jqww\" (UID: \"82fe2ec2-3456-4248-b995-09d625fcc2f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:30:22.793874 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.793776 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:30:22.932122 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.932091 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww"] May 23 22:30:22.934057 ip-10-0-131-208 kubenswrapper[2556]: W0523 22:30:22.934027 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82fe2ec2_3456_4248_b995_09d625fcc2f2.slice/crio-25a5c375d72a0ee654327c5cbdd594c3141ac684d3f44dc668593d051db48aa5 WatchSource:0}: Error finding container 25a5c375d72a0ee654327c5cbdd594c3141ac684d3f44dc668593d051db48aa5: Status 404 returned error can't find the container with id 25a5c375d72a0ee654327c5cbdd594c3141ac684d3f44dc668593d051db48aa5 May 23 22:30:22.936224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:22.936202 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 23 22:30:23.858250 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:23.858213 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" event={"ID":"82fe2ec2-3456-4248-b995-09d625fcc2f2","Type":"ContainerStarted","Data":"e67095c4dc6f99837e9e87e2e81a576bcc3aadc6285f89fc8e06a11edc0bad5b"} May 23 22:30:23.858250 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:23.858252 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" event={"ID":"82fe2ec2-3456-4248-b995-09d625fcc2f2","Type":"ContainerStarted","Data":"25a5c375d72a0ee654327c5cbdd594c3141ac684d3f44dc668593d051db48aa5"} May 23 22:30:23.858764 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:23.858334 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:30:23.878037 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:23.877986 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" podStartSLOduration=1.877970032 podStartE2EDuration="1.877970032s" podCreationTimestamp="2026-05-23 22:30:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:30:23.875938337 +0000 UTC m=+1527.481113758" watchObservedRunningTime="2026-05-23 22:30:23.877970032 +0000 UTC m=+1527.483145437" May 23 22:30:34.863396 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:30:34.863365 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8jqww" May 23 22:34:56.999429 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:34:56.999400 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:34:57.002697 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:34:57.002652 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:39:57.022806 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:39:57.022715 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:39:57.036368 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:39:57.036341 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:40:06.293370 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:06.293335 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-59qpf_74cd78a9-5c49-46e9-85a0-a65679825b85/manager/0.log" May 23 22:40:06.407784 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:06.407746 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8695c7d64c-78tvm_cda12eb2-3352-4540-b771-d58b7c13a3e6/maas-api/0.log" May 23 22:40:06.648157 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:06.648074 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-659745fdd9-j84pk_ee13d651-b871-49dd-82df-1a837de327da/manager/0.log" May 23 22:40:06.760118 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:06.760083 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-p8k59_317ca33b-2038-4dc4-98e9-1b72bfca6529/manager/2.log" May 23 22:40:06.879339 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:06.879305 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696794d4d9-5wpmq_bac7e23b-1ffc-4d89-8965-ad8914ab86ff/manager/0.log" May 23 22:40:07.200916 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:07.200889 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-kmvsn_ffd2b956-889c-45e6-87a5-f0b8137d71df/postgres/0.log" May 23 22:40:08.583066 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:08.583028 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-ldd99_3d0623da-37b8-41d4-b761-c6d52a43dc32/manager/0.log" May 23 22:40:08.902342 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:08.902266 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-8jqww_82fe2ec2-3456-4248-b995-09d625fcc2f2/manager/0.log" May 23 22:40:09.553537 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:09.553506 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-dgwnd_e60ff324-858a-4358-a11c-68a46734c10a/discovery/0.log" May 23 22:40:09.657074 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:09.657047 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59f475c6cf-d8xtv_c1745b13-47e6-4206-97d1-676aea47822f/kube-auth-proxy/0.log" May 23 22:40:10.408380 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:10.408352 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4_2e19573c-6791-4599-ba17-f6628901cf93/storage-initializer/0.log" May 23 22:40:10.414710 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:10.414687 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-7d9s4_2e19573c-6791-4599-ba17-f6628901cf93/main/0.log" May 23 22:40:10.519764 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:10.519731 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm_d6a53b79-d45e-4fab-a736-a144401938ac/storage-initializer/0.log" May 23 22:40:10.527112 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:10.527090 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-lvcvm_d6a53b79-d45e-4fab-a736-a144401938ac/main/0.log" May 23 22:40:10.630932 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:10.630908 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-nljc7_7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6/main/0.log" May 23 22:40:10.641609 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:10.641578 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-nljc7_7fbfdda0-c7c7-44aa-b509-6f4b812ff7e6/storage-initializer/0.log" May 23 22:40:10.867696 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:10.867645 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t_501b6293-3c22-4117-820a-701d5f376f6b/storage-initializer/0.log" May 23 22:40:10.879880 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:10.879856 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-qx48t_501b6293-3c22-4117-820a-701d5f376f6b/main/0.log" May 23 22:40:17.541890 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:17.541859 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4xkr7_ca1690e5-e0b4-451e-a0c8-5c626f0c5352/global-pull-secret-syncer/0.log" May 23 22:40:17.687394 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:17.687364 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nm2bb_f69b957c-3ac7-4ede-bcf8-e038427dbf53/konnectivity-agent/0.log" May 23 22:40:17.729707 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:17.729676 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-208.ec2.internal_67c2375dab2c957f4076b88e403b86cb/haproxy/0.log" May 23 22:40:22.149104 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:22.149072 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-ldd99_3d0623da-37b8-41d4-b761-c6d52a43dc32/manager/0.log" May 23 22:40:22.294414 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:22.294379 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-8jqww_82fe2ec2-3456-4248-b995-09d625fcc2f2/manager/0.log" May 23 22:40:24.080573 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:24.080540 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95nww_a6396329-d36a-4e99-ab55-750f053a1ca9/node-exporter/0.log" May 23 22:40:24.100130 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:24.100104 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95nww_a6396329-d36a-4e99-ab55-750f053a1ca9/kube-rbac-proxy/0.log" May 23 22:40:24.117041 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:24.117020 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95nww_a6396329-d36a-4e99-ab55-750f053a1ca9/init-textfile/0.log" May 23 22:40:26.050314 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.050280 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4"] May 23 22:40:26.053907 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.053884 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.056213 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.056188 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p5st4\"/\"kube-root-ca.crt\"" May 23 22:40:26.056917 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.056902 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p5st4\"/\"default-dockercfg-4jg8q\"" May 23 22:40:26.056917 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.056912 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p5st4\"/\"openshift-service-ca.crt\"" May 23 22:40:26.062164 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.062143 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4"] May 23 22:40:26.221242 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.221204 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-podres\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.221242 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.221240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82p44\" (UniqueName: \"kubernetes.io/projected/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-kube-api-access-82p44\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.221474 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.221258 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-sys\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.221474 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.221342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-proc\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.221474 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.221439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-lib-modules\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.322116 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.322039 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-proc\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.322248 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.322155 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-proc\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.322248 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.322189 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-lib-modules\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.322323 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.322289 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-podres\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.322357 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.322322 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82p44\" (UniqueName: \"kubernetes.io/projected/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-kube-api-access-82p44\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.322357 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.322337 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-lib-modules\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.322357 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.322349 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-sys\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.322458 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.322407 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-podres\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.322499 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.322473 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-sys\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.329224 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.329200 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82p44\" (UniqueName: \"kubernetes.io/projected/9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf-kube-api-access-82p44\") pod \"perf-node-gather-daemonset-gswt4\" (UID: \"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.364316 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.364293 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.490714 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.489280 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4"] May 23 22:40:26.494235 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.493430 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 23 22:40:26.857784 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.857745 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" event={"ID":"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf","Type":"ContainerStarted","Data":"78d213f9776052cd22f95917288bae8d135034de567e7d71ee515b5502c0bc4c"} May 23 22:40:26.857784 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.857783 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" event={"ID":"9ca8b1a1-11c7-4f35-9392-d3a7dcdfcfbf","Type":"ContainerStarted","Data":"de6a336d3ab8d1b3604d388587452786e328b27471e67d61f77cfe97f8a4fc92"} May 23 22:40:26.857997 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.857823 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:26.872607 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:26.872555 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" podStartSLOduration=0.87254152 podStartE2EDuration="872.54152ms" podCreationTimestamp="2026-05-23 22:40:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:40:26.870890278 +0000 UTC m=+2130.476065683" watchObservedRunningTime="2026-05-23 22:40:26.87254152 +0000 UTC m=+2130.477716923" May 23 22:40:27.979445 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:27.979413 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-st2tr_558c2bc9-c73f-499a-8f87-c61449d47c8b/dns/0.log" May 23 22:40:27.995143 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:27.995115 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-st2tr_558c2bc9-c73f-499a-8f87-c61449d47c8b/kube-rbac-proxy/0.log" May 23 22:40:28.012440 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:28.012414 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5jmxg_c52a45fc-b5ef-4a29-886d-24a731b34cd3/dns-node-resolver/0.log" May 23 22:40:28.505581 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:28.505548 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gm8x9_8995c7c9-bd2c-4658-bb7e-e79c5e42ba48/node-ca/0.log" May 23 22:40:29.412011 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:29.411981 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-dgwnd_e60ff324-858a-4358-a11c-68a46734c10a/discovery/0.log" May 23 22:40:29.429704 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:29.429676 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59f475c6cf-d8xtv_c1745b13-47e6-4206-97d1-676aea47822f/kube-auth-proxy/0.log" May 23 22:40:30.058846 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:30.058812 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m82sl_32c3d90a-f07f-4a74-aed1-627db82ad4c4/serve-healthcheck-canary/0.log" May 23 22:40:30.521307 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:30.521281 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-crblc_13d12510-5d51-48a4-b295-44d6c18f2543/kube-rbac-proxy/0.log" May 23 22:40:30.538705 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:30.538655 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-crblc_13d12510-5d51-48a4-b295-44d6c18f2543/exporter/0.log" May 23 22:40:30.557272 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:30.557246 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-crblc_13d12510-5d51-48a4-b295-44d6c18f2543/extractor/0.log" May 23 22:40:32.473412 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:32.473375 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-59qpf_74cd78a9-5c49-46e9-85a0-a65679825b85/manager/0.log" May 23 22:40:32.513263 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:32.513231 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8695c7d64c-78tvm_cda12eb2-3352-4540-b771-d58b7c13a3e6/maas-api/0.log" May 23 22:40:32.635972 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:32.635943 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-659745fdd9-j84pk_ee13d651-b871-49dd-82df-1a837de327da/manager/0.log" May 23 22:40:32.651887 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:32.651852 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-p8k59_317ca33b-2038-4dc4-98e9-1b72bfca6529/manager/1.log" May 23 22:40:32.673373 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:32.673349 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-p8k59_317ca33b-2038-4dc4-98e9-1b72bfca6529/manager/2.log" May 23 22:40:32.738517 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:32.738448 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696794d4d9-5wpmq_bac7e23b-1ffc-4d89-8965-ad8914ab86ff/manager/0.log" May 23 22:40:32.794815 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:32.794780 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-kmvsn_ffd2b956-889c-45e6-87a5-f0b8137d71df/postgres/0.log" May 23 22:40:32.870807 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:32.870782 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-gswt4" May 23 22:40:33.881849 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:33.881820 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-dbwqn_db68ce76-4d6a-448e-8358-1bb126b25df3/openshift-lws-operator/0.log" May 23 22:40:39.573682 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.573597 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ndkjb_53b84289-d5e8-41de-b21c-3793bf8bf775/kube-multus-additional-cni-plugins/0.log" May 23 22:40:39.589826 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.589799 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ndkjb_53b84289-d5e8-41de-b21c-3793bf8bf775/egress-router-binary-copy/0.log" May 23 22:40:39.607863 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.607840 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ndkjb_53b84289-d5e8-41de-b21c-3793bf8bf775/cni-plugins/0.log" May 23 22:40:39.624560 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.624532 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ndkjb_53b84289-d5e8-41de-b21c-3793bf8bf775/bond-cni-plugin/0.log" May 23 22:40:39.639592 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.639570 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ndkjb_53b84289-d5e8-41de-b21c-3793bf8bf775/routeoverride-cni/0.log" May 23 22:40:39.661832 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.661806 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ndkjb_53b84289-d5e8-41de-b21c-3793bf8bf775/whereabouts-cni-bincopy/0.log" May 23 22:40:39.678170 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.678136 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ndkjb_53b84289-d5e8-41de-b21c-3793bf8bf775/whereabouts-cni/0.log" May 23 22:40:39.706969 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.706949 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ffcwv_824089f7-53ba-4de5-8259-3c5e5be800cd/kube-multus/0.log" May 23 22:40:39.847241 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.847169 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h5tlh_bb43ba8a-7020-4f4a-8c3e-ed619161fc6b/network-metrics-daemon/0.log" May 23 22:40:39.862395 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:39.862373 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h5tlh_bb43ba8a-7020-4f4a-8c3e-ed619161fc6b/kube-rbac-proxy/0.log" May 23 22:40:40.823303 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:40.823273 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-controller/0.log" May 23 22:40:40.836762 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:40.836727 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/0.log" May 23 22:40:40.856362 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:40.856333 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovn-acl-logging/1.log" May 23 22:40:40.876099 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:40.876079 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/kube-rbac-proxy-node/0.log" May 23 22:40:40.894318 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:40.894280 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/kube-rbac-proxy-ovn-metrics/0.log" May 23 22:40:40.907767 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:40.907739 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/northd/0.log" May 23 22:40:40.923510 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:40.923487 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/nbdb/0.log" May 23 22:40:40.940170 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:40.940149 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/sbdb/0.log" May 23 22:40:41.102810 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:41.102730 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chpxl_eb86886e-a68b-4c4e-a078-03ac154dc901/ovnkube-controller/0.log" May 23 22:40:42.383190 ip-10-0-131-208 kubenswrapper[2556]: I0523 22:40:42.383159 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-72r52_2cf68606-cd54-4b99-8b79-7401b14a4f26/network-check-target-container/0.log"