May 27 17:55:36.881895 ip-10-0-141-157 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 17:55:36.881906 ip-10-0-141-157 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 17:55:36.881913 ip-10-0-141-157 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 17:55:36.882210 ip-10-0-141-157 systemd[1]: Failed to start Kubernetes Kubelet. May 27 17:55:45.929318 ip-10-0-141-157 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 17:55:45.929332 ip-10-0-141-157 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 65a30446232e403aa52170eff245870b -- May 27 17:58:01.839736 ip-10-0-141-157 systemd[1]: Starting Kubernetes Kubelet... May 27 17:58:02.354259 ip-10-0-141-157 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 17:58:02.354259 ip-10-0-141-157 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 17:58:02.354259 ip-10-0-141-157 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 17:58:02.354259 ip-10-0-141-157 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 17:58:02.354259 ip-10-0-141-157 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 17:58:02.358145 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.358026 2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 17:58:02.365617 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365592 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:58:02.365617 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365612 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:58:02.365617 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365616 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:58:02.365617 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365619 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:58:02.365617 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365622 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:58:02.365617 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365625 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:58:02.365617 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365629 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365634 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365638 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365641 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365644 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365647 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365650 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365653 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365656 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365659 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365661 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365664 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365667 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365670 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365673 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365676 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365680 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365685 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365688 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:58:02.365885 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365690 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365694 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365697 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365699 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365703 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365714 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365718 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365720 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365723 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365726 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365728 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365731 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365734 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365736 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365739 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365742 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365745 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365748 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365751 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365754 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:58:02.366403 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365756 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365759 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365762 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365765 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365767 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365770 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365773 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365776 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365778 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365781 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365783 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365786 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365788 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365791 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365793 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365796 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365798 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365801 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365803 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365805 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:58:02.366895 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365808 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365810 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365813 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365815 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365818 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365820 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365823 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365828 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365831 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365835 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365837 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365840 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365842 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365846 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365849 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365852 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365854 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365857 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365860 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365862 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:58:02.367402 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.365865 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366295 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366301 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366304 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366307 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366310 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366312 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366315 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366317 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366320 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366323 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366326 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366328 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366331 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366334 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366337 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366340 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366342 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366345 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366348 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:58:02.368039 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366351 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366354 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366357 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366359 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366362 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366368 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366371 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366373 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366376 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366378 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366381 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366384 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366386 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366388 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366391 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366394 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366397 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366401 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366403 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366407 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:58:02.368562 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366410 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366412 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366417 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366420 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366424 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366426 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366429 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366431 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366434 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366437 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366439 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366442 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366445 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366448 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366450 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366453 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366455 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366458 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366461 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366464 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:58:02.369082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366466 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366469 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366471 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366474 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366476 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366479 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366482 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366485 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366487 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366490 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366492 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366494 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366497 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366500 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366502 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366505 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366507 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366511 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366513 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:58:02.369613 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366516 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366518 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366521 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366523 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366526 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366529 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366531 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.366534 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366609 2576 flags.go:64] FLAG: --address="0.0.0.0" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366617 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366624 2576 flags.go:64] FLAG: --anonymous-auth="true" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366629 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366634 2576 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366638 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366642 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366647 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366651 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366654 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366658 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366661 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366664 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366667 2576 flags.go:64] FLAG: --cgroup-root="" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366670 2576 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 17:58:02.370082 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366673 2576 flags.go:64] FLAG: --client-ca-file="" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366676 2576 flags.go:64] FLAG: --cloud-config="" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366678 2576 flags.go:64] FLAG: --cloud-provider="external" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366681 2576 flags.go:64] FLAG: --cluster-dns="[]" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366685 2576 flags.go:64] FLAG: --cluster-domain="" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366688 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366691 2576 flags.go:64] FLAG: --config-dir="" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366694 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366697 2576 flags.go:64] FLAG: --container-log-max-files="5" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366701 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366704 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366707 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366710 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366714 2576 flags.go:64] FLAG: --contention-profiling="false" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366718 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366720 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366724 2576 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366726 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366730 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366733 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366736 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366739 2576 flags.go:64] FLAG: --enable-load-reader="false" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366743 2576 flags.go:64] FLAG: --enable-server="true" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366746 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366751 2576 flags.go:64] FLAG: --event-burst="100" May 27 17:58:02.370666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366754 2576 flags.go:64] FLAG: --event-qps="50" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366756 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366761 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366764 2576 flags.go:64] FLAG: --eviction-hard="" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366768 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366771 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366774 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366777 2576 flags.go:64] FLAG: --eviction-soft="" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366780 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366784 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366787 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366789 2576 flags.go:64] FLAG: --experimental-mounter-path="" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366792 2576 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366795 2576 flags.go:64] FLAG: --fail-swap-on="true" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366798 2576 flags.go:64] FLAG: --feature-gates="" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366802 2576 flags.go:64] FLAG: --file-check-frequency="20s" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366805 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366808 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366811 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366814 2576 flags.go:64] FLAG: --healthz-port="10248" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366817 2576 flags.go:64] FLAG: --help="false" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366820 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-141-157.ec2.internal" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366824 2576 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366827 2576 flags.go:64] FLAG: --http-check-frequency="20s" May 27 17:58:02.371270 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366829 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366833 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366836 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366839 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366841 2576 flags.go:64] FLAG: --image-service-endpoint="" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366844 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366848 2576 flags.go:64] FLAG: --kube-api-burst="100" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366850 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366853 2576 flags.go:64] FLAG: --kube-api-qps="50" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366856 2576 flags.go:64] FLAG: --kube-reserved="" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366859 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366862 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366866 2576 flags.go:64] FLAG: --kubelet-cgroups="" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366868 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366871 2576 flags.go:64] FLAG: --lock-file="" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366874 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366877 2576 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366880 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366885 2576 flags.go:64] FLAG: --log-json-split-stream="false" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366888 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366891 2576 flags.go:64] FLAG: --log-text-split-stream="false" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366894 2576 flags.go:64] FLAG: --logging-format="text" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366897 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366901 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 17:58:02.371869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366905 2576 flags.go:64] FLAG: --manifest-url="" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366908 2576 flags.go:64] FLAG: --manifest-url-header="" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366913 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366916 2576 flags.go:64] FLAG: --max-open-files="1000000" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366920 2576 flags.go:64] FLAG: --max-pods="110" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366923 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366926 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366929 2576 flags.go:64] FLAG: --memory-manager-policy="None" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366932 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366935 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366938 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366941 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366949 2576 flags.go:64] FLAG: --node-status-max-images="50" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366952 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366955 2576 flags.go:64] FLAG: --oom-score-adj="-999" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366958 2576 flags.go:64] FLAG: --pod-cidr="" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366961 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366967 2576 flags.go:64] FLAG: --pod-manifest-path="" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366970 2576 flags.go:64] FLAG: --pod-max-pids="-1" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366974 2576 flags.go:64] FLAG: --pods-per-core="0" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366977 2576 flags.go:64] FLAG: --port="10250" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366980 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366983 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d7c43a6c83c98d2b" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366986 2576 flags.go:64] FLAG: --qos-reserved="" May 27 17:58:02.372452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366989 2576 flags.go:64] FLAG: --read-only-port="10255" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366992 2576 flags.go:64] FLAG: --register-node="true" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366995 2576 flags.go:64] FLAG: --register-schedulable="true" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.366998 2576 flags.go:64] FLAG: --register-with-taints="" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367002 2576 flags.go:64] FLAG: --registry-burst="10" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367005 2576 flags.go:64] FLAG: --registry-qps="5" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367007 2576 flags.go:64] FLAG: --reserved-cpus="" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367010 2576 flags.go:64] FLAG: --reserved-memory="" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367014 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367017 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367020 2576 flags.go:64] FLAG: --rotate-certificates="false" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367023 2576 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367026 2576 flags.go:64] FLAG: --runonce="false" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367029 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367032 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367035 2576 flags.go:64] FLAG: --seccomp-default="false" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367038 2576 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367041 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367044 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367047 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367050 2576 flags.go:64] FLAG: --storage-driver-password="root" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367053 2576 flags.go:64] FLAG: --storage-driver-secure="false" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367056 2576 flags.go:64] FLAG: --storage-driver-table="stats" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367059 2576 flags.go:64] FLAG: --storage-driver-user="root" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367063 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367066 2576 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 17:58:02.373025 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367069 2576 flags.go:64] FLAG: --system-cgroups="" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367076 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367081 2576 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367084 2576 flags.go:64] FLAG: --tls-cert-file="" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367087 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367091 2576 flags.go:64] FLAG: --tls-min-version="" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367094 2576 flags.go:64] FLAG: --tls-private-key-file="" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367097 2576 flags.go:64] FLAG: --topology-manager-policy="none" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367100 2576 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367103 2576 flags.go:64] FLAG: --topology-manager-scope="container" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367106 2576 flags.go:64] FLAG: --v="2" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367110 2576 flags.go:64] FLAG: --version="false" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367114 2576 flags.go:64] FLAG: --vmodule="" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367119 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.367122 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367233 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367237 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367240 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367243 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367246 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367248 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367251 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367255 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:58:02.373706 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367260 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367264 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367267 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367269 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367273 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367276 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367292 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367296 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367299 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367302 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367306 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367309 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367312 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367314 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367317 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367320 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367322 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367325 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367328 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:58:02.374319 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367330 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367333 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367335 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367338 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367341 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367343 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367346 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367349 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367351 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367354 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367356 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367359 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367363 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367365 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367368 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367371 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367373 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367376 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367378 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367381 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:58:02.374802 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367384 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367386 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367389 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367393 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367396 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367399 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367401 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367404 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367407 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367409 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367412 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367415 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367419 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367422 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367425 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367428 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367431 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367433 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367436 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367438 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:58:02.375310 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367441 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367444 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367446 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367449 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367453 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367456 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367458 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367461 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367463 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367466 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367469 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367471 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367474 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367476 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367479 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367483 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367486 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367488 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:58:02.375801 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.367491 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.368156 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.375396 2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.375414 2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375465 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375471 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375474 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375478 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375481 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375484 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375486 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375489 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375492 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375494 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375497 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375500 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:58:02.376252 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375502 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375505 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375508 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375510 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375513 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375516 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375519 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375521 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375524 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375527 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375529 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375532 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375535 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375538 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375541 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375543 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375546 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375549 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375551 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375554 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:58:02.376666 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375557 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375560 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375563 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375565 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375568 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375570 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375573 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375575 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375578 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375580 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375583 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375586 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375589 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375591 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375594 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375596 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375599 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375601 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375604 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375606 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:58:02.377158 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375609 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375611 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375614 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375616 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375619 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375622 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375625 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375629 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375633 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375635 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375638 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375642 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375645 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375649 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375653 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375656 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375659 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375662 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375665 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:58:02.377703 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375668 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375671 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375673 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375676 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375679 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375681 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375684 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375686 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375689 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375691 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375694 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375696 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375699 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375701 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375704 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:58:02.378169 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.375709 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375809 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375814 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375818 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375820 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375824 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375827 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375831 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375834 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375836 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375839 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375842 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375845 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375847 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375850 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375853 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375856 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375858 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375861 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:58:02.378574 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375864 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375867 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375870 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375873 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375875 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375878 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375880 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375883 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375886 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375888 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375891 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375893 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375896 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375898 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375901 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375903 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375906 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375908 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375911 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375914 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:58:02.379033 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375917 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375920 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375922 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375925 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375928 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375931 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375933 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375936 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375939 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375941 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375944 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375946 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375949 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375951 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375954 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375956 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375959 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375962 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375964 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375967 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:58:02.379619 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375969 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375972 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375974 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375977 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375979 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375982 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375984 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375987 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375989 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375992 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375995 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.375998 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376001 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376004 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376007 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376009 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376012 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376014 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376017 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376019 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:58:02.380109 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376022 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:58:02.380614 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376025 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:58:02.380614 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376027 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:58:02.380614 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376031 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:58:02.380614 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376035 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:58:02.380614 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376038 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:58:02.380614 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376041 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:58:02.380614 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:02.376044 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:58:02.380614 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.376048 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 17:58:02.380614 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.376914 2576 server.go:962] "Client rotation is on, will bootstrap in background" May 27 17:58:02.381372 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.381302 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 17:58:02.382554 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.382541 2576 server.go:1019] "Starting client certificate rotation" May 27 17:58:02.382665 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.382646 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 17:58:02.382699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.382688 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 17:58:02.411680 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.411658 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 17:58:02.415592 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.415564 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 17:58:02.433355 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.433327 2576 log.go:25] "Validated CRI v1 runtime API" May 27 17:58:02.439829 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.439809 2576 log.go:25] "Validated CRI v1 image API" May 27 17:58:02.441374 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.441358 2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 17:58:02.446473 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.446445 2576 fs.go:135] Filesystem UUIDs: map[5b3b1a4a-4c72-4be4-aea5-b81e585b7bdd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f3dcff2b-fbfc-4cbf-8d1f-2a8c988b15c8:/dev/nvme0n1p4] May 27 17:58:02.446564 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.446469 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 17:58:02.448014 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.447979 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 17:58:02.450923 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.450809 2576 manager.go:217] Machine: {Timestamp:2026-05-27 17:58:02.450265008 +0000 UTC m=+0.467475576 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101993 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2861d135ca59e4b0299b249b20a1ec SystemUUID:ec2861d1-35ca-59e4-b029-9b249b20a1ec BootID:65a30446-232e-403a-a521-70eff245870b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:87:65:d9:ed:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:87:65:d9:ed:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:92:63:1a:5a:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 17:58:02.451749 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.451737 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 17:58:02.451838 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.451826 2576 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 17:58:02.454147 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.454120 2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 17:58:02.454347 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.454149 2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-157.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 17:58:02.454393 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.454360 2576 topology_manager.go:138] "Creating topology manager with none policy" May 27 17:58:02.454393 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.454368 2576 container_manager_linux.go:306] "Creating device plugin manager" May 27 17:58:02.454393 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.454376 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 17:58:02.455363 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.455351 2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 17:58:02.456672 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.456661 2576 state_mem.go:36] "Initialized new in-memory state store" May 27 17:58:02.456782 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.456773 2576 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 17:58:02.459702 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.459689 2576 kubelet.go:491] "Attempting to sync node with API server" May 27 17:58:02.459750 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.459706 2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 17:58:02.459750 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.459719 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 17:58:02.459750 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.459728 2576 kubelet.go:397] "Adding apiserver pod source" May 27 17:58:02.459750 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.459738 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 17:58:02.461114 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.461099 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 17:58:02.461158 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.461128 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 17:58:02.464835 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.464817 2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 17:58:02.467262 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.467248 2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 17:58:02.469836 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469815 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 17:58:02.469925 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469872 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 17:58:02.469925 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469880 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 17:58:02.469925 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469887 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 17:58:02.469925 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469898 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 17:58:02.469925 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469904 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 17:58:02.469925 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469910 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 17:58:02.469925 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469916 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 17:58:02.469925 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469924 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 17:58:02.470153 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469953 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 17:58:02.470153 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469988 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 17:58:02.470153 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.469996 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 17:58:02.471137 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.471124 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 17:58:02.471180 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.471157 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 17:58:02.471575 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.471520 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mszsr" May 27 17:58:02.474100 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.474069 2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-157.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 17:58:02.474789 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.474774 2576 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 17:58:02.474838 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.474831 2576 server.go:1295] "Started kubelet" May 27 17:58:02.474888 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.474857 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 17:58:02.474940 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.474879 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 17:58:02.474940 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.474916 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 17:58:02.475036 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.474932 2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 17:58:02.475036 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.475001 2576 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 17:58:02.475592 ip-10-0-141-157 systemd[1]: Started Kubernetes Kubelet. May 27 17:58:02.477165 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.477150 2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 17:58:02.478028 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.478012 2576 server.go:317] "Adding debug handlers to kubelet server" May 27 17:58:02.479713 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.479688 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mszsr" May 27 17:58:02.482168 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.481045 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-157.ec2.internal.18b37de0dcf6da53 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-157.ec2.internal,UID:ip-10-0-141-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-157.ec2.internal,},FirstTimestamp:2026-05-27 17:58:02.474789459 +0000 UTC m=+0.492000028,LastTimestamp:2026-05-27 17:58:02.474789459 +0000 UTC m=+0.492000028,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-157.ec2.internal,}" May 27 17:58:02.485421 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.485401 2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 17:58:02.486691 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.486671 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 17:58:02.487364 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.487348 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 17:58:02.487546 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.487527 2576 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 17:58:02.487546 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.487542 2576 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 17:58:02.487719 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.487617 2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 17:58:02.487779 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.487729 2576 reconstruct.go:97] "Volume reconstruction finished" May 27 17:58:02.487779 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.487738 2576 reconciler.go:26] "Reconciler: start to sync state" May 27 17:58:02.488249 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.488234 2576 factory.go:55] Registering systemd factory May 27 17:58:02.488343 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.488273 2576 factory.go:223] Registration of the systemd container factory successfully May 27 17:58:02.488532 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.488516 2576 factory.go:153] Registering CRI-O factory May 27 17:58:02.488582 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.488535 2576 factory.go:223] Registration of the crio container factory successfully May 27 17:58:02.488582 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.488542 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:02.488641 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.488591 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 17:58:02.488641 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.488611 2576 factory.go:103] Registering Raw factory May 27 17:58:02.488641 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.488627 2576 manager.go:1196] Started watching for new ooms in manager May 27 17:58:02.489296 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.489268 2576 manager.go:319] Starting recovery of all containers May 27 17:58:02.497552 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.497527 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:58:02.499938 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.499770 2576 manager.go:324] Recovery completed May 27 17:58:02.500492 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.500465 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-157.ec2.internal\" not found" node="ip-10-0-141-157.ec2.internal" May 27 17:58:02.505877 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.505862 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:58:02.507799 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.507781 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientMemory" May 27 17:58:02.507870 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.507812 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:58:02.507870 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.507823 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientPID" May 27 17:58:02.508383 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.508369 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 17:58:02.508383 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.508382 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 17:58:02.508478 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.508399 2576 state_mem.go:36] "Initialized new in-memory state store" May 27 17:58:02.512378 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.512366 2576 policy_none.go:49] "None policy: Start" May 27 17:58:02.512436 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.512382 2576 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 17:58:02.512436 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.512393 2576 state_mem.go:35] "Initializing new in-memory state store" May 27 17:58:02.550953 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.550934 2576 manager.go:341] "Starting Device Plugin manager" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.550969 2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.550979 2576 server.go:85] "Starting device plugin registration server" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.551241 2576 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.551252 2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.551352 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.551460 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.551471 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.551980 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.552044 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.554826 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.556016 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.556042 2576 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.556059 2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.556066 2576 kubelet.go:2451] "Starting kubelet main sync loop" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.556098 2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 17:58:02.567321 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.558338 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:58:02.652432 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.652347 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:58:02.653399 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.653379 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientMemory" May 27 17:58:02.653508 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.653417 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:58:02.653508 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.653432 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientPID" May 27 17:58:02.653508 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.653462 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-157.ec2.internal" May 27 17:58:02.656553 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.656533 2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal"] May 27 17:58:02.656617 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.656600 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:58:02.657623 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.657609 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientMemory" May 27 17:58:02.657703 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.657641 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:58:02.657703 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.657655 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientPID" May 27 17:58:02.660112 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.660097 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:58:02.660249 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.660236 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" May 27 17:58:02.660315 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.660264 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:58:02.660846 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.660831 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientMemory" May 27 17:58:02.660924 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.660860 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:58:02.660924 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.660832 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientMemory" May 27 17:58:02.660924 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.660885 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientPID" May 27 17:58:02.660924 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.660901 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:58:02.661062 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.660933 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientPID" May 27 17:58:02.661776 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.661761 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-157.ec2.internal" May 27 17:58:02.661818 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.661784 2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-157.ec2.internal\": node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:02.663878 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.663856 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal" May 27 17:58:02.663981 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.663883 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:58:02.664591 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.664574 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientMemory" May 27 17:58:02.664667 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.664608 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:58:02.664667 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.664622 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeHasSufficientPID" May 27 17:58:02.679462 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.679437 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:02.685177 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.685162 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-157.ec2.internal\" not found" node="ip-10-0-141-157.ec2.internal" May 27 17:58:02.688475 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.688454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2852ca49b9c606f03d1e5f901e33e53-config\") pod \"kube-apiserver-proxy-ip-10-0-141-157.ec2.internal\" (UID: \"a2852ca49b9c606f03d1e5f901e33e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal" May 27 17:58:02.688550 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.688495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab4681f288c4abcda995b97fb3d39c13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal\" (UID: \"ab4681f288c4abcda995b97fb3d39c13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" May 27 17:58:02.688606 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.688581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab4681f288c4abcda995b97fb3d39c13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal\" (UID: \"ab4681f288c4abcda995b97fb3d39c13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" May 27 17:58:02.689667 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.689650 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-157.ec2.internal\" not found" node="ip-10-0-141-157.ec2.internal" May 27 17:58:02.780578 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.780541 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:02.788806 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.788782 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab4681f288c4abcda995b97fb3d39c13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal\" (UID: \"ab4681f288c4abcda995b97fb3d39c13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" May 27 17:58:02.788889 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.788811 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab4681f288c4abcda995b97fb3d39c13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal\" (UID: \"ab4681f288c4abcda995b97fb3d39c13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" May 27 17:58:02.788889 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.788829 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2852ca49b9c606f03d1e5f901e33e53-config\") pod \"kube-apiserver-proxy-ip-10-0-141-157.ec2.internal\" (UID: \"a2852ca49b9c606f03d1e5f901e33e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal" May 27 17:58:02.788889 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.788854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2852ca49b9c606f03d1e5f901e33e53-config\") pod \"kube-apiserver-proxy-ip-10-0-141-157.ec2.internal\" (UID: \"a2852ca49b9c606f03d1e5f901e33e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal" May 27 17:58:02.788889 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.788861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab4681f288c4abcda995b97fb3d39c13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal\" (UID: \"ab4681f288c4abcda995b97fb3d39c13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" May 27 17:58:02.788889 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.788867 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab4681f288c4abcda995b97fb3d39c13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal\" (UID: \"ab4681f288c4abcda995b97fb3d39c13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" May 27 17:58:02.881649 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.881602 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:02.982393 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:02.982312 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:02.989577 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.989548 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" May 27 17:58:02.992787 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:02.992770 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal" May 27 17:58:03.083490 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:03.083442 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:03.183915 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:03.183878 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:03.284495 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:03.284408 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:03.381923 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.381897 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 17:58:03.382440 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.382062 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 17:58:03.382440 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.382085 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 17:58:03.385041 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:03.385021 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:03.484343 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.484301 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 17:53:02 +0000 UTC" deadline="2028-01-27 01:03:44.189465686 +0000 UTC" May 27 17:58:03.484343 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.484338 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14623h5m40.705131515s" May 27 17:58:03.485341 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:03.485320 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:03.486954 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.486924 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 17:58:03.499322 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.499279 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 17:58:03.517988 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.517952 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t6sr7" May 27 17:58:03.525312 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.525267 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t6sr7" May 27 17:58:03.549651 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:03.549599 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4681f288c4abcda995b97fb3d39c13.slice/crio-d9f9521712651dbdf32458ff8c2560064ebfb13085f0311f1915c71fc3350052 WatchSource:0}: Error finding container d9f9521712651dbdf32458ff8c2560064ebfb13085f0311f1915c71fc3350052: Status 404 returned error can't find the container with id d9f9521712651dbdf32458ff8c2560064ebfb13085f0311f1915c71fc3350052 May 27 17:58:03.549842 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:03.549821 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2852ca49b9c606f03d1e5f901e33e53.slice/crio-9eef8db3715717cb4ac71b21248bac00183d64ec5e1aedb65e410b523edfd861 WatchSource:0}: Error finding container 9eef8db3715717cb4ac71b21248bac00183d64ec5e1aedb65e410b523edfd861: Status 404 returned error can't find the container with id 9eef8db3715717cb4ac71b21248bac00183d64ec5e1aedb65e410b523edfd861 May 27 17:58:03.553800 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.553784 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 17:58:03.559223 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.559165 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal" event={"ID":"a2852ca49b9c606f03d1e5f901e33e53","Type":"ContainerStarted","Data":"9eef8db3715717cb4ac71b21248bac00183d64ec5e1aedb65e410b523edfd861"} May 27 17:58:03.560187 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.560166 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" event={"ID":"ab4681f288c4abcda995b97fb3d39c13","Type":"ContainerStarted","Data":"d9f9521712651dbdf32458ff8c2560064ebfb13085f0311f1915c71fc3350052"} May 27 17:58:03.586351 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:03.586313 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:03.640120 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.640093 2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:58:03.687273 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:03.687242 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:03.787788 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:03.787712 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:03.888120 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:03.888072 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-157.ec2.internal\" not found" May 27 17:58:03.910068 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.910030 2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:58:03.988228 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:03.988101 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" May 27 17:58:04.001090 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.001050 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 17:58:04.002365 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.002341 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal" May 27 17:58:04.011084 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.011053 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 17:58:04.461215 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.461174 2576 apiserver.go:52] "Watching apiserver" May 27 17:58:04.467928 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.467901 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:58:04.472453 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.472425 2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 17:58:04.472822 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.472792 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-nk7h2","kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal","openshift-dns/node-resolver-dgqft","openshift-image-registry/node-ca-7wwsk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal","openshift-network-diagnostics/network-check-target-2rhkj","openshift-ovn-kubernetes/ovnkube-node-w47xc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2","openshift-cluster-node-tuning-operator/tuned-p9brj","openshift-multus/multus-additional-cni-plugins-ptzmk","openshift-multus/multus-lrcm7","openshift-multus/network-metrics-daemon-pghnx","openshift-network-operator/iptables-alerter-rm6v2"] May 27 17:58:04.475754 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.475734 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.477877 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.477856 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.478385 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.478365 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 17:58:04.478485 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.478394 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 17:58:04.478585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.478568 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 17:58:04.478731 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.478716 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 17:58:04.478791 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.478760 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d5gmc\"" May 27 17:58:04.478791 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.478778 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 17:58:04.478896 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.478795 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 17:58:04.479855 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.479832 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 17:58:04.480067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.480049 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.480138 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.480088 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nvmwq\"" May 27 17:58:04.480189 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.480160 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 17:58:04.482296 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.482263 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:04.482412 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:04.482356 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:04.482495 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.482475 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 17:58:04.482599 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.482581 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 17:58:04.482720 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.482699 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vg9q9\"" May 27 17:58:04.482866 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.482845 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 17:58:04.484457 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.484434 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:04.486719 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.486697 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 17:58:04.486803 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.486702 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 17:58:04.487372 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.487350 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.487968 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.487832 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2m7dm\"" May 27 17:58:04.489983 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.489551 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 17:58:04.489983 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.489800 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 17:58:04.489983 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.489814 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.489983 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.489841 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 17:58:04.489983 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.489922 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vcnhv\"" May 27 17:58:04.492393 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.492374 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.492393 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.492384 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 17:58:04.492531 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.492499 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 17:58:04.492592 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.492388 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7j9ks\"" May 27 17:58:04.494785 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.494765 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 17:58:04.494877 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.494829 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 17:58:04.494877 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.494860 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 17:58:04.494982 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.494899 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lrcm7" May 27 17:58:04.495055 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.495035 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 17:58:04.495263 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.495247 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 17:58:04.495372 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.495320 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d58xn\"" May 27 17:58:04.496814 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.496789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-lib-modules\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.496916 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.496819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-tuned\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.496916 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.496870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.496916 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.496894 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tkpsb\"" May 27 17:58:04.497141 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.496898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-device-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.497141 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.496996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-var-lib-openvswitch\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497141 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497014 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 17:58:04.497141 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497141 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-registration-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.497141 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-etc-selinux\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.497141 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-systemd-units\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-slash\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-run-openvswitch\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-ovn-node-metrics-cert\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcc5w\" (UniqueName: \"kubernetes.io/projected/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-kube-api-access-bcc5w\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-sysctl-d\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-systemd\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-run\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-run-ovn\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-log-socket\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-cni-netd\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.497519 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-sysctl-conf\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-var-lib-kubelet\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-tmp\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6w87\" (UniqueName: \"kubernetes.io/projected/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-kube-api-access-p6w87\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-sys-fs\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-etc-openvswitch\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-host\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1160d555-a418-4723-83e8-650f2eda3a4b-tmp-dir\") pod \"node-resolver-dgqft\" (UID: \"1160d555-a418-4723-83e8-650f2eda3a4b\") " pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn2j8\" (UniqueName: \"kubernetes.io/projected/04c59b1d-e537-4702-be1d-c421b8a61bc9-kube-api-access-rn2j8\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-ovnkube-script-lib\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aef902f-4204-4aeb-a69c-c11fe3c61853-host\") pod \"node-ca-7wwsk\" (UID: \"7aef902f-4204-4aeb-a69c-c11fe3c61853\") " pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aef902f-4204-4aeb-a69c-c11fe3c61853-serviceca\") pod \"node-ca-7wwsk\" (UID: \"7aef902f-4204-4aeb-a69c-c11fe3c61853\") " pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.497968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptglf\" (UniqueName: \"kubernetes.io/projected/7aef902f-4204-4aeb-a69c-c11fe3c61853-kube-api-access-ptglf\") pod \"node-ca-7wwsk\" (UID: \"7aef902f-4204-4aeb-a69c-c11fe3c61853\") " pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.498016 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-kubernetes\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1160d555-a418-4723-83e8-650f2eda3a4b-hosts-file\") pod \"node-resolver-dgqft\" (UID: \"1160d555-a418-4723-83e8-650f2eda3a4b\") " pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65vpg\" (UniqueName: \"kubernetes.io/projected/1160d555-a418-4723-83e8-650f2eda3a4b-kube-api-access-65vpg\") pod \"node-resolver-dgqft\" (UID: \"1160d555-a418-4723-83e8-650f2eda3a4b\") " pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-kubelet\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-run-netns\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-ovnkube-config\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-sysconfig\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-sys\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/990d6269-96d8-480d-a99d-6c5f5b46a803-agent-certs\") pod \"konnectivity-agent-nk7h2\" (UID: \"990d6269-96d8-480d-a99d-6c5f5b46a803\") " pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-socket-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-run-systemd\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-modprobe-d\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/990d6269-96d8-480d-a99d-6c5f5b46a803-konnectivity-ca\") pod \"konnectivity-agent-nk7h2\" (UID: \"990d6269-96d8-480d-a99d-6c5f5b46a803\") " pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-node-log\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-cni-bin\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.498585 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.498414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-env-overrides\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.499899 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.499882 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.499966 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.499928 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:04.500028 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:04.500006 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:04.502412 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.502393 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 17:58:04.502532 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.502474 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 17:58:04.502698 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.502662 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vx96v\"" May 27 17:58:04.502801 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.502759 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 17:58:04.526063 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.526033 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:53:03 +0000 UTC" deadline="2028-02-28 11:32:57.568133386 +0000 UTC" May 27 17:58:04.526063 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.526060 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15401h34m53.042075449s" May 27 17:58:04.589133 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.589095 2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 17:58:04.598801 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598764 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-systemd-units\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598812 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-slash\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598843 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcc5w\" (UniqueName: \"kubernetes.io/projected/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-kube-api-access-bcc5w\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598869 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-systemd\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-systemd-units\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598897 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-run\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-slash\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598938 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-var-lib-kubelet\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-run\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598966 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6w87\" (UniqueName: \"kubernetes.io/projected/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-kube-api-access-p6w87\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.598995 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.598991 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-sys-fs\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599014 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-run-ovn\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599038 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-cni-netd\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599062 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-sysctl-conf\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599101 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-tmp\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-var-lib-cni-multus\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-cnibin\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3459f66f-8695-4dee-9647-e43b6687e566-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3459f66f-8695-4dee-9647-e43b6687e566-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaed4cd4-28fe-4113-9e3f-afda6e3fafa7-iptables-alerter-script\") pod \"iptables-alerter-rm6v2\" (UID: \"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7\") " pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599270 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-ovnkube-script-lib\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-systemd\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599324 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aef902f-4204-4aeb-a69c-c11fe3c61853-host\") pod \"node-ca-7wwsk\" (UID: \"7aef902f-4204-4aeb-a69c-c11fe3c61853\") " pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599351 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-sys-fs\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599353 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-kubernetes\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-run-ovn\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599386 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65vpg\" (UniqueName: \"kubernetes.io/projected/1160d555-a418-4723-83e8-650f2eda3a4b-kube-api-access-65vpg\") pod \"node-resolver-dgqft\" (UID: \"1160d555-a418-4723-83e8-650f2eda3a4b\") " pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.599556 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599411 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-socket-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599438 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-device-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599412 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-cni-netd\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-var-lib-kubelet\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-hostroot\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599547 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-sysctl-conf\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l682l\" (UniqueName: \"kubernetes.io/projected/3459f66f-8695-4dee-9647-e43b6687e566-kube-api-access-l682l\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599588 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-run-netns\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-device-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599613 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-ovnkube-config\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599639 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599684 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-sys\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aef902f-4204-4aeb-a69c-c11fe3c61853-host\") pod \"node-ca-7wwsk\" (UID: \"7aef902f-4204-4aeb-a69c-c11fe3c61853\") " pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599707 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/990d6269-96d8-480d-a99d-6c5f5b46a803-agent-certs\") pod \"konnectivity-agent-nk7h2\" (UID: \"990d6269-96d8-480d-a99d-6c5f5b46a803\") " pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76d18c9e-7229-4038-805e-de5730bc8e99-cni-binary-copy\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3459f66f-8695-4dee-9647-e43b6687e566-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599806 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-run-systemd\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.600318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-socket-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599897 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-run-k8s-cni-cncf-io\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599935 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-run-systemd\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599939 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-cni-bin\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599964 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-lib-modules\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-run-netns\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.599986 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-tuned\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-multus-cni-dir\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-os-release\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-multus-socket-dir-parent\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-lib-modules\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-multus-conf-dir\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600544 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-var-lib-openvswitch\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600581 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-registration-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-os-release\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.601067 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600666 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-run-openvswitch\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-kubernetes\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600772 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-ovn-node-metrics-cert\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-registration-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600824 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-sysctl-d\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-run-openvswitch\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-ovnkube-script-lib\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600866 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-ovnkube-config\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-system-cni-dir\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600903 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-sys\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600918 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-log-socket\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-cni-bin\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.600964 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-etc-openvswitch\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-etc-openvswitch\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601038 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601043 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-sysctl-d\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.601872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601081 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-host\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-var-lib-openvswitch\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601148 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-host\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-log-socket\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601182 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1160d555-a418-4723-83e8-650f2eda3a4b-tmp-dir\") pod \"node-resolver-dgqft\" (UID: \"1160d555-a418-4723-83e8-650f2eda3a4b\") " pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601223 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rn2j8\" (UniqueName: \"kubernetes.io/projected/04c59b1d-e537-4702-be1d-c421b8a61bc9-kube-api-access-rn2j8\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaed4cd4-28fe-4113-9e3f-afda6e3fafa7-host-slash\") pod \"iptables-alerter-rm6v2\" (UID: \"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7\") " pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601325 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aef902f-4204-4aeb-a69c-c11fe3c61853-serviceca\") pod \"node-ca-7wwsk\" (UID: \"7aef902f-4204-4aeb-a69c-c11fe3c61853\") " pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601356 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptglf\" (UniqueName: \"kubernetes.io/projected/7aef902f-4204-4aeb-a69c-c11fe3c61853-kube-api-access-ptglf\") pod \"node-ca-7wwsk\" (UID: \"7aef902f-4204-4aeb-a69c-c11fe3c61853\") " pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601480 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1160d555-a418-4723-83e8-650f2eda3a4b-hosts-file\") pod \"node-resolver-dgqft\" (UID: \"1160d555-a418-4723-83e8-650f2eda3a4b\") " pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1160d555-a418-4723-83e8-650f2eda3a4b-tmp-dir\") pod \"node-resolver-dgqft\" (UID: \"1160d555-a418-4723-83e8-650f2eda3a4b\") " pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vft8f\" (UniqueName: \"kubernetes.io/projected/7dd1832a-5a40-4e13-8cd7-1db0de605be7-kube-api-access-vft8f\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601569 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-kubelet\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-kubelet\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601667 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-sysconfig\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1160d555-a418-4723-83e8-650f2eda3a4b-hosts-file\") pod \"node-resolver-dgqft\" (UID: \"1160d555-a418-4723-83e8-650f2eda3a4b\") " pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/76d18c9e-7229-4038-805e-de5730bc8e99-multus-daemon-config\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-sysconfig\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.602661 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aef902f-4204-4aeb-a69c-c11fe3c61853-serviceca\") pod \"node-ca-7wwsk\" (UID: \"7aef902f-4204-4aeb-a69c-c11fe3c61853\") " pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-etc-kubernetes\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-system-cni-dir\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601879 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-modprobe-d\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601908 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/990d6269-96d8-480d-a99d-6c5f5b46a803-konnectivity-ca\") pod \"konnectivity-agent-nk7h2\" (UID: \"990d6269-96d8-480d-a99d-6c5f5b46a803\") " pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-run-multus-certs\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5plf6\" (UniqueName: \"kubernetes.io/projected/aaed4cd4-28fe-4113-9e3f-afda6e3fafa7-kube-api-access-5plf6\") pod \"iptables-alerter-rm6v2\" (UID: \"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7\") " pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.601989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-modprobe-d\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602028 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-node-log\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602058 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-env-overrides\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-node-log\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602083 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9rrn\" (UniqueName: \"kubernetes.io/projected/76d18c9e-7229-4038-805e-de5730bc8e99-kube-api-access-d9rrn\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602142 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602171 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-etc-selinux\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.603542 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-cnibin\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-run-netns\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602221 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-var-lib-cni-bin\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04c59b1d-e537-4702-be1d-c421b8a61bc9-etc-selinux\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-var-lib-kubelet\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-env-overrides\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.602462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/990d6269-96d8-480d-a99d-6c5f5b46a803-konnectivity-ca\") pod \"konnectivity-agent-nk7h2\" (UID: \"990d6269-96d8-480d-a99d-6c5f5b46a803\") " pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.603573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-etc-tuned\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.603658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-ovn-node-metrics-cert\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.603771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/990d6269-96d8-480d-a99d-6c5f5b46a803-agent-certs\") pod \"konnectivity-agent-nk7h2\" (UID: \"990d6269-96d8-480d-a99d-6c5f5b46a803\") " pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:04.604237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.604145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-tmp\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.609889 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:04.609864 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:58:04.609889 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:04.609892 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:58:04.610079 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:04.609906 2576 projected.go:194] Error preparing data for projected volume kube-api-access-s5pgx for pod openshift-network-diagnostics/network-check-target-2rhkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:04.610079 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:04.610004 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx podName:68c7b24b-a653-4767-9dc9-d2bcab402003 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:05.109971125 +0000 UTC m=+3.127181696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s5pgx" (UniqueName: "kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx") pod "network-check-target-2rhkj" (UID: "68c7b24b-a653-4767-9dc9-d2bcab402003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:04.611823 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.611796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6w87\" (UniqueName: \"kubernetes.io/projected/8d032c0b-cbe5-40e8-8fd2-e54eba9f5830-kube-api-access-p6w87\") pod \"tuned-p9brj\" (UID: \"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830\") " pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.612571 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.612548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn2j8\" (UniqueName: \"kubernetes.io/projected/04c59b1d-e537-4702-be1d-c421b8a61bc9-kube-api-access-rn2j8\") pod \"aws-ebs-csi-driver-node-k84q2\" (UID: \"04c59b1d-e537-4702-be1d-c421b8a61bc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.612651 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.612548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcc5w\" (UniqueName: \"kubernetes.io/projected/d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a-kube-api-access-bcc5w\") pod \"ovnkube-node-w47xc\" (UID: \"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.613039 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.613015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65vpg\" (UniqueName: \"kubernetes.io/projected/1160d555-a418-4723-83e8-650f2eda3a4b-kube-api-access-65vpg\") pod \"node-resolver-dgqft\" (UID: \"1160d555-a418-4723-83e8-650f2eda3a4b\") " pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.614279 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.614247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptglf\" (UniqueName: \"kubernetes.io/projected/7aef902f-4204-4aeb-a69c-c11fe3c61853-kube-api-access-ptglf\") pod \"node-ca-7wwsk\" (UID: \"7aef902f-4204-4aeb-a69c-c11fe3c61853\") " pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.676963 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.676926 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:58:04.703505 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703471 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaed4cd4-28fe-4113-9e3f-afda6e3fafa7-host-slash\") pod \"iptables-alerter-rm6v2\" (UID: \"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7\") " pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.703505 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703508 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vft8f\" (UniqueName: \"kubernetes.io/projected/7dd1832a-5a40-4e13-8cd7-1db0de605be7-kube-api-access-vft8f\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:04.703736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703531 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/76d18c9e-7229-4038-805e-de5730bc8e99-multus-daemon-config\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.703736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703548 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-etc-kubernetes\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.703736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaed4cd4-28fe-4113-9e3f-afda6e3fafa7-host-slash\") pod \"iptables-alerter-rm6v2\" (UID: \"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7\") " pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.703736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-etc-kubernetes\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.703736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703652 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-system-cni-dir\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.703736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703705 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-run-multus-certs\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.703736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-system-cni-dir\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703735 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5plf6\" (UniqueName: \"kubernetes.io/projected/aaed4cd4-28fe-4113-9e3f-afda6e3fafa7-kube-api-access-5plf6\") pod \"iptables-alerter-rm6v2\" (UID: \"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7\") " pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703776 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-run-multus-certs\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703809 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9rrn\" (UniqueName: \"kubernetes.io/projected/76d18c9e-7229-4038-805e-de5730bc8e99-kube-api-access-d9rrn\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703839 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-cnibin\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703864 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-run-netns\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703891 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-var-lib-cni-bin\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:04.703897 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-run-netns\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.703955 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-cnibin\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:04.703987 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs podName:7dd1832a-5a40-4e13-8cd7-1db0de605be7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:05.203964414 +0000 UTC m=+3.221174983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs") pod "network-metrics-daemon-pghnx" (UID: "7dd1832a-5a40-4e13-8cd7-1db0de605be7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704002 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-var-lib-cni-bin\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704010 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-var-lib-kubelet\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704056 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-var-lib-cni-multus\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704082 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-cnibin\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704083 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-var-lib-kubelet\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704122 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3459f66f-8695-4dee-9647-e43b6687e566-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-var-lib-cni-multus\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704163 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3459f66f-8695-4dee-9647-e43b6687e566-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-cnibin\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704187 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/76d18c9e-7229-4038-805e-de5730bc8e99-multus-daemon-config\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704231 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaed4cd4-28fe-4113-9e3f-afda6e3fafa7-iptables-alerter-script\") pod \"iptables-alerter-rm6v2\" (UID: \"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7\") " pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704354 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-hostroot\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704385 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l682l\" (UniqueName: \"kubernetes.io/projected/3459f66f-8695-4dee-9647-e43b6687e566-kube-api-access-l682l\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-hostroot\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704435 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76d18c9e-7229-4038-805e-de5730bc8e99-cni-binary-copy\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704486 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3459f66f-8695-4dee-9647-e43b6687e566-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704517 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-run-k8s-cni-cncf-io\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704549 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-multus-cni-dir\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704575 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-os-release\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.704699 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704604 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-multus-socket-dir-parent\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704632 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-multus-conf-dir\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704647 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3459f66f-8695-4dee-9647-e43b6687e566-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-host-run-k8s-cni-cncf-io\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704662 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-os-release\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3459f66f-8695-4dee-9647-e43b6687e566-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704699 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-os-release\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-multus-cni-dir\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704824 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-system-cni-dir\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-os-release\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-multus-socket-dir-parent\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76d18c9e-7229-4038-805e-de5730bc8e99-cni-binary-copy\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704927 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3459f66f-8695-4dee-9647-e43b6687e566-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-multus-conf-dir\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.704957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76d18c9e-7229-4038-805e-de5730bc8e99-system-cni-dir\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.705318 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.705060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3459f66f-8695-4dee-9647-e43b6687e566-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.705798 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.705402 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaed4cd4-28fe-4113-9e3f-afda6e3fafa7-iptables-alerter-script\") pod \"iptables-alerter-rm6v2\" (UID: \"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7\") " pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.716247 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.716173 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5plf6\" (UniqueName: \"kubernetes.io/projected/aaed4cd4-28fe-4113-9e3f-afda6e3fafa7-kube-api-access-5plf6\") pod \"iptables-alerter-rm6v2\" (UID: \"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7\") " pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:04.716247 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.716210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vft8f\" (UniqueName: \"kubernetes.io/projected/7dd1832a-5a40-4e13-8cd7-1db0de605be7-kube-api-access-vft8f\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:04.716435 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.716392 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l682l\" (UniqueName: \"kubernetes.io/projected/3459f66f-8695-4dee-9647-e43b6687e566-kube-api-access-l682l\") pod \"multus-additional-cni-plugins-ptzmk\" (UID: \"3459f66f-8695-4dee-9647-e43b6687e566\") " pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.716618 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.716595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9rrn\" (UniqueName: \"kubernetes.io/projected/76d18c9e-7229-4038-805e-de5730bc8e99-kube-api-access-d9rrn\") pod \"multus-lrcm7\" (UID: \"76d18c9e-7229-4038-805e-de5730bc8e99\") " pod="openshift-multus/multus-lrcm7" May 27 17:58:04.789691 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.789654 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:04.796478 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.796450 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgqft" May 27 17:58:04.806395 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.806363 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7wwsk" May 27 17:58:04.811146 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.811120 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:04.817839 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.817811 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" May 27 17:58:04.823532 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.823511 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p9brj" May 27 17:58:04.830136 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.830113 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" May 27 17:58:04.836810 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.836783 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lrcm7" May 27 17:58:04.843384 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:04.843360 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rm6v2" May 27 17:58:05.208863 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.208787 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:05.208863 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.208836 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:05.209050 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:05.208911 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:05.209050 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:05.208960 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:58:05.209050 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:05.208974 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:58:05.209050 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:05.208984 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs podName:7dd1832a-5a40-4e13-8cd7-1db0de605be7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:06.208963117 +0000 UTC m=+4.226173685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs") pod "network-metrics-daemon-pghnx" (UID: "7dd1832a-5a40-4e13-8cd7-1db0de605be7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:05.209050 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:05.209002 2576 projected.go:194] Error preparing data for projected volume kube-api-access-s5pgx for pod openshift-network-diagnostics/network-check-target-2rhkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:05.209222 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:05.209067 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx podName:68c7b24b-a653-4767-9dc9-d2bcab402003 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:06.209042564 +0000 UTC m=+4.226253120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5pgx" (UniqueName: "kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx") pod "network-check-target-2rhkj" (UID: "68c7b24b-a653-4767-9dc9-d2bcab402003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:05.247076 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:05.247050 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d18c9e_7229_4038_805e_de5730bc8e99.slice/crio-3bdad7ca485b3c2d732e03bf477486725eb3d05914cb94bff9e066028ec62b88 WatchSource:0}: Error finding container 3bdad7ca485b3c2d732e03bf477486725eb3d05914cb94bff9e066028ec62b88: Status 404 returned error can't find the container with id 3bdad7ca485b3c2d732e03bf477486725eb3d05914cb94bff9e066028ec62b88 May 27 17:58:05.256550 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:05.256432 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1160d555_a418_4723_83e8_650f2eda3a4b.slice/crio-cb346603163ffa0ed1736e0d1efca1caec3796a00783874164a309f697593b1b WatchSource:0}: Error finding container cb346603163ffa0ed1736e0d1efca1caec3796a00783874164a309f697593b1b: Status 404 returned error can't find the container with id cb346603163ffa0ed1736e0d1efca1caec3796a00783874164a309f697593b1b May 27 17:58:05.257126 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:05.257106 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f6af9e_bcd3_46bd_a82b_b559d3aa1e0a.slice/crio-48ea2ac5341eddcf5c1164236d35f89b4b6e03c06a388f13570045bfcc8d3cc7 WatchSource:0}: Error finding container 48ea2ac5341eddcf5c1164236d35f89b4b6e03c06a388f13570045bfcc8d3cc7: Status 404 returned error can't find the container with id 48ea2ac5341eddcf5c1164236d35f89b4b6e03c06a388f13570045bfcc8d3cc7 May 27 17:58:05.259243 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:05.259071 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3459f66f_8695_4dee_9647_e43b6687e566.slice/crio-0137fa86d3690136fe21f22e0bb2cf0d0f454e7c81764dd97ee984a0490e078e WatchSource:0}: Error finding container 0137fa86d3690136fe21f22e0bb2cf0d0f454e7c81764dd97ee984a0490e078e: Status 404 returned error can't find the container with id 0137fa86d3690136fe21f22e0bb2cf0d0f454e7c81764dd97ee984a0490e078e May 27 17:58:05.260024 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:05.259646 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aef902f_4204_4aeb_a69c_c11fe3c61853.slice/crio-d45c6c98c39770092915088faf20c5b6fca584ef1fc26c387c10b04c93612e45 WatchSource:0}: Error finding container d45c6c98c39770092915088faf20c5b6fca584ef1fc26c387c10b04c93612e45: Status 404 returned error can't find the container with id d45c6c98c39770092915088faf20c5b6fca584ef1fc26c387c10b04c93612e45 May 27 17:58:05.261110 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:05.261053 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990d6269_96d8_480d_a99d_6c5f5b46a803.slice/crio-e0c6d6be284dc60c8984ceb497879fcc1994d327d819c4187c25af38318ad65a WatchSource:0}: Error finding container e0c6d6be284dc60c8984ceb497879fcc1994d327d819c4187c25af38318ad65a: Status 404 returned error can't find the container with id e0c6d6be284dc60c8984ceb497879fcc1994d327d819c4187c25af38318ad65a May 27 17:58:05.263971 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:05.262624 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c59b1d_e537_4702_be1d_c421b8a61bc9.slice/crio-d3c30b60a84d8e6b9c1972b3b91cbc815c007e2d03ca4ae4d95fb6ff5e26d483 WatchSource:0}: Error finding container d3c30b60a84d8e6b9c1972b3b91cbc815c007e2d03ca4ae4d95fb6ff5e26d483: Status 404 returned error can't find the container with id d3c30b60a84d8e6b9c1972b3b91cbc815c007e2d03ca4ae4d95fb6ff5e26d483 May 27 17:58:05.527337 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.527138 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:53:03 +0000 UTC" deadline="2028-01-06 08:49:27.611876559 +0000 UTC" May 27 17:58:05.527337 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.527330 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14126h51m22.084549698s" May 27 17:58:05.563621 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.563590 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgqft" event={"ID":"1160d555-a418-4723-83e8-650f2eda3a4b","Type":"ContainerStarted","Data":"cb346603163ffa0ed1736e0d1efca1caec3796a00783874164a309f697593b1b"} May 27 17:58:05.564667 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.564633 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p9brj" event={"ID":"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830","Type":"ContainerStarted","Data":"3a2039d8525b87c591e156baca235235f162cf67db78f1841803cf74637882d6"} May 27 17:58:05.567190 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.567156 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" event={"ID":"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a","Type":"ContainerStarted","Data":"48ea2ac5341eddcf5c1164236d35f89b4b6e03c06a388f13570045bfcc8d3cc7"} May 27 17:58:05.568143 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.568110 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nk7h2" event={"ID":"990d6269-96d8-480d-a99d-6c5f5b46a803","Type":"ContainerStarted","Data":"e0c6d6be284dc60c8984ceb497879fcc1994d327d819c4187c25af38318ad65a"} May 27 17:58:05.569030 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.569011 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" event={"ID":"3459f66f-8695-4dee-9647-e43b6687e566","Type":"ContainerStarted","Data":"0137fa86d3690136fe21f22e0bb2cf0d0f454e7c81764dd97ee984a0490e078e"} May 27 17:58:05.569854 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.569834 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rm6v2" event={"ID":"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7","Type":"ContainerStarted","Data":"d9b2289156fd8f2013072d184f09f9ccb38f4746adc602f3f5d1baeb850b79be"} May 27 17:58:05.570876 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.570855 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lrcm7" event={"ID":"76d18c9e-7229-4038-805e-de5730bc8e99","Type":"ContainerStarted","Data":"3bdad7ca485b3c2d732e03bf477486725eb3d05914cb94bff9e066028ec62b88"} May 27 17:58:05.572012 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.571989 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal" event={"ID":"a2852ca49b9c606f03d1e5f901e33e53","Type":"ContainerStarted","Data":"9d6c9ef54cf95b9ecd8f703b2dd569b3d7ba109df48ab8bf2d2485cf979fdb35"} May 27 17:58:05.572894 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.572874 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" event={"ID":"04c59b1d-e537-4702-be1d-c421b8a61bc9","Type":"ContainerStarted","Data":"d3c30b60a84d8e6b9c1972b3b91cbc815c007e2d03ca4ae4d95fb6ff5e26d483"} May 27 17:58:05.573790 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:05.573772 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7wwsk" event={"ID":"7aef902f-4204-4aeb-a69c-c11fe3c61853","Type":"ContainerStarted","Data":"d45c6c98c39770092915088faf20c5b6fca584ef1fc26c387c10b04c93612e45"} May 27 17:58:06.216841 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:06.216786 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:06.217105 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:06.216879 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:06.217105 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:06.217031 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:58:06.217105 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:06.217049 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:58:06.217105 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:06.217062 2576 projected.go:194] Error preparing data for projected volume kube-api-access-s5pgx for pod openshift-network-diagnostics/network-check-target-2rhkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:06.217404 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:06.217123 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx podName:68c7b24b-a653-4767-9dc9-d2bcab402003 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:08.217103528 +0000 UTC m=+6.234314092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5pgx" (UniqueName: "kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx") pod "network-check-target-2rhkj" (UID: "68c7b24b-a653-4767-9dc9-d2bcab402003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:06.217598 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:06.217580 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:06.217667 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:06.217639 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs podName:7dd1832a-5a40-4e13-8cd7-1db0de605be7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:08.217622258 +0000 UTC m=+6.234832829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs") pod "network-metrics-daemon-pghnx" (UID: "7dd1832a-5a40-4e13-8cd7-1db0de605be7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:06.557416 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:06.557319 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:06.557869 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:06.557455 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:06.560122 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:06.560097 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:06.560249 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:06.560224 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:06.601313 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:06.600821 2576 generic.go:358] "Generic (PLEG): container finished" podID="ab4681f288c4abcda995b97fb3d39c13" containerID="0c990857b521c39d8c43e3aa74d52af3d256490432ef4d18f057f61d45486680" exitCode=0 May 27 17:58:06.601616 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:06.601558 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" event={"ID":"ab4681f288c4abcda995b97fb3d39c13","Type":"ContainerDied","Data":"0c990857b521c39d8c43e3aa74d52af3d256490432ef4d18f057f61d45486680"} May 27 17:58:06.616355 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:06.616239 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-157.ec2.internal" podStartSLOduration=2.616219729 podStartE2EDuration="2.616219729s" podCreationTimestamp="2026-05-27 17:58:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:58:05.598976955 +0000 UTC m=+3.616187532" watchObservedRunningTime="2026-05-27 17:58:06.616219729 +0000 UTC m=+4.633430311" May 27 17:58:07.620205 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:07.620162 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" event={"ID":"ab4681f288c4abcda995b97fb3d39c13","Type":"ContainerStarted","Data":"df1a86d358b4420ed910abfc460a990c557e11953c59c583d9bc7116cb82cf05"} May 27 17:58:08.236142 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:08.236097 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:08.236341 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:08.236178 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:08.236341 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:08.236329 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:08.236485 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:08.236394 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs podName:7dd1832a-5a40-4e13-8cd7-1db0de605be7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:12.23637368 +0000 UTC m=+10.253584251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs") pod "network-metrics-daemon-pghnx" (UID: "7dd1832a-5a40-4e13-8cd7-1db0de605be7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:08.236997 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:08.236847 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:58:08.236997 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:08.236875 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:58:08.236997 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:08.236888 2576 projected.go:194] Error preparing data for projected volume kube-api-access-s5pgx for pod openshift-network-diagnostics/network-check-target-2rhkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:08.236997 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:08.236938 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx podName:68c7b24b-a653-4767-9dc9-d2bcab402003 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:12.236921929 +0000 UTC m=+10.254132500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5pgx" (UniqueName: "kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx") pod "network-check-target-2rhkj" (UID: "68c7b24b-a653-4767-9dc9-d2bcab402003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:08.558008 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:08.557879 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:08.558159 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:08.558023 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:08.558159 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:08.558080 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:08.558301 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:08.558182 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:10.557013 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:10.556977 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:10.557474 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:10.557124 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:10.557474 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:10.557180 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:10.557474 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:10.557318 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:12.272062 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:12.272022 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:12.272559 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:12.272101 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:12.272559 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:12.272237 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:12.272559 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:12.272319 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs podName:7dd1832a-5a40-4e13-8cd7-1db0de605be7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:20.272298501 +0000 UTC m=+18.289509070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs") pod "network-metrics-daemon-pghnx" (UID: "7dd1832a-5a40-4e13-8cd7-1db0de605be7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:12.272872 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:12.272759 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:58:12.272872 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:12.272784 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:58:12.272872 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:12.272796 2576 projected.go:194] Error preparing data for projected volume kube-api-access-s5pgx for pod openshift-network-diagnostics/network-check-target-2rhkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:12.272872 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:12.272843 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx podName:68c7b24b-a653-4767-9dc9-d2bcab402003 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:20.27282743 +0000 UTC m=+18.290038000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5pgx" (UniqueName: "kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx") pod "network-check-target-2rhkj" (UID: "68c7b24b-a653-4767-9dc9-d2bcab402003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:12.556429 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:12.556350 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:12.557097 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:12.556689 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:12.558161 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:12.557806 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:12.558273 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:12.558196 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:14.556770 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:14.556732 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:14.557266 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:14.556788 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:14.557266 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:14.556878 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:14.557266 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:14.556999 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:16.559896 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:16.559854 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:16.560509 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:16.559861 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:16.560509 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:16.559977 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:16.560509 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:16.560029 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:18.557171 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:18.557122 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:18.557543 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:18.557277 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:18.557879 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:18.557850 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:18.557988 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:18.557975 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:20.332691 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:20.332649 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:20.333201 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:20.332810 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:20.333201 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:20.332849 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:58:20.333201 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:20.332881 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:58:20.333201 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:20.332895 2576 projected.go:194] Error preparing data for projected volume kube-api-access-s5pgx for pod openshift-network-diagnostics/network-check-target-2rhkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:20.333201 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:20.332921 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:20.333201 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:20.332965 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx podName:68c7b24b-a653-4767-9dc9-d2bcab402003 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:36.332944623 +0000 UTC m=+34.350155183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5pgx" (UniqueName: "kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx") pod "network-check-target-2rhkj" (UID: "68c7b24b-a653-4767-9dc9-d2bcab402003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:20.333201 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:20.332988 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs podName:7dd1832a-5a40-4e13-8cd7-1db0de605be7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:36.332976758 +0000 UTC m=+34.350187317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs") pod "network-metrics-daemon-pghnx" (UID: "7dd1832a-5a40-4e13-8cd7-1db0de605be7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:20.556835 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:20.556690 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:20.556835 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:20.556738 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:20.556835 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:20.556830 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:20.557129 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:20.556951 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:22.557481 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:22.557450 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:22.558005 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:22.557564 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:22.558005 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:22.557624 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:22.558005 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:22.557751 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:23.648230 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:23.648192 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nk7h2" event={"ID":"990d6269-96d8-480d-a99d-6c5f5b46a803","Type":"ContainerStarted","Data":"da9e4ecfc958121656614b68cee6622963540b264e4d844f1f1b0f292ac25cd0"} May 27 17:58:23.650737 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:23.650709 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7wwsk" event={"ID":"7aef902f-4204-4aeb-a69c-c11fe3c61853","Type":"ContainerStarted","Data":"cd6d9b71d7fbc4e51a3756859a9e3cba3e01466e4bb3e895bbbe02015a64bb26"} May 27 17:58:23.651815 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:23.651794 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgqft" event={"ID":"1160d555-a418-4723-83e8-650f2eda3a4b","Type":"ContainerStarted","Data":"e97f371f30d4d4b097cdb7e0c5971c17884f455ece26265501fccae3e59dde6f"} May 27 17:58:23.673404 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:23.672960 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-157.ec2.internal" podStartSLOduration=20.672946185 podStartE2EDuration="20.672946185s" podCreationTimestamp="2026-05-27 17:58:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:58:07.63718154 +0000 UTC m=+5.654392117" watchObservedRunningTime="2026-05-27 17:58:23.672946185 +0000 UTC m=+21.690156762" May 27 17:58:23.691808 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:23.690487 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7wwsk" podStartSLOduration=11.734659034 podStartE2EDuration="21.690474241s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:58:05.26236892 +0000 UTC m=+3.279579490" lastFinishedPulling="2026-05-27 17:58:15.218184127 +0000 UTC m=+13.235394697" observedRunningTime="2026-05-27 17:58:23.672937605 +0000 UTC m=+21.690148182" watchObservedRunningTime="2026-05-27 17:58:23.690474241 +0000 UTC m=+21.707684818" May 27 17:58:23.691808 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:23.691404 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nk7h2" podStartSLOduration=3.5467585059999998 podStartE2EDuration="21.691394685s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:58:05.265726218 +0000 UTC m=+3.282936772" lastFinishedPulling="2026-05-27 17:58:23.410362396 +0000 UTC m=+21.427572951" observedRunningTime="2026-05-27 17:58:23.690372501 +0000 UTC m=+21.707583078" watchObservedRunningTime="2026-05-27 17:58:23.691394685 +0000 UTC m=+21.708605264" May 27 17:58:23.711998 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:23.711955 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-dgqft" podStartSLOduration=3.590556352 podStartE2EDuration="21.711940316s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:58:05.258427503 +0000 UTC m=+3.275638061" lastFinishedPulling="2026-05-27 17:58:23.379811463 +0000 UTC m=+21.397022025" observedRunningTime="2026-05-27 17:58:23.71169712 +0000 UTC m=+21.728907698" watchObservedRunningTime="2026-05-27 17:58:23.711940316 +0000 UTC m=+21.729150893" May 27 17:58:24.557402 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.557132 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:24.557555 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.557178 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:24.557555 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:24.557514 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:24.557636 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:24.557566 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:24.582458 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.582430 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 17:58:24.655204 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.655167 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p9brj" event={"ID":"8d032c0b-cbe5-40e8-8fd2-e54eba9f5830","Type":"ContainerStarted","Data":"0e1264da816c00ba94f68f51c278aab663aec0cfe96efaa78fb64c0defa1d9ed"} May 27 17:58:24.657702 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.657665 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" event={"ID":"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a","Type":"ContainerStarted","Data":"16d4df73c86601b75fffaf8d35796b85b45e627c15c0dd08270f88b44a8b1955"} May 27 17:58:24.657702 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.657705 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" event={"ID":"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a","Type":"ContainerStarted","Data":"47076f4618037b69d815e6190c1d998a483e7d9a43972b1db4700d8772bfce4b"} May 27 17:58:24.657883 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.657717 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" event={"ID":"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a","Type":"ContainerStarted","Data":"023d59d6dfd43a81d7584f436d789a1a4430650e902e281a5afc75fd8300e26b"} May 27 17:58:24.657883 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.657730 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" event={"ID":"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a","Type":"ContainerStarted","Data":"fdf74e11609bfdc38a867b168aa17c67db36e05857a758dcc767f67f6cdd1d46"} May 27 17:58:24.657883 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.657741 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" event={"ID":"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a","Type":"ContainerStarted","Data":"231a492a46304a2c3c4b67fa548fc6a316e6bebb6952212b59cfb31527a32b1b"} May 27 17:58:24.657883 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.657754 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" event={"ID":"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a","Type":"ContainerStarted","Data":"ccb427f48610d825def25e44f4abaed4bc73482c82c50880ca3703ea1cea52ac"} May 27 17:58:24.658950 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.658924 2576 generic.go:358] "Generic (PLEG): container finished" podID="3459f66f-8695-4dee-9647-e43b6687e566" containerID="18542541237bf396c41ba7058b1c2fc892ac56eb031b7d3a82afd7e1408b9095" exitCode=0 May 27 17:58:24.659096 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.659000 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" event={"ID":"3459f66f-8695-4dee-9647-e43b6687e566","Type":"ContainerDied","Data":"18542541237bf396c41ba7058b1c2fc892ac56eb031b7d3a82afd7e1408b9095"} May 27 17:58:24.660388 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.660255 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lrcm7" event={"ID":"76d18c9e-7229-4038-805e-de5730bc8e99","Type":"ContainerStarted","Data":"220557567c7ac663efc69e607c2cefb1e45740b4f34c85d965226f80e46b776f"} May 27 17:58:24.661955 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.661934 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" event={"ID":"04c59b1d-e537-4702-be1d-c421b8a61bc9","Type":"ContainerStarted","Data":"10e1cddc1c499cea58085dc276770147d0563a3352fd1b2271d9d64fa176daf5"} May 27 17:58:24.662026 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.661976 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" event={"ID":"04c59b1d-e537-4702-be1d-c421b8a61bc9","Type":"ContainerStarted","Data":"6c4d5a9af5e81ae7a3f836683c8e4cf1cbe360393ee4be7f25c5644395ede5b5"} May 27 17:58:24.691248 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.691190 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p9brj" podStartSLOduration=4.532897382 podStartE2EDuration="22.691177871s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:58:05.254420149 +0000 UTC m=+3.271630721" lastFinishedPulling="2026-05-27 17:58:23.412700654 +0000 UTC m=+21.429911210" observedRunningTime="2026-05-27 17:58:24.672928569 +0000 UTC m=+22.690139158" watchObservedRunningTime="2026-05-27 17:58:24.691177871 +0000 UTC m=+22.708388448" May 27 17:58:24.691479 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:24.691430 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-lrcm7" podStartSLOduration=4.522514786 podStartE2EDuration="22.691421744s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:58:05.249019484 +0000 UTC m=+3.266230054" lastFinishedPulling="2026-05-27 17:58:23.417926454 +0000 UTC m=+21.435137012" observedRunningTime="2026-05-27 17:58:24.691154538 +0000 UTC m=+22.708365115" watchObservedRunningTime="2026-05-27 17:58:24.691421744 +0000 UTC m=+22.708632323" May 27 17:58:25.511828 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.511791 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:25.512450 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.512423 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:25.563077 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.562974 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T17:58:24.582452942Z","UUID":"111dc4e8-ca83-4e1b-9e36-36b02e4bdab2","Handler":null,"Name":"","Endpoint":""} May 27 17:58:25.565396 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.565373 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 17:58:25.565524 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.565403 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 17:58:25.664970 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.664934 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rm6v2" event={"ID":"aaed4cd4-28fe-4113-9e3f-afda6e3fafa7","Type":"ContainerStarted","Data":"7f619c99645ca55ec955e4555524ed280c8273d2d94556e754c25631676cdb1f"} May 27 17:58:25.667627 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.667543 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" event={"ID":"04c59b1d-e537-4702-be1d-c421b8a61bc9","Type":"ContainerStarted","Data":"73ce059de564225abceae98929c1266fc9c092387b097f1334e987fd3a2acb35"} May 27 17:58:25.667863 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.667689 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:25.669716 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.669036 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nk7h2" May 27 17:58:25.680221 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.680171 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rm6v2" podStartSLOduration=5.524391817 podStartE2EDuration="23.680156494s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:58:05.254489159 +0000 UTC m=+3.271699723" lastFinishedPulling="2026-05-27 17:58:23.41025384 +0000 UTC m=+21.427464400" observedRunningTime="2026-05-27 17:58:25.680055827 +0000 UTC m=+23.697266404" watchObservedRunningTime="2026-05-27 17:58:25.680156494 +0000 UTC m=+23.697367070" May 27 17:58:25.711135 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:25.711077 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k84q2" podStartSLOduration=3.414666595 podStartE2EDuration="23.711063017s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:58:05.265754807 +0000 UTC m=+3.282965365" lastFinishedPulling="2026-05-27 17:58:25.562151208 +0000 UTC m=+23.579361787" observedRunningTime="2026-05-27 17:58:25.710602685 +0000 UTC m=+23.727813263" watchObservedRunningTime="2026-05-27 17:58:25.711063017 +0000 UTC m=+23.728273593" May 27 17:58:26.556427 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:26.556326 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:26.556427 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:26.556360 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:26.556650 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:26.556465 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:26.556650 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:26.556585 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:26.672638 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:26.672568 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" event={"ID":"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a","Type":"ContainerStarted","Data":"8bc1281f940986b9fc6912c1014f732dea702ac640a041235c665c1d3abe27ea"} May 27 17:58:28.557487 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:28.557241 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:28.557882 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:28.557252 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:28.557882 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:28.557627 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:28.557882 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:28.557646 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:28.681275 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:28.681173 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" event={"ID":"d3f6af9e-bcd3-46bd-a82b-b559d3aa1e0a","Type":"ContainerStarted","Data":"6744358d61e15d6e4506b96dd7e4a7a4763e9934fb126bfa3437b6f28dab8483"} May 27 17:58:28.681570 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:28.681538 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:28.681621 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:28.681572 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:28.696734 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:28.696706 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:28.710537 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:28.710485 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" podStartSLOduration=8.511879148 podStartE2EDuration="26.71047151s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:58:05.258873576 +0000 UTC m=+3.276084132" lastFinishedPulling="2026-05-27 17:58:23.45746592 +0000 UTC m=+21.474676494" observedRunningTime="2026-05-27 17:58:28.709886606 +0000 UTC m=+26.727097174" watchObservedRunningTime="2026-05-27 17:58:28.71047151 +0000 UTC m=+26.727682087" May 27 17:58:29.685161 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:29.685116 2576 generic.go:358] "Generic (PLEG): container finished" podID="3459f66f-8695-4dee-9647-e43b6687e566" containerID="9baf65ca0552b83276e35bfab96ca478bbe550b63de33ebe67c158e38912129b" exitCode=0 May 27 17:58:29.685858 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:29.685220 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" event={"ID":"3459f66f-8695-4dee-9647-e43b6687e566","Type":"ContainerDied","Data":"9baf65ca0552b83276e35bfab96ca478bbe550b63de33ebe67c158e38912129b"} May 27 17:58:29.685858 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:29.685830 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:29.701301 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:29.701242 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:58:30.553631 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:30.553389 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pghnx"] May 27 17:58:30.553797 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:30.553753 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:30.553891 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:30.553866 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:30.554198 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:30.554020 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2rhkj"] May 27 17:58:30.554198 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:30.554116 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:30.554198 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:30.554179 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:31.691619 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:31.691581 2576 generic.go:358] "Generic (PLEG): container finished" podID="3459f66f-8695-4dee-9647-e43b6687e566" containerID="415781d04fbb0b143b33e4445a7cc6f1714590d7522add78eb86e3bead6c9745" exitCode=0 May 27 17:58:31.692041 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:31.691676 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" event={"ID":"3459f66f-8695-4dee-9647-e43b6687e566","Type":"ContainerDied","Data":"415781d04fbb0b143b33e4445a7cc6f1714590d7522add78eb86e3bead6c9745"} May 27 17:58:32.559794 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:32.559762 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:32.559978 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:32.559889 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:32.560327 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:32.560307 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:32.560420 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:32.560396 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:33.697589 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:33.697402 2576 generic.go:358] "Generic (PLEG): container finished" podID="3459f66f-8695-4dee-9647-e43b6687e566" containerID="b27d832065110013cc1c41d515c6548f3ed30666f148bc34d3a3b24d0451bb9b" exitCode=0 May 27 17:58:33.697589 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:33.697487 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" event={"ID":"3459f66f-8695-4dee-9647-e43b6687e566","Type":"ContainerDied","Data":"b27d832065110013cc1c41d515c6548f3ed30666f148bc34d3a3b24d0451bb9b"} May 27 17:58:34.556986 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:34.556954 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:34.557198 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:34.557082 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rhkj" podUID="68c7b24b-a653-4767-9dc9-d2bcab402003" May 27 17:58:34.557198 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:34.557139 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:34.557333 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:34.557268 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pghnx" podUID="7dd1832a-5a40-4e13-8cd7-1db0de605be7" May 27 17:58:36.329391 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.329315 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-157.ec2.internal" event="NodeReady" May 27 17:58:36.329761 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.329448 2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 17:58:36.343440 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.343405 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:36.343651 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.343471 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:36.343651 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.343585 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:58:36.343651 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.343606 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:58:36.343651 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.343619 2576 projected.go:194] Error preparing data for projected volume kube-api-access-s5pgx for pod openshift-network-diagnostics/network-check-target-2rhkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:36.343651 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.343636 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:36.343881 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.343684 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx podName:68c7b24b-a653-4767-9dc9-d2bcab402003 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:08.343663332 +0000 UTC m=+66.360873887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5pgx" (UniqueName: "kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx") pod "network-check-target-2rhkj" (UID: "68c7b24b-a653-4767-9dc9-d2bcab402003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:58:36.343881 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.343709 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs podName:7dd1832a-5a40-4e13-8cd7-1db0de605be7 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:08.343699792 +0000 UTC m=+66.360910347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs") pod "network-metrics-daemon-pghnx" (UID: "7dd1832a-5a40-4e13-8cd7-1db0de605be7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:58:36.373678 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.373644 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p7642"] May 27 17:58:36.411352 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.411320 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x6f5h"] May 27 17:58:36.411563 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.411538 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p7642" May 27 17:58:36.414311 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.414270 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 17:58:36.414437 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.414338 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdfkw\"" May 27 17:58:36.414437 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.414356 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 17:58:36.450150 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.450110 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p7642"] May 27 17:58:36.450150 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.450147 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x6f5h"] May 27 17:58:36.450409 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.450270 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:36.453171 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.453135 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 17:58:36.453364 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.453136 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 17:58:36.453364 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.453135 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 17:58:36.453569 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.453554 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mszw7\"" May 27 17:58:36.544499 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.544464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6chc\" (UniqueName: \"kubernetes.io/projected/70a6983a-b7e9-44c6-b242-f2372a5df5d7-kube-api-access-t6chc\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.544706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.544507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:36.544706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.544607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.544706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.544655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a6983a-b7e9-44c6-b242-f2372a5df5d7-tmp-dir\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.544706 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.544703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g889\" (UniqueName: \"kubernetes.io/projected/bcc45bf4-25bc-4563-a285-3aa33227a9de-kube-api-access-6g889\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:36.544865 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.544740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a6983a-b7e9-44c6-b242-f2372a5df5d7-config-volume\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.556721 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.556684 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:58:36.556721 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.556716 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:58:36.560433 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.560404 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 17:58:36.560433 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.560440 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 17:58:36.560645 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.560460 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f6v4b\"" May 27 17:58:36.560645 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.560511 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 17:58:36.560814 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.560798 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-snwzs\"" May 27 17:58:36.646101 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.646068 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a6983a-b7e9-44c6-b242-f2372a5df5d7-config-volume\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.646326 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.646108 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6chc\" (UniqueName: \"kubernetes.io/projected/70a6983a-b7e9-44c6-b242-f2372a5df5d7-kube-api-access-t6chc\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.646326 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.646141 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:36.646326 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.646248 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:58:36.646506 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.646335 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert podName:bcc45bf4-25bc-4563-a285-3aa33227a9de nodeName:}" failed. No retries permitted until 2026-05-27 17:58:37.146315642 +0000 UTC m=+35.163526209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert") pod "ingress-canary-x6f5h" (UID: "bcc45bf4-25bc-4563-a285-3aa33227a9de") : secret "canary-serving-cert" not found May 27 17:58:36.646582 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.646513 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.646582 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.646542 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a6983a-b7e9-44c6-b242-f2372a5df5d7-tmp-dir\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.646681 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.646579 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6g889\" (UniqueName: \"kubernetes.io/projected/bcc45bf4-25bc-4563-a285-3aa33227a9de-kube-api-access-6g889\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:36.646814 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.646759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a6983a-b7e9-44c6-b242-f2372a5df5d7-config-volume\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.646938 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.646869 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:58:36.646997 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:36.646943 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls podName:70a6983a-b7e9-44c6-b242-f2372a5df5d7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:37.146924704 +0000 UTC m=+35.164135266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls") pod "dns-default-p7642" (UID: "70a6983a-b7e9-44c6-b242-f2372a5df5d7") : secret "dns-default-metrics-tls" not found May 27 17:58:36.647056 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.647010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a6983a-b7e9-44c6-b242-f2372a5df5d7-tmp-dir\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.658217 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.658184 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6chc\" (UniqueName: \"kubernetes.io/projected/70a6983a-b7e9-44c6-b242-f2372a5df5d7-kube-api-access-t6chc\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:36.658527 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:36.658506 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g889\" (UniqueName: \"kubernetes.io/projected/bcc45bf4-25bc-4563-a285-3aa33227a9de-kube-api-access-6g889\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:37.150203 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:37.150166 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:37.150421 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:37.150241 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:37.150421 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:37.150328 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:58:37.150421 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:37.150402 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:58:37.150555 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:37.150472 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert podName:bcc45bf4-25bc-4563-a285-3aa33227a9de nodeName:}" failed. No retries permitted until 2026-05-27 17:58:38.150448641 +0000 UTC m=+36.167659203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert") pod "ingress-canary-x6f5h" (UID: "bcc45bf4-25bc-4563-a285-3aa33227a9de") : secret "canary-serving-cert" not found May 27 17:58:37.150555 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:37.150492 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls podName:70a6983a-b7e9-44c6-b242-f2372a5df5d7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:38.150481573 +0000 UTC m=+36.167692142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls") pod "dns-default-p7642" (UID: "70a6983a-b7e9-44c6-b242-f2372a5df5d7") : secret "dns-default-metrics-tls" not found May 27 17:58:38.158865 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:38.158832 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:38.159501 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:38.158982 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:58:38.159501 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:38.159005 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:38.159501 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:38.159047 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls podName:70a6983a-b7e9-44c6-b242-f2372a5df5d7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:40.159029123 +0000 UTC m=+38.176239723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls") pod "dns-default-p7642" (UID: "70a6983a-b7e9-44c6-b242-f2372a5df5d7") : secret "dns-default-metrics-tls" not found May 27 17:58:38.159501 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:38.159113 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:58:38.159501 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:38.159161 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert podName:bcc45bf4-25bc-4563-a285-3aa33227a9de nodeName:}" failed. No retries permitted until 2026-05-27 17:58:40.159145537 +0000 UTC m=+38.176356109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert") pod "ingress-canary-x6f5h" (UID: "bcc45bf4-25bc-4563-a285-3aa33227a9de") : secret "canary-serving-cert" not found May 27 17:58:40.173044 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:40.172996 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:40.173660 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:40.173176 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:58:40.173660 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:40.173236 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls podName:70a6983a-b7e9-44c6-b242-f2372a5df5d7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:44.173221168 +0000 UTC m=+42.190431726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls") pod "dns-default-p7642" (UID: "70a6983a-b7e9-44c6-b242-f2372a5df5d7") : secret "dns-default-metrics-tls" not found May 27 17:58:40.173660 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:40.173177 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:40.173660 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:40.173263 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:58:40.173660 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:40.173342 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert podName:bcc45bf4-25bc-4563-a285-3aa33227a9de nodeName:}" failed. No retries permitted until 2026-05-27 17:58:44.173325335 +0000 UTC m=+42.190535908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert") pod "ingress-canary-x6f5h" (UID: "bcc45bf4-25bc-4563-a285-3aa33227a9de") : secret "canary-serving-cert" not found May 27 17:58:42.716731 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:42.716693 2576 generic.go:358] "Generic (PLEG): container finished" podID="3459f66f-8695-4dee-9647-e43b6687e566" containerID="d6ae6d4638dbc5c6e06b389453b274cc083999d883693bed407703b4b410261a" exitCode=0 May 27 17:58:42.717206 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:42.716762 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" event={"ID":"3459f66f-8695-4dee-9647-e43b6687e566","Type":"ContainerDied","Data":"d6ae6d4638dbc5c6e06b389453b274cc083999d883693bed407703b4b410261a"} May 27 17:58:43.721781 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:43.721746 2576 generic.go:358] "Generic (PLEG): container finished" podID="3459f66f-8695-4dee-9647-e43b6687e566" containerID="a7ee19ab6ba695cb1ebbd290c8953e6fd38355792d6e57d5508de6b1a0355866" exitCode=0 May 27 17:58:43.722157 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:43.721803 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" event={"ID":"3459f66f-8695-4dee-9647-e43b6687e566","Type":"ContainerDied","Data":"a7ee19ab6ba695cb1ebbd290c8953e6fd38355792d6e57d5508de6b1a0355866"} May 27 17:58:44.205816 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:44.205768 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:44.205991 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:44.205835 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:44.205991 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:44.205912 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:58:44.205991 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:44.205937 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:58:44.205991 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:44.205984 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert podName:bcc45bf4-25bc-4563-a285-3aa33227a9de nodeName:}" failed. No retries permitted until 2026-05-27 17:58:52.20596561 +0000 UTC m=+50.223176165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert") pod "ingress-canary-x6f5h" (UID: "bcc45bf4-25bc-4563-a285-3aa33227a9de") : secret "canary-serving-cert" not found May 27 17:58:44.206126 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:44.205999 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls podName:70a6983a-b7e9-44c6-b242-f2372a5df5d7 nodeName:}" failed. No retries permitted until 2026-05-27 17:58:52.205993309 +0000 UTC m=+50.223203864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls") pod "dns-default-p7642" (UID: "70a6983a-b7e9-44c6-b242-f2372a5df5d7") : secret "dns-default-metrics-tls" not found May 27 17:58:44.729790 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:44.729754 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" event={"ID":"3459f66f-8695-4dee-9647-e43b6687e566","Type":"ContainerStarted","Data":"9fb8e8d75360e28b5c522b54b1f98a70c210a90a4b917812913f1cbd41459c7f"} May 27 17:58:44.754609 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:44.754556 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ptzmk" podStartSLOduration=6.437850673 podStartE2EDuration="42.754542397s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:58:05.261621684 +0000 UTC m=+3.278832243" lastFinishedPulling="2026-05-27 17:58:41.578313413 +0000 UTC m=+39.595523967" observedRunningTime="2026-05-27 17:58:44.753059401 +0000 UTC m=+42.770269979" watchObservedRunningTime="2026-05-27 17:58:44.754542397 +0000 UTC m=+42.771752973" May 27 17:58:46.935589 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:46.935551 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v"] May 27 17:58:46.937296 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:46.937267 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:46.941314 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:46.941275 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 27 17:58:46.941575 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:46.941314 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 27 17:58:46.941724 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:46.941710 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 27 17:58:46.941770 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:46.941739 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 27 17:58:46.951799 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:46.951773 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v"] May 27 17:58:47.025430 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.025395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3afc1812-3ca4-4a7a-91f3-e15a29513346-tmp\") pod \"klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v\" (UID: \"3afc1812-3ca4-4a7a-91f3-e15a29513346\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.025621 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.025459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmqc4\" (UniqueName: \"kubernetes.io/projected/3afc1812-3ca4-4a7a-91f3-e15a29513346-kube-api-access-pmqc4\") pod \"klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v\" (UID: \"3afc1812-3ca4-4a7a-91f3-e15a29513346\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.025621 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.025503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3afc1812-3ca4-4a7a-91f3-e15a29513346-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v\" (UID: \"3afc1812-3ca4-4a7a-91f3-e15a29513346\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.126055 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.126013 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmqc4\" (UniqueName: \"kubernetes.io/projected/3afc1812-3ca4-4a7a-91f3-e15a29513346-kube-api-access-pmqc4\") pod \"klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v\" (UID: \"3afc1812-3ca4-4a7a-91f3-e15a29513346\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.126243 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.126108 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3afc1812-3ca4-4a7a-91f3-e15a29513346-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v\" (UID: \"3afc1812-3ca4-4a7a-91f3-e15a29513346\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.126243 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.126155 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3afc1812-3ca4-4a7a-91f3-e15a29513346-tmp\") pod \"klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v\" (UID: \"3afc1812-3ca4-4a7a-91f3-e15a29513346\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.126611 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.126587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3afc1812-3ca4-4a7a-91f3-e15a29513346-tmp\") pod \"klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v\" (UID: \"3afc1812-3ca4-4a7a-91f3-e15a29513346\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.128813 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.128795 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3afc1812-3ca4-4a7a-91f3-e15a29513346-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v\" (UID: \"3afc1812-3ca4-4a7a-91f3-e15a29513346\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.135199 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.135172 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmqc4\" (UniqueName: \"kubernetes.io/projected/3afc1812-3ca4-4a7a-91f3-e15a29513346-kube-api-access-pmqc4\") pod \"klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v\" (UID: \"3afc1812-3ca4-4a7a-91f3-e15a29513346\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.246682 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.246587 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:47.415882 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.415848 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v"] May 27 17:58:47.419133 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:58:47.419098 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afc1812_3ca4_4a7a_91f3_e15a29513346.slice/crio-ce4db83f0797fb2d5429620d85036108ef02c02ada820ea71886c321a9d47b3f WatchSource:0}: Error finding container ce4db83f0797fb2d5429620d85036108ef02c02ada820ea71886c321a9d47b3f: Status 404 returned error can't find the container with id ce4db83f0797fb2d5429620d85036108ef02c02ada820ea71886c321a9d47b3f May 27 17:58:47.736841 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:47.736804 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" event={"ID":"3afc1812-3ca4-4a7a-91f3-e15a29513346","Type":"ContainerStarted","Data":"ce4db83f0797fb2d5429620d85036108ef02c02ada820ea71886c321a9d47b3f"} May 27 17:58:51.745858 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:51.745772 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" event={"ID":"3afc1812-3ca4-4a7a-91f3-e15a29513346","Type":"ContainerStarted","Data":"438b205875de0b941948effdbf4e25028416ce1a051e72d51510b27be0f923f3"} May 27 17:58:51.746238 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:51.745982 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:51.747548 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:51.747527 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" May 27 17:58:51.764254 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:51.764200 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bbb4fdbdc-zpg6v" podStartSLOduration=1.711870524 podStartE2EDuration="5.764186322s" podCreationTimestamp="2026-05-27 17:58:46 +0000 UTC" firstStartedPulling="2026-05-27 17:58:47.420883915 +0000 UTC m=+45.438094471" lastFinishedPulling="2026-05-27 17:58:51.473199711 +0000 UTC m=+49.490410269" observedRunningTime="2026-05-27 17:58:51.763504162 +0000 UTC m=+49.780714740" watchObservedRunningTime="2026-05-27 17:58:51.764186322 +0000 UTC m=+49.781396895" May 27 17:58:52.265709 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:52.265667 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:58:52.265878 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:58:52.265747 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:58:52.265878 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:52.265829 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:58:52.265878 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:52.265829 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:58:52.266049 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:52.265903 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert podName:bcc45bf4-25bc-4563-a285-3aa33227a9de nodeName:}" failed. No retries permitted until 2026-05-27 17:59:08.265887684 +0000 UTC m=+66.283098242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert") pod "ingress-canary-x6f5h" (UID: "bcc45bf4-25bc-4563-a285-3aa33227a9de") : secret "canary-serving-cert" not found May 27 17:58:52.266049 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:58:52.265916 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls podName:70a6983a-b7e9-44c6-b242-f2372a5df5d7 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:08.265910733 +0000 UTC m=+66.283121288 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls") pod "dns-default-p7642" (UID: "70a6983a-b7e9-44c6-b242-f2372a5df5d7") : secret "dns-default-metrics-tls" not found May 27 17:59:01.702078 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:01.702048 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w47xc" May 27 17:59:08.276469 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.276409 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:59:08.276938 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.276498 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:59:08.276938 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:08.276587 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:59:08.276938 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:08.276591 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:59:08.276938 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:08.276666 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert podName:bcc45bf4-25bc-4563-a285-3aa33227a9de nodeName:}" failed. No retries permitted until 2026-05-27 17:59:40.276652541 +0000 UTC m=+98.293863101 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert") pod "ingress-canary-x6f5h" (UID: "bcc45bf4-25bc-4563-a285-3aa33227a9de") : secret "canary-serving-cert" not found May 27 17:59:08.276938 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:08.276682 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls podName:70a6983a-b7e9-44c6-b242-f2372a5df5d7 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:40.27667495 +0000 UTC m=+98.293885519 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls") pod "dns-default-p7642" (UID: "70a6983a-b7e9-44c6-b242-f2372a5df5d7") : secret "dns-default-metrics-tls" not found May 27 17:59:08.377252 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.377204 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 17:59:08.377452 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.377273 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:59:08.379872 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.379852 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 17:59:08.379965 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.379882 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 17:59:08.388013 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:08.387981 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 17:59:08.388156 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:08.388066 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs podName:7dd1832a-5a40-4e13-8cd7-1db0de605be7 nodeName:}" failed. No retries permitted until 2026-05-27 18:00:12.388046591 +0000 UTC m=+130.405257151 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs") pod "network-metrics-daemon-pghnx" (UID: "7dd1832a-5a40-4e13-8cd7-1db0de605be7") : secret "metrics-daemon-secret" not found May 27 17:59:08.390477 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.390459 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 17:59:08.400711 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.400685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5pgx\" (UniqueName: \"kubernetes.io/projected/68c7b24b-a653-4767-9dc9-d2bcab402003-kube-api-access-s5pgx\") pod \"network-check-target-2rhkj\" (UID: \"68c7b24b-a653-4767-9dc9-d2bcab402003\") " pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:59:08.672462 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.672427 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f6v4b\"" May 27 17:59:08.679853 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.679821 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:59:08.805260 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:08.805227 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2rhkj"] May 27 17:59:08.808604 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:08.808574 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c7b24b_a653_4767_9dc9_d2bcab402003.slice/crio-2276e3a08a85e1640251f8706ffb8be96ed1a51b38dec9d18856fcda1b3737b3 WatchSource:0}: Error finding container 2276e3a08a85e1640251f8706ffb8be96ed1a51b38dec9d18856fcda1b3737b3: Status 404 returned error can't find the container with id 2276e3a08a85e1640251f8706ffb8be96ed1a51b38dec9d18856fcda1b3737b3 May 27 17:59:09.783667 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:09.783617 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2rhkj" event={"ID":"68c7b24b-a653-4767-9dc9-d2bcab402003","Type":"ContainerStarted","Data":"2276e3a08a85e1640251f8706ffb8be96ed1a51b38dec9d18856fcda1b3737b3"} May 27 17:59:12.792124 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:12.792082 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2rhkj" event={"ID":"68c7b24b-a653-4767-9dc9-d2bcab402003","Type":"ContainerStarted","Data":"f159a7ca22d471f550c820147d9c9e65f1672d5870d7323c47e76f449982d8b8"} May 27 17:59:12.792621 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:12.792229 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:59:12.808007 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:12.807948 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2rhkj" podStartSLOduration=67.895969438 podStartE2EDuration="1m10.807926516s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 17:59:08.810696054 +0000 UTC m=+66.827906623" lastFinishedPulling="2026-05-27 17:59:11.722653146 +0000 UTC m=+69.739863701" observedRunningTime="2026-05-27 17:59:12.80745827 +0000 UTC m=+70.824668861" watchObservedRunningTime="2026-05-27 17:59:12.807926516 +0000 UTC m=+70.825137094" May 27 17:59:20.340568 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.340531 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-kr7bt"] May 27 17:59:20.364464 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.364427 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-kr7bt"] May 27 17:59:20.364650 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.364571 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.367399 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.367372 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 27 17:59:20.367564 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.367549 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 27 17:59:20.368570 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.368550 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-78789\"" May 27 17:59:20.368685 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.368629 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 27 17:59:20.368685 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.368658 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 27 17:59:20.373456 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.373435 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 27 17:59:20.447862 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.447829 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg"] May 27 17:59:20.451544 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.451526 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:20.460011 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.459990 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 27 17:59:20.461540 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.461526 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-crsqv\"" May 27 17:59:20.462684 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.462672 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 27 17:59:20.465428 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.465400 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 27 17:59:20.466249 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.466228 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg"] May 27 17:59:20.469570 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.469551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/338190a7-aa12-45f7-9c87-91a124beb1f8-config\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.469660 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.469577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/338190a7-aa12-45f7-9c87-91a124beb1f8-trusted-ca\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.469660 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.469618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjrwr\" (UniqueName: \"kubernetes.io/projected/338190a7-aa12-45f7-9c87-91a124beb1f8-kube-api-access-vjrwr\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.469747 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.469713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:20.469813 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.469801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/338190a7-aa12-45f7-9c87-91a124beb1f8-serving-cert\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.469847 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.469821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjj7w\" (UniqueName: \"kubernetes.io/projected/7c178dc0-1781-47b4-b08a-8b65a72e3621-kube-api-access-bjj7w\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:20.570409 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.570377 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:20.570627 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.570452 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/338190a7-aa12-45f7-9c87-91a124beb1f8-serving-cert\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.570627 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.570480 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjj7w\" (UniqueName: \"kubernetes.io/projected/7c178dc0-1781-47b4-b08a-8b65a72e3621-kube-api-access-bjj7w\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:20.570627 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.570509 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/338190a7-aa12-45f7-9c87-91a124beb1f8-config\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.570627 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.570531 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/338190a7-aa12-45f7-9c87-91a124beb1f8-trusted-ca\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.570627 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:20.570535 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 17:59:20.570627 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:20.570610 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls podName:7c178dc0-1781-47b4-b08a-8b65a72e3621 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:21.070592419 +0000 UTC m=+79.087802973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls") pod "cluster-samples-operator-697587599-lmlkg" (UID: "7c178dc0-1781-47b4-b08a-8b65a72e3621") : secret "samples-operator-tls" not found May 27 17:59:20.570959 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.570667 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjrwr\" (UniqueName: \"kubernetes.io/projected/338190a7-aa12-45f7-9c87-91a124beb1f8-kube-api-access-vjrwr\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.571214 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.571196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/338190a7-aa12-45f7-9c87-91a124beb1f8-config\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.572536 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.572511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/338190a7-aa12-45f7-9c87-91a124beb1f8-trusted-ca\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.572957 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.572939 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/338190a7-aa12-45f7-9c87-91a124beb1f8-serving-cert\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.585251 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.585224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjj7w\" (UniqueName: \"kubernetes.io/projected/7c178dc0-1781-47b4-b08a-8b65a72e3621-kube-api-access-bjj7w\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:20.585500 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.585477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjrwr\" (UniqueName: \"kubernetes.io/projected/338190a7-aa12-45f7-9c87-91a124beb1f8-kube-api-access-vjrwr\") pod \"console-operator-76dff48d59-kr7bt\" (UID: \"338190a7-aa12-45f7-9c87-91a124beb1f8\") " pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.675646 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.675593 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:20.829619 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:20.829579 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-kr7bt"] May 27 17:59:20.833475 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:20.833446 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338190a7_aa12_45f7_9c87_91a124beb1f8.slice/crio-1a66eb5e1cfce29fcd37106ad160cb4d1aae0292a49ca9c2b8fbe5bacf2d0c0b WatchSource:0}: Error finding container 1a66eb5e1cfce29fcd37106ad160cb4d1aae0292a49ca9c2b8fbe5bacf2d0c0b: Status 404 returned error can't find the container with id 1a66eb5e1cfce29fcd37106ad160cb4d1aae0292a49ca9c2b8fbe5bacf2d0c0b May 27 17:59:21.074707 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:21.074613 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:21.074854 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:21.074766 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 17:59:21.074854 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:21.074846 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls podName:7c178dc0-1781-47b4-b08a-8b65a72e3621 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:22.074828488 +0000 UTC m=+80.092039043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls") pod "cluster-samples-operator-697587599-lmlkg" (UID: "7c178dc0-1781-47b4-b08a-8b65a72e3621") : secret "samples-operator-tls" not found May 27 17:59:21.812918 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:21.812878 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" event={"ID":"338190a7-aa12-45f7-9c87-91a124beb1f8","Type":"ContainerStarted","Data":"1a66eb5e1cfce29fcd37106ad160cb4d1aae0292a49ca9c2b8fbe5bacf2d0c0b"} May 27 17:59:22.082361 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:22.082264 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:22.082523 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:22.082421 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 17:59:22.082523 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:22.082491 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls podName:7c178dc0-1781-47b4-b08a-8b65a72e3621 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:24.082474425 +0000 UTC m=+82.099684984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls") pod "cluster-samples-operator-697587599-lmlkg" (UID: "7c178dc0-1781-47b4-b08a-8b65a72e3621") : secret "samples-operator-tls" not found May 27 17:59:23.818236 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:23.818204 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/0.log" May 27 17:59:23.818666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:23.818249 2576 generic.go:358] "Generic (PLEG): container finished" podID="338190a7-aa12-45f7-9c87-91a124beb1f8" containerID="b2fbc4833a532348343687b1427ad9cc2d64309e384991f50acdca6618cbed9e" exitCode=255 May 27 17:59:23.818666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:23.818336 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" event={"ID":"338190a7-aa12-45f7-9c87-91a124beb1f8","Type":"ContainerDied","Data":"b2fbc4833a532348343687b1427ad9cc2d64309e384991f50acdca6618cbed9e"} May 27 17:59:23.818666 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:23.818562 2576 scope.go:117] "RemoveContainer" containerID="b2fbc4833a532348343687b1427ad9cc2d64309e384991f50acdca6618cbed9e" May 27 17:59:24.097639 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:24.097544 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:24.097791 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:24.097697 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 17:59:24.097791 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:24.097772 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls podName:7c178dc0-1781-47b4-b08a-8b65a72e3621 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:28.09775481 +0000 UTC m=+86.114965370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls") pod "cluster-samples-operator-697587599-lmlkg" (UID: "7c178dc0-1781-47b4-b08a-8b65a72e3621") : secret "samples-operator-tls" not found May 27 17:59:24.821958 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:24.821927 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 17:59:24.822397 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:24.822365 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/0.log" May 27 17:59:24.822440 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:24.822395 2576 generic.go:358] "Generic (PLEG): container finished" podID="338190a7-aa12-45f7-9c87-91a124beb1f8" containerID="e3a187e8586f4b72e364d78342568d576938e63d9c82169b22f7ee0cbc528e05" exitCode=255 May 27 17:59:24.822476 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:24.822453 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" event={"ID":"338190a7-aa12-45f7-9c87-91a124beb1f8","Type":"ContainerDied","Data":"e3a187e8586f4b72e364d78342568d576938e63d9c82169b22f7ee0cbc528e05"} May 27 17:59:24.822509 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:24.822486 2576 scope.go:117] "RemoveContainer" containerID="b2fbc4833a532348343687b1427ad9cc2d64309e384991f50acdca6618cbed9e" May 27 17:59:24.822691 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:24.822675 2576 scope.go:117] "RemoveContainer" containerID="e3a187e8586f4b72e364d78342568d576938e63d9c82169b22f7ee0cbc528e05" May 27 17:59:24.822890 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:24.822873 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-kr7bt_openshift-console-operator(338190a7-aa12-45f7-9c87-91a124beb1f8)\"" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" podUID="338190a7-aa12-45f7-9c87-91a124beb1f8" May 27 17:59:25.825415 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:25.825384 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 17:59:25.825799 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:25.825748 2576 scope.go:117] "RemoveContainer" containerID="e3a187e8586f4b72e364d78342568d576938e63d9c82169b22f7ee0cbc528e05" May 27 17:59:25.825957 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:25.825938 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-kr7bt_openshift-console-operator(338190a7-aa12-45f7-9c87-91a124beb1f8)\"" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" podUID="338190a7-aa12-45f7-9c87-91a124beb1f8" May 27 17:59:26.921916 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:26.921878 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r"] May 27 17:59:26.925588 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:26.925563 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r" May 27 17:59:26.928294 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:26.928260 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jrg7b\"" May 27 17:59:26.928405 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:26.928260 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 27 17:59:26.929165 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:26.929132 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 27 17:59:26.933907 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:26.933884 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r"] May 27 17:59:27.018257 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.018207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98dg8\" (UniqueName: \"kubernetes.io/projected/97a5a319-b23b-48e5-b851-2ec6e60c5341-kube-api-access-98dg8\") pod \"migrator-b985f5d89-phm2r\" (UID: \"97a5a319-b23b-48e5-b851-2ec6e60c5341\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r" May 27 17:59:27.118741 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.118691 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98dg8\" (UniqueName: \"kubernetes.io/projected/97a5a319-b23b-48e5-b851-2ec6e60c5341-kube-api-access-98dg8\") pod \"migrator-b985f5d89-phm2r\" (UID: \"97a5a319-b23b-48e5-b851-2ec6e60c5341\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r" May 27 17:59:27.127707 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.127674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98dg8\" (UniqueName: \"kubernetes.io/projected/97a5a319-b23b-48e5-b851-2ec6e60c5341-kube-api-access-98dg8\") pod \"migrator-b985f5d89-phm2r\" (UID: \"97a5a319-b23b-48e5-b851-2ec6e60c5341\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r" May 27 17:59:27.234165 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.234051 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r" May 27 17:59:27.364003 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.363971 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r"] May 27 17:59:27.366983 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:27.366945 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a5a319_b23b_48e5_b851_2ec6e60c5341.slice/crio-c9502fa23f43a491e9e435e1b5b286447b7f3b6e6352300cc62ef948ca4c789b WatchSource:0}: Error finding container c9502fa23f43a491e9e435e1b5b286447b7f3b6e6352300cc62ef948ca4c789b: Status 404 returned error can't find the container with id c9502fa23f43a491e9e435e1b5b286447b7f3b6e6352300cc62ef948ca4c789b May 27 17:59:27.830859 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.830818 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r" event={"ID":"97a5a319-b23b-48e5-b851-2ec6e60c5341","Type":"ContainerStarted","Data":"c9502fa23f43a491e9e435e1b5b286447b7f3b6e6352300cc62ef948ca4c789b"} May 27 17:59:27.939627 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.939593 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-d774j"] May 27 17:59:27.942392 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.942373 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:27.945056 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.944866 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 27 17:59:27.945056 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.945047 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2rs2g\"" May 27 17:59:27.945253 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.945052 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 27 17:59:27.945253 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.944866 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 27 17:59:27.945746 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.945729 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 27 17:59:27.950642 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:27.950620 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-d774j"] May 27 17:59:28.027551 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.027513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ba93f091-c773-400e-88a3-8cdec9cd557d-signing-key\") pod \"service-ca-67d667c7d-d774j\" (UID: \"ba93f091-c773-400e-88a3-8cdec9cd557d\") " pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.027736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.027677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ba93f091-c773-400e-88a3-8cdec9cd557d-signing-cabundle\") pod \"service-ca-67d667c7d-d774j\" (UID: \"ba93f091-c773-400e-88a3-8cdec9cd557d\") " pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.027736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.027712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmn2d\" (UniqueName: \"kubernetes.io/projected/ba93f091-c773-400e-88a3-8cdec9cd557d-kube-api-access-xmn2d\") pod \"service-ca-67d667c7d-d774j\" (UID: \"ba93f091-c773-400e-88a3-8cdec9cd557d\") " pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.036997 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.036968 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgqft_1160d555-a418-4723-83e8-650f2eda3a4b/dns-node-resolver/0.log" May 27 17:59:28.128379 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.128277 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ba93f091-c773-400e-88a3-8cdec9cd557d-signing-key\") pod \"service-ca-67d667c7d-d774j\" (UID: \"ba93f091-c773-400e-88a3-8cdec9cd557d\") " pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.128379 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.128366 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:28.128710 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.128414 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ba93f091-c773-400e-88a3-8cdec9cd557d-signing-cabundle\") pod \"service-ca-67d667c7d-d774j\" (UID: \"ba93f091-c773-400e-88a3-8cdec9cd557d\") " pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.128710 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.128433 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmn2d\" (UniqueName: \"kubernetes.io/projected/ba93f091-c773-400e-88a3-8cdec9cd557d-kube-api-access-xmn2d\") pod \"service-ca-67d667c7d-d774j\" (UID: \"ba93f091-c773-400e-88a3-8cdec9cd557d\") " pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.128710 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:28.128536 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 17:59:28.128710 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:28.128617 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls podName:7c178dc0-1781-47b4-b08a-8b65a72e3621 nodeName:}" failed. No retries permitted until 2026-05-27 17:59:36.128594142 +0000 UTC m=+94.145804711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls") pod "cluster-samples-operator-697587599-lmlkg" (UID: "7c178dc0-1781-47b4-b08a-8b65a72e3621") : secret "samples-operator-tls" not found May 27 17:59:28.129052 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.129030 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ba93f091-c773-400e-88a3-8cdec9cd557d-signing-cabundle\") pod \"service-ca-67d667c7d-d774j\" (UID: \"ba93f091-c773-400e-88a3-8cdec9cd557d\") " pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.131159 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.131133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ba93f091-c773-400e-88a3-8cdec9cd557d-signing-key\") pod \"service-ca-67d667c7d-d774j\" (UID: \"ba93f091-c773-400e-88a3-8cdec9cd557d\") " pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.137839 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.137816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmn2d\" (UniqueName: \"kubernetes.io/projected/ba93f091-c773-400e-88a3-8cdec9cd557d-kube-api-access-xmn2d\") pod \"service-ca-67d667c7d-d774j\" (UID: \"ba93f091-c773-400e-88a3-8cdec9cd557d\") " pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.253619 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.253579 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-d774j" May 27 17:59:28.547111 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.547080 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-d774j"] May 27 17:59:28.550071 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:28.550047 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba93f091_c773_400e_88a3_8cdec9cd557d.slice/crio-7bb1b7c18faf688df28c62214dc746e8f14b8db2308c21d69218548fc54699b1 WatchSource:0}: Error finding container 7bb1b7c18faf688df28c62214dc746e8f14b8db2308c21d69218548fc54699b1: Status 404 returned error can't find the container with id 7bb1b7c18faf688df28c62214dc746e8f14b8db2308c21d69218548fc54699b1 May 27 17:59:28.834741 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.834637 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r" event={"ID":"97a5a319-b23b-48e5-b851-2ec6e60c5341","Type":"ContainerStarted","Data":"e383f4b96bace06eda2b2f3baa1f9c505050adfb5550b93e6c8e81c7a2089ec0"} May 27 17:59:28.834741 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.834688 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r" event={"ID":"97a5a319-b23b-48e5-b851-2ec6e60c5341","Type":"ContainerStarted","Data":"debf0188ae8ec97a5765df62e1f16a4e321061950faeda21dbc08fe2e5035f4e"} May 27 17:59:28.835736 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.835711 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-d774j" event={"ID":"ba93f091-c773-400e-88a3-8cdec9cd557d","Type":"ContainerStarted","Data":"7bb1b7c18faf688df28c62214dc746e8f14b8db2308c21d69218548fc54699b1"} May 27 17:59:28.842824 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.842803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7wwsk_7aef902f-4204-4aeb-a69c-c11fe3c61853/node-ca/0.log" May 27 17:59:28.859172 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:28.859117 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-phm2r" podStartSLOduration=1.759074987 podStartE2EDuration="2.859101308s" podCreationTimestamp="2026-05-27 17:59:26 +0000 UTC" firstStartedPulling="2026-05-27 17:59:27.368784018 +0000 UTC m=+85.385994576" lastFinishedPulling="2026-05-27 17:59:28.468810338 +0000 UTC m=+86.486020897" observedRunningTime="2026-05-27 17:59:28.857147056 +0000 UTC m=+86.874357615" watchObservedRunningTime="2026-05-27 17:59:28.859101308 +0000 UTC m=+86.876311907" May 27 17:59:30.676391 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:30.676344 2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:30.676391 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:30.676385 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:30.676801 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:30.676724 2576 scope.go:117] "RemoveContainer" containerID="e3a187e8586f4b72e364d78342568d576938e63d9c82169b22f7ee0cbc528e05" May 27 17:59:30.676897 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:30.676880 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-kr7bt_openshift-console-operator(338190a7-aa12-45f7-9c87-91a124beb1f8)\"" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" podUID="338190a7-aa12-45f7-9c87-91a124beb1f8" May 27 17:59:30.843165 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:30.843072 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-d774j" event={"ID":"ba93f091-c773-400e-88a3-8cdec9cd557d","Type":"ContainerStarted","Data":"6d6852eba5b7bb83b4a4b2c7522299001a361a466145398b363b14f18527b45c"} May 27 17:59:30.861030 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:30.860864 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-d774j" podStartSLOduration=1.9787933149999999 podStartE2EDuration="3.860847629s" podCreationTimestamp="2026-05-27 17:59:27 +0000 UTC" firstStartedPulling="2026-05-27 17:59:28.551801615 +0000 UTC m=+86.569012172" lastFinishedPulling="2026-05-27 17:59:30.433855918 +0000 UTC m=+88.451066486" observedRunningTime="2026-05-27 17:59:30.860471323 +0000 UTC m=+88.877681900" watchObservedRunningTime="2026-05-27 17:59:30.860847629 +0000 UTC m=+88.878058206" May 27 17:59:36.195240 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:36.195195 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:36.197640 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:36.197618 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c178dc0-1781-47b4-b08a-8b65a72e3621-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lmlkg\" (UID: \"7c178dc0-1781-47b4-b08a-8b65a72e3621\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:36.360573 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:36.360531 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" May 27 17:59:36.488029 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:36.487945 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg"] May 27 17:59:36.858073 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:36.857983 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" event={"ID":"7c178dc0-1781-47b4-b08a-8b65a72e3621","Type":"ContainerStarted","Data":"f39772d2cc0d2ae030ea2b5b29b9a091ef4fb36c1b1de654cace80b09cc11411"} May 27 17:59:38.865204 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:38.865154 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" event={"ID":"7c178dc0-1781-47b4-b08a-8b65a72e3621","Type":"ContainerStarted","Data":"797cdb22cd3b9df618cbac2bddb9df5f195f875e36022db1b6f6ee43376dc68a"} May 27 17:59:38.865204 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:38.865206 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" event={"ID":"7c178dc0-1781-47b4-b08a-8b65a72e3621","Type":"ContainerStarted","Data":"d20a23c1ba739c7c21208bf8660c81259543632e50710ae671ed2fbfd8ca323d"} May 27 17:59:38.888482 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:38.888432 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lmlkg" podStartSLOduration=17.389289712 podStartE2EDuration="18.888418314s" podCreationTimestamp="2026-05-27 17:59:20 +0000 UTC" firstStartedPulling="2026-05-27 17:59:36.530418883 +0000 UTC m=+94.547629439" lastFinishedPulling="2026-05-27 17:59:38.029547472 +0000 UTC m=+96.046758041" observedRunningTime="2026-05-27 17:59:38.886850818 +0000 UTC m=+96.904061396" watchObservedRunningTime="2026-05-27 17:59:38.888418314 +0000 UTC m=+96.905628891" May 27 17:59:40.327343 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.327270 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:59:40.327727 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.327366 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:59:40.329668 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.329631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a6983a-b7e9-44c6-b242-f2372a5df5d7-metrics-tls\") pod \"dns-default-p7642\" (UID: \"70a6983a-b7e9-44c6-b242-f2372a5df5d7\") " pod="openshift-dns/dns-default-p7642" May 27 17:59:40.329797 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.329679 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc45bf4-25bc-4563-a285-3aa33227a9de-cert\") pod \"ingress-canary-x6f5h\" (UID: \"bcc45bf4-25bc-4563-a285-3aa33227a9de\") " pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:59:40.362000 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.361964 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mszw7\"" May 27 17:59:40.370033 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.370011 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x6f5h" May 27 17:59:40.494574 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.494541 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x6f5h"] May 27 17:59:40.497818 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:40.497777 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc45bf4_25bc_4563_a285_3aa33227a9de.slice/crio-48291d62c92d2f70185fd35a2a5b71498fe0957465ff3f69309a2544f765063a WatchSource:0}: Error finding container 48291d62c92d2f70185fd35a2a5b71498fe0957465ff3f69309a2544f765063a: Status 404 returned error can't find the container with id 48291d62c92d2f70185fd35a2a5b71498fe0957465ff3f69309a2544f765063a May 27 17:59:40.623938 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.623904 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdfkw\"" May 27 17:59:40.632191 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.632114 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p7642" May 27 17:59:40.762839 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.762804 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p7642"] May 27 17:59:40.765816 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:40.765784 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a6983a_b7e9_44c6_b242_f2372a5df5d7.slice/crio-97b4346be792385b36ddc381ce9760131392660848072c3b8a2fc667fbc494f6 WatchSource:0}: Error finding container 97b4346be792385b36ddc381ce9760131392660848072c3b8a2fc667fbc494f6: Status 404 returned error can't find the container with id 97b4346be792385b36ddc381ce9760131392660848072c3b8a2fc667fbc494f6 May 27 17:59:40.871745 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.871704 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x6f5h" event={"ID":"bcc45bf4-25bc-4563-a285-3aa33227a9de","Type":"ContainerStarted","Data":"48291d62c92d2f70185fd35a2a5b71498fe0957465ff3f69309a2544f765063a"} May 27 17:59:40.872818 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:40.872786 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p7642" event={"ID":"70a6983a-b7e9-44c6-b242-f2372a5df5d7","Type":"ContainerStarted","Data":"97b4346be792385b36ddc381ce9760131392660848072c3b8a2fc667fbc494f6"} May 27 17:59:41.557613 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:41.557578 2576 scope.go:117] "RemoveContainer" containerID="e3a187e8586f4b72e364d78342568d576938e63d9c82169b22f7ee0cbc528e05" May 27 17:59:41.878768 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:41.878686 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 17:59:41.878768 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:41.878759 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" event={"ID":"338190a7-aa12-45f7-9c87-91a124beb1f8","Type":"ContainerStarted","Data":"b3b7633e844901bd93cf0242b8e08a3e23ea0ab71128ab289192c232c9aa4be9"} May 27 17:59:41.879203 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:41.879181 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:41.899619 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:41.899568 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" podStartSLOduration=19.851866623 podStartE2EDuration="21.899546027s" podCreationTimestamp="2026-05-27 17:59:20 +0000 UTC" firstStartedPulling="2026-05-27 17:59:20.835092776 +0000 UTC m=+78.852303335" lastFinishedPulling="2026-05-27 17:59:22.882772171 +0000 UTC m=+80.899982739" observedRunningTime="2026-05-27 17:59:41.899045287 +0000 UTC m=+99.916255865" watchObservedRunningTime="2026-05-27 17:59:41.899546027 +0000 UTC m=+99.916756616" May 27 17:59:42.414144 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:42.414097 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-kr7bt" May 27 17:59:43.796490 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:43.796461 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2rhkj" May 27 17:59:43.885078 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:43.885043 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x6f5h" event={"ID":"bcc45bf4-25bc-4563-a285-3aa33227a9de","Type":"ContainerStarted","Data":"64cd14368842b4e98dcde1bbb755076496171d8beaa9910b19a1234f41e3decb"} May 27 17:59:43.886514 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:43.886488 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p7642" event={"ID":"70a6983a-b7e9-44c6-b242-f2372a5df5d7","Type":"ContainerStarted","Data":"c8a11b9dc326dcd4147b24e228b04e3b26db16fb50075910b8f31e0507f4a7ef"} May 27 17:59:43.886633 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:43.886519 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p7642" event={"ID":"70a6983a-b7e9-44c6-b242-f2372a5df5d7","Type":"ContainerStarted","Data":"859fc7b37e0090421502c3d49479a37d6237d0a28df14337cdef9dd31dc8ce6f"} May 27 17:59:43.901375 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:43.901319 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x6f5h" podStartSLOduration=65.584911548 podStartE2EDuration="1m7.901305389s" podCreationTimestamp="2026-05-27 17:58:36 +0000 UTC" firstStartedPulling="2026-05-27 17:59:40.499686947 +0000 UTC m=+98.516897502" lastFinishedPulling="2026-05-27 17:59:42.81608077 +0000 UTC m=+100.833291343" observedRunningTime="2026-05-27 17:59:43.900583454 +0000 UTC m=+101.917794031" watchObservedRunningTime="2026-05-27 17:59:43.901305389 +0000 UTC m=+101.918515957" May 27 17:59:43.918919 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:43.918868 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-p7642" podStartSLOduration=65.868635492 podStartE2EDuration="1m7.918853297s" podCreationTimestamp="2026-05-27 17:58:36 +0000 UTC" firstStartedPulling="2026-05-27 17:59:40.767681947 +0000 UTC m=+98.784892502" lastFinishedPulling="2026-05-27 17:59:42.817899742 +0000 UTC m=+100.835110307" observedRunningTime="2026-05-27 17:59:43.918225455 +0000 UTC m=+101.935436043" watchObservedRunningTime="2026-05-27 17:59:43.918853297 +0000 UTC m=+101.936063874" May 27 17:59:44.889523 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:44.889483 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p7642" May 27 17:59:46.599943 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.599905 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh"] May 27 17:59:46.602980 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.602961 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" May 27 17:59:46.606262 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.606233 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 27 17:59:46.606262 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.606233 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 27 17:59:46.607338 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.607322 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9fspp\"" May 27 17:59:46.615045 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.615022 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh"] May 27 17:59:46.638766 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.638731 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-664ml"] May 27 17:59:46.641924 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.641904 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.644521 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.644492 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 17:59:46.644665 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.644544 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s4jcs\"" May 27 17:59:46.644665 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.644620 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 17:59:46.644813 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.644795 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 17:59:46.644874 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.644824 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 17:59:46.653430 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.653406 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-664ml"] May 27 17:59:46.678955 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.678901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/91065e03-ab16-4bc0-8987-2569d7142e55-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-wlvdh\" (UID: \"91065e03-ab16-4bc0-8987-2569d7142e55\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" May 27 17:59:46.679106 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.679078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/91065e03-ab16-4bc0-8987-2569d7142e55-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-wlvdh\" (UID: \"91065e03-ab16-4bc0-8987-2569d7142e55\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" May 27 17:59:46.695869 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.695836 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-2jzgj"] May 27 17:59:46.699155 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.699131 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-2jzgj" May 27 17:59:46.701705 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.701679 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bd9b45dbf-s2rd6"] May 27 17:59:46.702543 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.702507 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zgql9\"" May 27 17:59:46.703010 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.702985 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 17:59:46.703379 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.703017 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 17:59:46.709523 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.709500 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.712167 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.712142 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 17:59:46.712466 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.712445 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 17:59:46.712629 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.712611 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 17:59:46.712767 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.712528 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vt8dw\"" May 27 17:59:46.712767 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.712669 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-2jzgj"] May 27 17:59:46.715529 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.715503 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bd9b45dbf-s2rd6"] May 27 17:59:46.719495 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.719471 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 17:59:46.758545 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.758505 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bd9b45dbf-s2rd6"] May 27 17:59:46.758763 ip-10-0-141-157 kubenswrapper[2576]: E0527 17:59:46.758736 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-xdfff registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" podUID="7213f83e-2462-4f77-b637-66eafa787c69" May 27 17:59:46.780494 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8mmc\" (UniqueName: \"kubernetes.io/projected/ad1bbc04-f865-4508-b960-ce6887640b0e-kube-api-access-v8mmc\") pod \"downloads-57bd96b888-2jzgj\" (UID: \"ad1bbc04-f865-4508-b960-ce6887640b0e\") " pod="openshift-console/downloads-57bd96b888-2jzgj" May 27 17:59:46.780689 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4209d44-daa9-4de2-a605-a6937ec5aed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.780689 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q7ps\" (UniqueName: \"kubernetes.io/projected/f4209d44-daa9-4de2-a605-a6937ec5aed5-kube-api-access-6q7ps\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.780689 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-registry-tls\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.780689 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-trusted-ca\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.780689 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-installation-pull-secrets\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.780890 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4209d44-daa9-4de2-a605-a6937ec5aed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.780890 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-image-registry-private-configuration\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.780890 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-registry-certificates\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.780890 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-bound-sa-token\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.780890 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdfff\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-kube-api-access-xdfff\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.780890 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4209d44-daa9-4de2-a605-a6937ec5aed5-crio-socket\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.780890 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4209d44-daa9-4de2-a605-a6937ec5aed5-data-volume\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.781215 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780908 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/91065e03-ab16-4bc0-8987-2569d7142e55-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-wlvdh\" (UID: \"91065e03-ab16-4bc0-8987-2569d7142e55\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" May 27 17:59:46.781215 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780931 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/91065e03-ab16-4bc0-8987-2569d7142e55-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-wlvdh\" (UID: \"91065e03-ab16-4bc0-8987-2569d7142e55\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" May 27 17:59:46.781215 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.780952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7213f83e-2462-4f77-b637-66eafa787c69-ca-trust-extracted\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.781533 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.781514 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/91065e03-ab16-4bc0-8987-2569d7142e55-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-wlvdh\" (UID: \"91065e03-ab16-4bc0-8987-2569d7142e55\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" May 27 17:59:46.783367 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.783348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/91065e03-ab16-4bc0-8987-2569d7142e55-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-wlvdh\" (UID: \"91065e03-ab16-4bc0-8987-2569d7142e55\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" May 27 17:59:46.881853 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.881755 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-registry-certificates\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.881853 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.881804 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-bound-sa-token\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.882091 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.881912 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdfff\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-kube-api-access-xdfff\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.882091 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.881964 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4209d44-daa9-4de2-a605-a6937ec5aed5-crio-socket\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.882091 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.881996 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4209d44-daa9-4de2-a605-a6937ec5aed5-data-volume\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.882091 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882050 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7213f83e-2462-4f77-b637-66eafa787c69-ca-trust-extracted\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.882275 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4209d44-daa9-4de2-a605-a6937ec5aed5-crio-socket\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.882275 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882123 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mmc\" (UniqueName: \"kubernetes.io/projected/ad1bbc04-f865-4508-b960-ce6887640b0e-kube-api-access-v8mmc\") pod \"downloads-57bd96b888-2jzgj\" (UID: \"ad1bbc04-f865-4508-b960-ce6887640b0e\") " pod="openshift-console/downloads-57bd96b888-2jzgj" May 27 17:59:46.882275 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882187 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4209d44-daa9-4de2-a605-a6937ec5aed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.882275 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882213 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6q7ps\" (UniqueName: \"kubernetes.io/projected/f4209d44-daa9-4de2-a605-a6937ec5aed5-kube-api-access-6q7ps\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.882275 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882238 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-registry-tls\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.882275 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882302 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-trusted-ca\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.882619 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882447 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-installation-pull-secrets\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.882619 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882487 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4209d44-daa9-4de2-a605-a6937ec5aed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.882619 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882515 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-image-registry-private-configuration\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.882619 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4209d44-daa9-4de2-a605-a6937ec5aed5-data-volume\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.882815 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-registry-certificates\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.882931 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.882910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7213f83e-2462-4f77-b637-66eafa787c69-ca-trust-extracted\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.883233 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.883211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4209d44-daa9-4de2-a605-a6937ec5aed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.883423 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.883406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-trusted-ca\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.884770 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.884742 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-registry-tls\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.884886 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.884799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-installation-pull-secrets\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.885202 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.885170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4209d44-daa9-4de2-a605-a6937ec5aed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.885261 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.885225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-image-registry-private-configuration\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.894258 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.894227 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.899529 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.899503 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.900264 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.900229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdfff\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-kube-api-access-xdfff\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.900806 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.900787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-bound-sa-token\") pod \"image-registry-bd9b45dbf-s2rd6\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:46.902101 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.902079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q7ps\" (UniqueName: \"kubernetes.io/projected/f4209d44-daa9-4de2-a605-a6937ec5aed5-kube-api-access-6q7ps\") pod \"insights-runtime-extractor-664ml\" (UID: \"f4209d44-daa9-4de2-a605-a6937ec5aed5\") " pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.902307 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.902265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8mmc\" (UniqueName: \"kubernetes.io/projected/ad1bbc04-f865-4508-b960-ce6887640b0e-kube-api-access-v8mmc\") pod \"downloads-57bd96b888-2jzgj\" (UID: \"ad1bbc04-f865-4508-b960-ce6887640b0e\") " pod="openshift-console/downloads-57bd96b888-2jzgj" May 27 17:59:46.911741 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.911718 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" May 27 17:59:46.952132 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.952088 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-664ml" May 27 17:59:46.983688 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.983609 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-bound-sa-token\") pod \"7213f83e-2462-4f77-b637-66eafa787c69\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " May 27 17:59:46.983688 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.983680 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-registry-certificates\") pod \"7213f83e-2462-4f77-b637-66eafa787c69\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " May 27 17:59:46.984173 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.983727 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-installation-pull-secrets\") pod \"7213f83e-2462-4f77-b637-66eafa787c69\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " May 27 17:59:46.984173 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.983763 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-image-registry-private-configuration\") pod \"7213f83e-2462-4f77-b637-66eafa787c69\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " May 27 17:59:46.984173 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.983791 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7213f83e-2462-4f77-b637-66eafa787c69-ca-trust-extracted\") pod \"7213f83e-2462-4f77-b637-66eafa787c69\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " May 27 17:59:46.984173 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.984091 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7213f83e-2462-4f77-b637-66eafa787c69-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7213f83e-2462-4f77-b637-66eafa787c69" (UID: "7213f83e-2462-4f77-b637-66eafa787c69"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:59:46.984562 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.984246 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-trusted-ca\") pod \"7213f83e-2462-4f77-b637-66eafa787c69\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " May 27 17:59:46.984562 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.984316 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdfff\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-kube-api-access-xdfff\") pod \"7213f83e-2462-4f77-b637-66eafa787c69\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " May 27 17:59:46.984562 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.984375 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-registry-tls\") pod \"7213f83e-2462-4f77-b637-66eafa787c69\" (UID: \"7213f83e-2462-4f77-b637-66eafa787c69\") " May 27 17:59:46.984562 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.984401 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7213f83e-2462-4f77-b637-66eafa787c69" (UID: "7213f83e-2462-4f77-b637-66eafa787c69"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:59:46.984762 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.984620 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-registry-certificates\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 17:59:46.984762 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.984641 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7213f83e-2462-4f77-b637-66eafa787c69-ca-trust-extracted\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 17:59:46.984975 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.984916 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7213f83e-2462-4f77-b637-66eafa787c69" (UID: "7213f83e-2462-4f77-b637-66eafa787c69"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:59:46.986460 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.986341 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7213f83e-2462-4f77-b637-66eafa787c69" (UID: "7213f83e-2462-4f77-b637-66eafa787c69"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:59:46.986460 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.986422 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7213f83e-2462-4f77-b637-66eafa787c69" (UID: "7213f83e-2462-4f77-b637-66eafa787c69"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:59:46.986460 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.986420 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7213f83e-2462-4f77-b637-66eafa787c69" (UID: "7213f83e-2462-4f77-b637-66eafa787c69"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:59:46.987132 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.987109 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7213f83e-2462-4f77-b637-66eafa787c69" (UID: "7213f83e-2462-4f77-b637-66eafa787c69"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:59:46.988248 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:46.988226 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-kube-api-access-xdfff" (OuterVolumeSpecName: "kube-api-access-xdfff") pod "7213f83e-2462-4f77-b637-66eafa787c69" (UID: "7213f83e-2462-4f77-b637-66eafa787c69"). InnerVolumeSpecName "kube-api-access-xdfff". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:59:47.014753 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.014161 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-2jzgj" May 27 17:59:47.056524 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.056333 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh"] May 27 17:59:47.059646 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:47.059611 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91065e03_ab16_4bc0_8987_2569d7142e55.slice/crio-f921f2c6a4c4cd25ba657367c06bb1ed914d208022b115078f5920f603b45ee7 WatchSource:0}: Error finding container f921f2c6a4c4cd25ba657367c06bb1ed914d208022b115078f5920f603b45ee7: Status 404 returned error can't find the container with id f921f2c6a4c4cd25ba657367c06bb1ed914d208022b115078f5920f603b45ee7 May 27 17:59:47.085015 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.084985 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-registry-tls\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 17:59:47.085015 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.085013 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-bound-sa-token\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 17:59:47.085237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.085023 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-installation-pull-secrets\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 17:59:47.085237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.085041 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7213f83e-2462-4f77-b637-66eafa787c69-image-registry-private-configuration\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 17:59:47.085237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.085056 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7213f83e-2462-4f77-b637-66eafa787c69-trusted-ca\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 17:59:47.085237 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.085071 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdfff\" (UniqueName: \"kubernetes.io/projected/7213f83e-2462-4f77-b637-66eafa787c69-kube-api-access-xdfff\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 17:59:47.107392 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.107361 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-664ml"] May 27 17:59:47.110253 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:47.110207 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4209d44_daa9_4de2_a605_a6937ec5aed5.slice/crio-696cd0ac723d15a53845cbcb0b26a73ac86a43c660921da34d93afb1380c8f96 WatchSource:0}: Error finding container 696cd0ac723d15a53845cbcb0b26a73ac86a43c660921da34d93afb1380c8f96: Status 404 returned error can't find the container with id 696cd0ac723d15a53845cbcb0b26a73ac86a43c660921da34d93afb1380c8f96 May 27 17:59:47.166236 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.166202 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-2jzgj"] May 27 17:59:47.176723 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:47.176694 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1bbc04_f865_4508_b960_ce6887640b0e.slice/crio-5cd27b9da4c4a05aa420f129c8df7e4ed5c513c7894c8d782a192fd6deafe406 WatchSource:0}: Error finding container 5cd27b9da4c4a05aa420f129c8df7e4ed5c513c7894c8d782a192fd6deafe406: Status 404 returned error can't find the container with id 5cd27b9da4c4a05aa420f129c8df7e4ed5c513c7894c8d782a192fd6deafe406 May 27 17:59:47.900185 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.900149 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" event={"ID":"91065e03-ab16-4bc0-8987-2569d7142e55","Type":"ContainerStarted","Data":"f921f2c6a4c4cd25ba657367c06bb1ed914d208022b115078f5920f603b45ee7"} May 27 17:59:47.901231 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.901202 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-2jzgj" event={"ID":"ad1bbc04-f865-4508-b960-ce6887640b0e","Type":"ContainerStarted","Data":"5cd27b9da4c4a05aa420f129c8df7e4ed5c513c7894c8d782a192fd6deafe406"} May 27 17:59:47.902850 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.902788 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-664ml" event={"ID":"f4209d44-daa9-4de2-a605-a6937ec5aed5","Type":"ContainerStarted","Data":"a4c3bf13b16bfccd501be26b6927ab58e6cf192d12c353f22fb76ad93df67ebf"} May 27 17:59:47.902850 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.902827 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-664ml" event={"ID":"f4209d44-daa9-4de2-a605-a6937ec5aed5","Type":"ContainerStarted","Data":"696cd0ac723d15a53845cbcb0b26a73ac86a43c660921da34d93afb1380c8f96"} May 27 17:59:47.902850 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.902835 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd9b45dbf-s2rd6" May 27 17:59:47.942108 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.942076 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bd9b45dbf-s2rd6"] May 27 17:59:47.947471 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:47.947430 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bd9b45dbf-s2rd6"] May 27 17:59:48.561917 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:48.561879 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7213f83e-2462-4f77-b637-66eafa787c69" path="/var/lib/kubelet/pods/7213f83e-2462-4f77-b637-66eafa787c69/volumes" May 27 17:59:48.907620 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:48.907552 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" event={"ID":"91065e03-ab16-4bc0-8987-2569d7142e55","Type":"ContainerStarted","Data":"ccbcd4504e2607d3b9e357e5669d85c46730c023d8d7a2f973c495870e6451c3"} May 27 17:59:48.909541 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:48.909506 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-664ml" event={"ID":"f4209d44-daa9-4de2-a605-a6937ec5aed5","Type":"ContainerStarted","Data":"949d9bdc86243045a6d55bf85e06526c4a2cd62574f9aceb3d3a583b7aa8a1c8"} May 27 17:59:48.927010 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:48.924872 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wlvdh" podStartSLOduration=1.615097081 podStartE2EDuration="2.924850497s" podCreationTimestamp="2026-05-27 17:59:46 +0000 UTC" firstStartedPulling="2026-05-27 17:59:47.062195934 +0000 UTC m=+105.079406493" lastFinishedPulling="2026-05-27 17:59:48.371949352 +0000 UTC m=+106.389159909" observedRunningTime="2026-05-27 17:59:48.922897306 +0000 UTC m=+106.940107884" watchObservedRunningTime="2026-05-27 17:59:48.924850497 +0000 UTC m=+106.942061075" May 27 17:59:49.914621 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:49.914576 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-664ml" event={"ID":"f4209d44-daa9-4de2-a605-a6937ec5aed5","Type":"ContainerStarted","Data":"686b5341b298aa03d4f5074a0e842b0e7594fef75590333c29db9eae3e723a8a"} May 27 17:59:49.932689 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:49.932489 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-664ml" podStartSLOduration=1.74168198 podStartE2EDuration="3.932471113s" podCreationTimestamp="2026-05-27 17:59:46 +0000 UTC" firstStartedPulling="2026-05-27 17:59:47.181230289 +0000 UTC m=+105.198440845" lastFinishedPulling="2026-05-27 17:59:49.37201942 +0000 UTC m=+107.389229978" observedRunningTime="2026-05-27 17:59:49.932254845 +0000 UTC m=+107.949465462" watchObservedRunningTime="2026-05-27 17:59:49.932471113 +0000 UTC m=+107.949681690" May 27 17:59:54.894441 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:54.894400 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p7642" May 27 17:59:55.308498 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.308345 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-644ffcc8fb-cddv6"] May 27 17:59:55.311209 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.311184 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.313732 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.313706 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 17:59:55.313878 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.313706 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cwmsm\"" May 27 17:59:55.314058 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.314024 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 17:59:55.315587 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.314713 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 17:59:55.315587 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.314744 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 17:59:55.315587 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.314826 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 17:59:55.318495 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.318473 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 17:59:55.320805 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.320782 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644ffcc8fb-cddv6"] May 27 17:59:55.453608 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.453554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-config\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.453792 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.453617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-trusted-ca-bundle\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.453792 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.453721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-oauth-serving-cert\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.453792 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.453769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-serving-cert\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.453943 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.453846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-oauth-config\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.453943 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.453871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-service-ca\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.453943 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.453923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgw46\" (UniqueName: \"kubernetes.io/projected/2ca4f846-c30b-41a0-916a-b7caa8d1a102-kube-api-access-tgw46\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.554991 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.554953 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-oauth-config\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.554991 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.554990 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-service-ca\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.555244 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.555008 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw46\" (UniqueName: \"kubernetes.io/projected/2ca4f846-c30b-41a0-916a-b7caa8d1a102-kube-api-access-tgw46\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.555244 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.555065 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-config\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.555244 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.555109 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-trusted-ca-bundle\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.555244 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.555152 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-oauth-serving-cert\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.555244 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.555176 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-serving-cert\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.555890 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.555837 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-service-ca\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.555890 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.555888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-config\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.556061 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.555913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-oauth-serving-cert\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.556515 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.556493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-trusted-ca-bundle\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.558059 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.558034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-serving-cert\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.558161 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.558080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-oauth-config\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.563496 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.563431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgw46\" (UniqueName: \"kubernetes.io/projected/2ca4f846-c30b-41a0-916a-b7caa8d1a102-kube-api-access-tgw46\") pod \"console-644ffcc8fb-cddv6\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.623728 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.623684 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644ffcc8fb-cddv6" May 27 17:59:55.763863 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.763828 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644ffcc8fb-cddv6"] May 27 17:59:55.768164 ip-10-0-141-157 kubenswrapper[2576]: W0527 17:59:55.768134 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca4f846_c30b_41a0_916a_b7caa8d1a102.slice/crio-810611e2dd94972ccb78ffdd85c76b8085ea3e5fec4d4a57e8aabc9aa692dddb WatchSource:0}: Error finding container 810611e2dd94972ccb78ffdd85c76b8085ea3e5fec4d4a57e8aabc9aa692dddb: Status 404 returned error can't find the container with id 810611e2dd94972ccb78ffdd85c76b8085ea3e5fec4d4a57e8aabc9aa692dddb May 27 17:59:55.938456 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:55.938411 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644ffcc8fb-cddv6" event={"ID":"2ca4f846-c30b-41a0-916a-b7caa8d1a102","Type":"ContainerStarted","Data":"810611e2dd94972ccb78ffdd85c76b8085ea3e5fec4d4a57e8aabc9aa692dddb"} May 27 17:59:58.795073 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.795026 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7"] May 27 17:59:58.801035 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.801006 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:58.803761 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.803693 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 27 17:59:58.803896 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.803830 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hfntw\"" May 27 17:59:58.803962 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.803944 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 27 17:59:58.804076 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.804033 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 17:59:58.804721 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.804687 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 17:59:58.805152 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.804991 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 17:59:58.806514 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.806489 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7"] May 27 17:59:58.987088 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.987042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqd42\" (UniqueName: \"kubernetes.io/projected/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-kube-api-access-tqd42\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:58.987320 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.987119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:58.987320 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.987156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:58.987320 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:58.987222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:59.087815 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:59.087728 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:59.087815 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:59.087775 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqd42\" (UniqueName: \"kubernetes.io/projected/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-kube-api-access-tqd42\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:59.088035 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:59.087978 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:59.088090 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:59.088028 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:59.088709 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:59.088676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:59.090805 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:59.090778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:59.091027 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:59.091005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:59.096657 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:59.096631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqd42\" (UniqueName: \"kubernetes.io/projected/5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef-kube-api-access-tqd42\") pod \"prometheus-operator-7779bbdd78-dcrc7\" (UID: \"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 17:59:59.113355 ip-10-0-141-157 kubenswrapper[2576]: I0527 17:59:59.113324 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" May 27 18:00:04.665356 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:04.665317 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7"] May 27 18:00:04.668630 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:00:04.668593 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb90146_1f7e_4bb3_a7ef_d33ebbde47ef.slice/crio-1ca38e2248db28f268c5d40f472259b20106cfbb23d33755688fd2a8ab3962d7 WatchSource:0}: Error finding container 1ca38e2248db28f268c5d40f472259b20106cfbb23d33755688fd2a8ab3962d7: Status 404 returned error can't find the container with id 1ca38e2248db28f268c5d40f472259b20106cfbb23d33755688fd2a8ab3962d7 May 27 18:00:04.966547 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:04.966504 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" event={"ID":"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef","Type":"ContainerStarted","Data":"1ca38e2248db28f268c5d40f472259b20106cfbb23d33755688fd2a8ab3962d7"} May 27 18:00:04.968238 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:04.968199 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644ffcc8fb-cddv6" event={"ID":"2ca4f846-c30b-41a0-916a-b7caa8d1a102","Type":"ContainerStarted","Data":"97ba4c6ce2b750fe41ea9785a6f3b0b4746b1f06a4991869e0626f80490dba79"} May 27 18:00:04.970177 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:04.970150 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-2jzgj" event={"ID":"ad1bbc04-f865-4508-b960-ce6887640b0e","Type":"ContainerStarted","Data":"4d766f6c52b705c25ef14cb8dab3ae056e65232c822c489ce0d104b641b60c4d"} May 27 18:00:04.970342 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:04.970320 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-2jzgj" May 27 18:00:04.985125 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:04.985090 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-2jzgj" May 27 18:00:04.993553 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:04.993503 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-644ffcc8fb-cddv6" podStartSLOduration=1.233719574 podStartE2EDuration="9.993485709s" podCreationTimestamp="2026-05-27 17:59:55 +0000 UTC" firstStartedPulling="2026-05-27 17:59:55.770131425 +0000 UTC m=+113.787341980" lastFinishedPulling="2026-05-27 18:00:04.52989755 +0000 UTC m=+122.547108115" observedRunningTime="2026-05-27 18:00:04.992764603 +0000 UTC m=+123.009975180" watchObservedRunningTime="2026-05-27 18:00:04.993485709 +0000 UTC m=+123.010696289" May 27 18:00:05.624300 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:05.624246 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644ffcc8fb-cddv6" May 27 18:00:05.624506 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:05.624453 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-644ffcc8fb-cddv6" May 27 18:00:05.630807 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:05.630775 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-644ffcc8fb-cddv6" May 27 18:00:05.653940 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:05.653883 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-2jzgj" podStartSLOduration=2.265145754 podStartE2EDuration="19.653864937s" podCreationTimestamp="2026-05-27 17:59:46 +0000 UTC" firstStartedPulling="2026-05-27 17:59:47.179048777 +0000 UTC m=+105.196259332" lastFinishedPulling="2026-05-27 18:00:04.567767955 +0000 UTC m=+122.584978515" observedRunningTime="2026-05-27 18:00:05.014115245 +0000 UTC m=+123.031326029" watchObservedRunningTime="2026-05-27 18:00:05.653864937 +0000 UTC m=+123.671075516" May 27 18:00:05.982229 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:05.982194 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-644ffcc8fb-cddv6" May 27 18:00:06.986714 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:06.986672 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" event={"ID":"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef","Type":"ContainerStarted","Data":"0c645178aa76b57108d0daf7005dee76e69104e45dcd31c3cc10c0ffb7103f35"} May 27 18:00:06.987174 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:06.986723 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" event={"ID":"5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef","Type":"ContainerStarted","Data":"762b75d76eb43f36b0b69b9d7b6299bc6ad56ef435e2b7d3721acf741a18a2fc"} May 27 18:00:07.009627 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:07.009571 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dcrc7" podStartSLOduration=7.540048314 podStartE2EDuration="9.009553989s" podCreationTimestamp="2026-05-27 17:59:58 +0000 UTC" firstStartedPulling="2026-05-27 18:00:04.671129798 +0000 UTC m=+122.688340353" lastFinishedPulling="2026-05-27 18:00:06.140635452 +0000 UTC m=+124.157846028" observedRunningTime="2026-05-27 18:00:07.007854547 +0000 UTC m=+125.025065148" watchObservedRunningTime="2026-05-27 18:00:07.009553989 +0000 UTC m=+125.026764566" May 27 18:00:09.261733 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.261688 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k"] May 27 18:00:09.306181 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.306146 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.314554 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.314512 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 27 18:00:09.316993 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.316968 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 27 18:00:09.319003 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.318976 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4pb95\"" May 27 18:00:09.319323 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.319236 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 27 18:00:09.319612 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.319590 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k"] May 27 18:00:09.350146 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.350106 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f8rxr"] May 27 18:00:09.370169 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.370133 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.383959 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.383917 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b084b089-dfb9-4e13-b32a-2ee86937c742-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.384104 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.383983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.384166 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.384110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.384166 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.384147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9knnq\" (UniqueName: \"kubernetes.io/projected/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-api-access-9knnq\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.384265 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.384236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b084b089-dfb9-4e13-b32a-2ee86937c742-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.384337 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.384271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.390690 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.390661 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 18:00:09.390690 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.390672 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 18:00:09.390904 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.390662 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 18:00:09.390904 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.390836 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8dlgx\"" May 27 18:00:09.485524 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a5d59c7-060e-4daa-981e-81746fe4fcb4-root\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.485524 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-textfile\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.485775 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485550 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b084b089-dfb9-4e13-b32a-2ee86937c742-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.485775 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485577 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.485775 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz6q7\" (UniqueName: \"kubernetes.io/projected/9a5d59c7-060e-4daa-981e-81746fe4fcb4-kube-api-access-tz6q7\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.485775 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485640 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b084b089-dfb9-4e13-b32a-2ee86937c742-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.485775 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-wtmp\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.485775 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485739 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.486063 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5d59c7-060e-4daa-981e-81746fe4fcb4-metrics-client-ca\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.486063 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485939 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.486063 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485972 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9knnq\" (UniqueName: \"kubernetes.io/projected/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-api-access-9knnq\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.486063 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.485982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b084b089-dfb9-4e13-b32a-2ee86937c742-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.486063 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.486013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-tls\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.486063 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.486043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.486344 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.486070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.486344 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.486100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a5d59c7-060e-4daa-981e-81746fe4fcb4-sys\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.486639 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.486614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.486735 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.486636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b084b089-dfb9-4e13-b32a-2ee86937c742-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.488764 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.488736 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.488863 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.488809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.506272 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.506233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9knnq\" (UniqueName: \"kubernetes.io/projected/b084b089-dfb9-4e13-b32a-2ee86937c742-kube-api-access-9knnq\") pod \"kube-state-metrics-54fd6bc5c4-fxd9k\" (UID: \"b084b089-dfb9-4e13-b32a-2ee86937c742\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.587305 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587199 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-tls\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587305 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587241 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587305 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587267 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587313 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a5d59c7-060e-4daa-981e-81746fe4fcb4-sys\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587356 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a5d59c7-060e-4daa-981e-81746fe4fcb4-root\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587381 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-textfile\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587410 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tz6q7\" (UniqueName: \"kubernetes.io/projected/9a5d59c7-060e-4daa-981e-81746fe4fcb4-kube-api-access-tz6q7\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a5d59c7-060e-4daa-981e-81746fe4fcb4-sys\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a5d59c7-060e-4daa-981e-81746fe4fcb4-root\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587458 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-wtmp\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587526 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5d59c7-060e-4daa-981e-81746fe4fcb4-metrics-client-ca\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-wtmp\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.587979 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.587824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-textfile\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.588039 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.588016 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.588095 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.588055 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5d59c7-060e-4daa-981e-81746fe4fcb4-metrics-client-ca\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.590201 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.590172 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-tls\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.590372 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.590310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a5d59c7-060e-4daa-981e-81746fe4fcb4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.600471 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.600443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz6q7\" (UniqueName: \"kubernetes.io/projected/9a5d59c7-060e-4daa-981e-81746fe4fcb4-kube-api-access-tz6q7\") pod \"node-exporter-f8rxr\" (UID: \"9a5d59c7-060e-4daa-981e-81746fe4fcb4\") " pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.623486 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.623448 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" May 27 18:00:09.683301 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.682400 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8rxr" May 27 18:00:09.696357 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:00:09.696274 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5d59c7_060e_4daa_981e_81746fe4fcb4.slice/crio-ea59020b00afac8967667b388010a3d94dfd2c7e895656d405c65854f985af9d WatchSource:0}: Error finding container ea59020b00afac8967667b388010a3d94dfd2c7e895656d405c65854f985af9d: Status 404 returned error can't find the container with id ea59020b00afac8967667b388010a3d94dfd2c7e895656d405c65854f985af9d May 27 18:00:09.818633 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.818569 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k"] May 27 18:00:09.821713 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:00:09.821671 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb084b089_dfb9_4e13_b32a_2ee86937c742.slice/crio-da78866dbf55739d3c1c6cda92db8ed128498e88cdbfc6e1dfba314fbb991d8e WatchSource:0}: Error finding container da78866dbf55739d3c1c6cda92db8ed128498e88cdbfc6e1dfba314fbb991d8e: Status 404 returned error can't find the container with id da78866dbf55739d3c1c6cda92db8ed128498e88cdbfc6e1dfba314fbb991d8e May 27 18:00:09.997179 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.997134 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8rxr" event={"ID":"9a5d59c7-060e-4daa-981e-81746fe4fcb4","Type":"ContainerStarted","Data":"ea59020b00afac8967667b388010a3d94dfd2c7e895656d405c65854f985af9d"} May 27 18:00:09.998408 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:09.998363 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" event={"ID":"b084b089-dfb9-4e13-b32a-2ee86937c742","Type":"ContainerStarted","Data":"da78866dbf55739d3c1c6cda92db8ed128498e88cdbfc6e1dfba314fbb991d8e"} May 27 18:00:12.351277 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.351238 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7cd449db45-mhlvn"] May 27 18:00:12.368755 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.368724 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.377361 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.377326 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 27 18:00:12.377976 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.377947 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 27 18:00:12.378662 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.378212 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jbd7z\"" May 27 18:00:12.378845 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.378333 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 27 18:00:12.378921 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.378896 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-32tdcshn3pa4g\"" May 27 18:00:12.378997 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.378382 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 27 18:00:12.380115 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.378437 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 27 18:00:12.381414 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.381388 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cd449db45-mhlvn"] May 27 18:00:12.415905 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.415864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-grpc-tls\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.416099 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.415919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.416099 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.415952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmwcb\" (UniqueName: \"kubernetes.io/projected/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-kube-api-access-xmwcb\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.416099 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.415989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.416099 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.416032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.416324 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.416105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.416324 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.416162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-tls\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.416324 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.416199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-metrics-client-ca\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.416324 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.416278 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 18:00:12.419451 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.419420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dd1832a-5a40-4e13-8cd7-1db0de605be7-metrics-certs\") pod \"network-metrics-daemon-pghnx\" (UID: \"7dd1832a-5a40-4e13-8cd7-1db0de605be7\") " pod="openshift-multus/network-metrics-daemon-pghnx" May 27 18:00:12.517083 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.516988 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-grpc-tls\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.517083 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.517037 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.517083 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.517073 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmwcb\" (UniqueName: \"kubernetes.io/projected/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-kube-api-access-xmwcb\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.517398 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.517112 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.517398 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.517146 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.517398 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.517193 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.517398 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.517237 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-tls\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.517398 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.517266 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-metrics-client-ca\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.518056 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.518021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-metrics-client-ca\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.520552 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.520502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.520799 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.520752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-grpc-tls\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.521468 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.521361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.521468 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.521420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.521613 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.521473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-tls\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.521664 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.521617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.527361 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.527339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmwcb\" (UniqueName: \"kubernetes.io/projected/b28564e8-4fc9-4ec9-9be9-eee4e1f5523f-kube-api-access-xmwcb\") pod \"thanos-querier-7cd449db45-mhlvn\" (UID: \"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f\") " pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.577607 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.577571 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-snwzs\"" May 27 18:00:12.584921 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.584891 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pghnx" May 27 18:00:12.686016 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.685984 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:12.742166 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.742125 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pghnx"] May 27 18:00:12.746784 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:00:12.746722 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd1832a_5a40_4e13_8cd7_1db0de605be7.slice/crio-b0a998af151c9cefb30b50988682a847b210310733b25423250c74f996c1914f WatchSource:0}: Error finding container b0a998af151c9cefb30b50988682a847b210310733b25423250c74f996c1914f: Status 404 returned error can't find the container with id b0a998af151c9cefb30b50988682a847b210310733b25423250c74f996c1914f May 27 18:00:12.882988 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:12.882955 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cd449db45-mhlvn"] May 27 18:00:12.886467 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:00:12.886432 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28564e8_4fc9_4ec9_9be9_eee4e1f5523f.slice/crio-ea18b04b7af6e4b4b12754cf1b60d5faa9744e9a649fb35d93ad7ebf22e845f5 WatchSource:0}: Error finding container ea18b04b7af6e4b4b12754cf1b60d5faa9744e9a649fb35d93ad7ebf22e845f5: Status 404 returned error can't find the container with id ea18b04b7af6e4b4b12754cf1b60d5faa9744e9a649fb35d93ad7ebf22e845f5 May 27 18:00:13.021903 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:13.021859 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" event={"ID":"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f","Type":"ContainerStarted","Data":"ea18b04b7af6e4b4b12754cf1b60d5faa9744e9a649fb35d93ad7ebf22e845f5"} May 27 18:00:13.023598 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:13.023568 2576 generic.go:358] "Generic (PLEG): container finished" podID="9a5d59c7-060e-4daa-981e-81746fe4fcb4" containerID="ecca60afd30d9ac6fb5efc483cded650172660b4c142d321482b246d01a33404" exitCode=0 May 27 18:00:13.023740 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:13.023664 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8rxr" event={"ID":"9a5d59c7-060e-4daa-981e-81746fe4fcb4","Type":"ContainerDied","Data":"ecca60afd30d9ac6fb5efc483cded650172660b4c142d321482b246d01a33404"} May 27 18:00:13.026221 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:13.026120 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" event={"ID":"b084b089-dfb9-4e13-b32a-2ee86937c742","Type":"ContainerStarted","Data":"6a4247c3f6233360b194f3415ec72c717b218f67a2b1ebb48fb209fe7a0e5c58"} May 27 18:00:13.026221 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:13.026152 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" event={"ID":"b084b089-dfb9-4e13-b32a-2ee86937c742","Type":"ContainerStarted","Data":"309e8c7ece8daf1091d4ac19ed7d2859aeaca669e9b9c5bfd97ae7880f026916"} May 27 18:00:13.026221 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:13.026167 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" event={"ID":"b084b089-dfb9-4e13-b32a-2ee86937c742","Type":"ContainerStarted","Data":"15efa3c0106f87ee3121d37e7e0b4e9b207a099692c5ad3f9e1b20fba108253a"} May 27 18:00:13.027889 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:13.027866 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pghnx" event={"ID":"7dd1832a-5a40-4e13-8cd7-1db0de605be7","Type":"ContainerStarted","Data":"b0a998af151c9cefb30b50988682a847b210310733b25423250c74f996c1914f"} May 27 18:00:13.064046 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:13.063984 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fxd9k" podStartSLOduration=1.9447665170000001 podStartE2EDuration="4.063966212s" podCreationTimestamp="2026-05-27 18:00:09 +0000 UTC" firstStartedPulling="2026-05-27 18:00:09.8240242 +0000 UTC m=+127.841234759" lastFinishedPulling="2026-05-27 18:00:11.943223895 +0000 UTC m=+129.960434454" observedRunningTime="2026-05-27 18:00:13.063141552 +0000 UTC m=+131.080352134" watchObservedRunningTime="2026-05-27 18:00:13.063966212 +0000 UTC m=+131.081176888" May 27 18:00:14.037264 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:14.037222 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8rxr" event={"ID":"9a5d59c7-060e-4daa-981e-81746fe4fcb4","Type":"ContainerStarted","Data":"5b35811ba2ed0b1f54409b3acd5d3f0e967c2a347914285f8984d55d95454bd5"} May 27 18:00:14.037741 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:14.037273 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8rxr" event={"ID":"9a5d59c7-060e-4daa-981e-81746fe4fcb4","Type":"ContainerStarted","Data":"274fe8c4fc316a6dc5ca360e0c9ab9141212c5935757f1b9d5acfccc04eff784"} May 27 18:00:14.066509 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:14.066035 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f8rxr" podStartSLOduration=2.82429981 podStartE2EDuration="5.066003664s" podCreationTimestamp="2026-05-27 18:00:09 +0000 UTC" firstStartedPulling="2026-05-27 18:00:09.698746244 +0000 UTC m=+127.715956812" lastFinishedPulling="2026-05-27 18:00:11.940450096 +0000 UTC m=+129.957660666" observedRunningTime="2026-05-27 18:00:14.065622621 +0000 UTC m=+132.082833200" watchObservedRunningTime="2026-05-27 18:00:14.066003664 +0000 UTC m=+132.083214242" May 27 18:00:16.046326 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:16.046263 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pghnx" event={"ID":"7dd1832a-5a40-4e13-8cd7-1db0de605be7","Type":"ContainerStarted","Data":"1b4813b69d481a02af5610ba2671bb3da09fa3917da8406b0dbe70f6db0bee98"} May 27 18:00:16.046326 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:16.046330 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pghnx" event={"ID":"7dd1832a-5a40-4e13-8cd7-1db0de605be7","Type":"ContainerStarted","Data":"64b28b684c828982cb0ed20e76763e336029ed2067e6e7b1dd8c26d7439cce66"} May 27 18:00:16.048117 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:16.048090 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" event={"ID":"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f","Type":"ContainerStarted","Data":"cd1a29ff57c2ba8732b5586ee9ab69e68f4fa5eee0950d41dd02e81e94bd4830"} May 27 18:00:16.048117 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:16.048120 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" event={"ID":"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f","Type":"ContainerStarted","Data":"f279c5a4266e8e95d9373212f135e2f48903980fc9f5f6731543ea847b57e111"} May 27 18:00:16.048277 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:16.048130 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" event={"ID":"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f","Type":"ContainerStarted","Data":"ed8118ccb14683c752c733cc2e0e4a6f00891517c351e4bc67ccb103760599ca"} May 27 18:00:16.063864 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:16.063811 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pghnx" podStartSLOduration=131.866117154 podStartE2EDuration="2m14.063777619s" podCreationTimestamp="2026-05-27 17:58:02 +0000 UTC" firstStartedPulling="2026-05-27 18:00:12.749905611 +0000 UTC m=+130.767116173" lastFinishedPulling="2026-05-27 18:00:14.94756608 +0000 UTC m=+132.964776638" observedRunningTime="2026-05-27 18:00:16.062380301 +0000 UTC m=+134.079590877" watchObservedRunningTime="2026-05-27 18:00:16.063777619 +0000 UTC m=+134.080988243" May 27 18:00:17.053560 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:17.053529 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" event={"ID":"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f","Type":"ContainerStarted","Data":"ab1b0550bfac61c4d178fcb846f63dfe2be598db88852026f43e2150d662f72d"} May 27 18:00:17.053919 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:17.053571 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" event={"ID":"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f","Type":"ContainerStarted","Data":"1589ee124ff488fb3d943b7a198ab2cd297a35545cabecef13e4f0ef47ce89a4"} May 27 18:00:18.059560 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:18.059519 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" event={"ID":"b28564e8-4fc9-4ec9-9be9-eee4e1f5523f","Type":"ContainerStarted","Data":"44cf6dd77f5e0cf50f924dfa1f0d41cab78cb3c5d860c8f6cba9c8045fcfb22f"} May 27 18:00:18.060057 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:18.059700 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:18.094909 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:18.094857 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" podStartSLOduration=2.252867982 podStartE2EDuration="6.09484088s" podCreationTimestamp="2026-05-27 18:00:12 +0000 UTC" firstStartedPulling="2026-05-27 18:00:12.888975108 +0000 UTC m=+130.906185663" lastFinishedPulling="2026-05-27 18:00:16.730948 +0000 UTC m=+134.748158561" observedRunningTime="2026-05-27 18:00:18.093625534 +0000 UTC m=+136.110836114" watchObservedRunningTime="2026-05-27 18:00:18.09484088 +0000 UTC m=+136.112051494" May 27 18:00:24.068662 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:24.068631 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7cd449db45-mhlvn" May 27 18:00:25.003224 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:25.003185 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644ffcc8fb-cddv6"] May 27 18:00:50.023554 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.023460 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-644ffcc8fb-cddv6" podUID="2ca4f846-c30b-41a0-916a-b7caa8d1a102" containerName="console" containerID="cri-o://97ba4c6ce2b750fe41ea9785a6f3b0b4746b1f06a4991869e0626f80490dba79" gracePeriod=15 May 27 18:00:50.163182 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.163156 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644ffcc8fb-cddv6_2ca4f846-c30b-41a0-916a-b7caa8d1a102/console/0.log" May 27 18:00:50.163353 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.163195 2576 generic.go:358] "Generic (PLEG): container finished" podID="2ca4f846-c30b-41a0-916a-b7caa8d1a102" containerID="97ba4c6ce2b750fe41ea9785a6f3b0b4746b1f06a4991869e0626f80490dba79" exitCode=2 May 27 18:00:50.163353 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.163258 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644ffcc8fb-cddv6" event={"ID":"2ca4f846-c30b-41a0-916a-b7caa8d1a102","Type":"ContainerDied","Data":"97ba4c6ce2b750fe41ea9785a6f3b0b4746b1f06a4991869e0626f80490dba79"} May 27 18:00:50.290091 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.290066 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644ffcc8fb-cddv6_2ca4f846-c30b-41a0-916a-b7caa8d1a102/console/0.log" May 27 18:00:50.290240 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.290143 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644ffcc8fb-cddv6" May 27 18:00:50.336698 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.336660 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgw46\" (UniqueName: \"kubernetes.io/projected/2ca4f846-c30b-41a0-916a-b7caa8d1a102-kube-api-access-tgw46\") pod \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " May 27 18:00:50.336875 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.336717 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-trusted-ca-bundle\") pod \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " May 27 18:00:50.336875 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.336754 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-serving-cert\") pod \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " May 27 18:00:50.336946 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.336915 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-oauth-serving-cert\") pod \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " May 27 18:00:50.336980 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.336955 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-service-ca\") pod \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " May 27 18:00:50.337023 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.336988 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-config\") pod \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " May 27 18:00:50.337023 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.337014 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-oauth-config\") pod \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\" (UID: \"2ca4f846-c30b-41a0-916a-b7caa8d1a102\") " May 27 18:00:50.337319 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.337251 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2ca4f846-c30b-41a0-916a-b7caa8d1a102" (UID: "2ca4f846-c30b-41a0-916a-b7caa8d1a102"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:00:50.337447 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.337314 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ca4f846-c30b-41a0-916a-b7caa8d1a102" (UID: "2ca4f846-c30b-41a0-916a-b7caa8d1a102"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:00:50.337447 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.337327 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ca4f846-c30b-41a0-916a-b7caa8d1a102" (UID: "2ca4f846-c30b-41a0-916a-b7caa8d1a102"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:00:50.337447 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.337392 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-config" (OuterVolumeSpecName: "console-config") pod "2ca4f846-c30b-41a0-916a-b7caa8d1a102" (UID: "2ca4f846-c30b-41a0-916a-b7caa8d1a102"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:00:50.339037 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.339015 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ca4f846-c30b-41a0-916a-b7caa8d1a102" (UID: "2ca4f846-c30b-41a0-916a-b7caa8d1a102"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:00:50.339131 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.339030 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ca4f846-c30b-41a0-916a-b7caa8d1a102-kube-api-access-tgw46" (OuterVolumeSpecName: "kube-api-access-tgw46") pod "2ca4f846-c30b-41a0-916a-b7caa8d1a102" (UID: "2ca4f846-c30b-41a0-916a-b7caa8d1a102"). InnerVolumeSpecName "kube-api-access-tgw46". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:00:50.339131 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.339041 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ca4f846-c30b-41a0-916a-b7caa8d1a102" (UID: "2ca4f846-c30b-41a0-916a-b7caa8d1a102"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:00:50.437792 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.437751 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-trusted-ca-bundle\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:00:50.437792 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.437783 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-serving-cert\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:00:50.437792 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.437795 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-oauth-serving-cert\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:00:50.437792 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.437804 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-service-ca\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:00:50.438061 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.437813 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-config\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:00:50.438061 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.437821 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ca4f846-c30b-41a0-916a-b7caa8d1a102-console-oauth-config\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:00:50.438061 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:50.437830 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgw46\" (UniqueName: \"kubernetes.io/projected/2ca4f846-c30b-41a0-916a-b7caa8d1a102-kube-api-access-tgw46\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:00:51.169701 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:51.169672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644ffcc8fb-cddv6_2ca4f846-c30b-41a0-916a-b7caa8d1a102/console/0.log" May 27 18:00:51.170125 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:51.169749 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644ffcc8fb-cddv6" event={"ID":"2ca4f846-c30b-41a0-916a-b7caa8d1a102","Type":"ContainerDied","Data":"810611e2dd94972ccb78ffdd85c76b8085ea3e5fec4d4a57e8aabc9aa692dddb"} May 27 18:00:51.170125 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:51.169782 2576 scope.go:117] "RemoveContainer" containerID="97ba4c6ce2b750fe41ea9785a6f3b0b4746b1f06a4991869e0626f80490dba79" May 27 18:00:51.170125 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:51.169790 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644ffcc8fb-cddv6" May 27 18:00:51.187601 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:51.187571 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644ffcc8fb-cddv6"] May 27 18:00:51.193767 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:51.193740 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-644ffcc8fb-cddv6"] May 27 18:00:52.560692 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:00:52.560660 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ca4f846-c30b-41a0-916a-b7caa8d1a102" path="/var/lib/kubelet/pods/2ca4f846-c30b-41a0-916a-b7caa8d1a102/volumes" May 27 18:01:33.562316 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.562267 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74b6c5674f-jj22p"] May 27 18:01:33.562844 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.562575 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ca4f846-c30b-41a0-916a-b7caa8d1a102" containerName="console" May 27 18:01:33.562844 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.562586 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ca4f846-c30b-41a0-916a-b7caa8d1a102" containerName="console" May 27 18:01:33.562844 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.562653 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ca4f846-c30b-41a0-916a-b7caa8d1a102" containerName="console" May 27 18:01:33.567523 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.567493 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.570217 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.569994 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2j6k9\"" May 27 18:01:33.570217 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.570022 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 27 18:01:33.570217 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.570045 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 27 18:01:33.570217 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.570078 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 27 18:01:33.570217 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.570100 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 27 18:01:33.570217 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.570112 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 27 18:01:33.576915 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.576893 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 27 18:01:33.578071 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.578039 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74b6c5674f-jj22p"] May 27 18:01:33.665038 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.665000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbab515-8077-45e0-abb0-aa834a493026-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.665038 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.665043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-telemeter-client-tls\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.665331 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.665070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbab515-8077-45e0-abb0-aa834a493026-serving-certs-ca-bundle\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.665331 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.665138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-secret-telemeter-client\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.665331 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.665195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-federate-client-tls\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.665331 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.665225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdbab515-8077-45e0-abb0-aa834a493026-metrics-client-ca\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.665331 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.665295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.665523 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.665341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kh58\" (UniqueName: \"kubernetes.io/projected/cdbab515-8077-45e0-abb0-aa834a493026-kube-api-access-2kh58\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.766083 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.766053 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kh58\" (UniqueName: \"kubernetes.io/projected/cdbab515-8077-45e0-abb0-aa834a493026-kube-api-access-2kh58\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.766232 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.766098 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbab515-8077-45e0-abb0-aa834a493026-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.766232 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.766132 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-telemeter-client-tls\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.766232 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.766161 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbab515-8077-45e0-abb0-aa834a493026-serving-certs-ca-bundle\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.766232 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.766185 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-secret-telemeter-client\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.766232 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.766218 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-federate-client-tls\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.766531 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.766246 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdbab515-8077-45e0-abb0-aa834a493026-metrics-client-ca\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.766531 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.766325 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.767061 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.767033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbab515-8077-45e0-abb0-aa834a493026-serving-certs-ca-bundle\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.767236 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.767095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdbab515-8077-45e0-abb0-aa834a493026-metrics-client-ca\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.767236 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.767159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbab515-8077-45e0-abb0-aa834a493026-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.768753 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.768732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-federate-client-tls\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.768926 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.768839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.768926 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.768885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-secret-telemeter-client\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.769026 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.769005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cdbab515-8077-45e0-abb0-aa834a493026-telemeter-client-tls\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.775779 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.775752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kh58\" (UniqueName: \"kubernetes.io/projected/cdbab515-8077-45e0-abb0-aa834a493026-kube-api-access-2kh58\") pod \"telemeter-client-74b6c5674f-jj22p\" (UID: \"cdbab515-8077-45e0-abb0-aa834a493026\") " pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:33.879664 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:33.879598 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" May 27 18:01:34.008384 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:34.008345 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74b6c5674f-jj22p"] May 27 18:01:34.011770 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:01:34.011738 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbab515_8077_45e0_abb0_aa834a493026.slice/crio-97d1c6bf86ede1db305f701b09c30f3d07233fc374380da66e5d1b65e7ebf174 WatchSource:0}: Error finding container 97d1c6bf86ede1db305f701b09c30f3d07233fc374380da66e5d1b65e7ebf174: Status 404 returned error can't find the container with id 97d1c6bf86ede1db305f701b09c30f3d07233fc374380da66e5d1b65e7ebf174 May 27 18:01:34.296967 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:34.296935 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" event={"ID":"cdbab515-8077-45e0-abb0-aa834a493026","Type":"ContainerStarted","Data":"97d1c6bf86ede1db305f701b09c30f3d07233fc374380da66e5d1b65e7ebf174"} May 27 18:01:36.303547 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:36.303460 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" event={"ID":"cdbab515-8077-45e0-abb0-aa834a493026","Type":"ContainerStarted","Data":"202ab5205390d39843c6ad589bce9f2e8175ac18fc8e4fdd0e5252833befb1cc"} May 27 18:01:38.310580 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:38.310540 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" event={"ID":"cdbab515-8077-45e0-abb0-aa834a493026","Type":"ContainerStarted","Data":"e334cb9b863b21946fc5da031f64d89f09fe6b91069e3ebe0bee78b27b2745c6"} May 27 18:01:38.310580 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:38.310583 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" event={"ID":"cdbab515-8077-45e0-abb0-aa834a493026","Type":"ContainerStarted","Data":"d61794e303613a4072b8ddfa54b97c19ee17b821e9fe6c6c629cb620c78e777c"} May 27 18:01:38.331478 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:38.331418 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74b6c5674f-jj22p" podStartSLOduration=2.044593216 podStartE2EDuration="5.331400514s" podCreationTimestamp="2026-05-27 18:01:33 +0000 UTC" firstStartedPulling="2026-05-27 18:01:34.014109439 +0000 UTC m=+212.031320000" lastFinishedPulling="2026-05-27 18:01:37.300916744 +0000 UTC m=+215.318127298" observedRunningTime="2026-05-27 18:01:38.329886084 +0000 UTC m=+216.347096660" watchObservedRunningTime="2026-05-27 18:01:38.331400514 +0000 UTC m=+216.348611092" May 27 18:01:39.043587 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.043551 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-766f9b9dbf-vlbbg"] May 27 18:01:39.047535 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.047515 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.050065 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.050029 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 18:01:39.050979 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.050961 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 18:01:39.051087 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.050995 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cwmsm\"" May 27 18:01:39.051087 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.051038 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 18:01:39.051087 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.051079 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 18:01:39.051303 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.051272 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 18:01:39.054818 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.054799 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 18:01:39.058145 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.058127 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766f9b9dbf-vlbbg"] May 27 18:01:39.111876 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.111847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-config\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.112023 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.111889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-oauth-serving-cert\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.112023 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.111918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-service-ca\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.112023 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.111944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-serving-cert\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.112023 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.111983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-oauth-config\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.112179 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.112037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8cl2\" (UniqueName: \"kubernetes.io/projected/46f82b5e-3219-4daf-8bd8-387ebf38ed98-kube-api-access-l8cl2\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.112179 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.112107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-trusted-ca-bundle\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.213144 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.213109 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-oauth-config\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.213317 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.213150 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8cl2\" (UniqueName: \"kubernetes.io/projected/46f82b5e-3219-4daf-8bd8-387ebf38ed98-kube-api-access-l8cl2\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.213317 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.213200 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-trusted-ca-bundle\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.213317 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.213248 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-config\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.213317 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.213302 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-oauth-serving-cert\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.213541 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.213336 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-service-ca\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.213541 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.213393 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-serving-cert\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.214119 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.214090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-oauth-serving-cert\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.214228 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.214108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-service-ca\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.214228 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.214138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-config\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.214228 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.214163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-trusted-ca-bundle\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.215646 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.215630 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-oauth-config\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.215860 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.215838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-serving-cert\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.221756 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.221735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8cl2\" (UniqueName: \"kubernetes.io/projected/46f82b5e-3219-4daf-8bd8-387ebf38ed98-kube-api-access-l8cl2\") pod \"console-766f9b9dbf-vlbbg\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.358316 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.358204 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:39.483473 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:39.483348 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766f9b9dbf-vlbbg"] May 27 18:01:39.485906 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:01:39.485883 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f82b5e_3219_4daf_8bd8_387ebf38ed98.slice/crio-deb7c47b49db7b330d71f4d3ed01450975ead67e9c92cf092ca2596738ffa535 WatchSource:0}: Error finding container deb7c47b49db7b330d71f4d3ed01450975ead67e9c92cf092ca2596738ffa535: Status 404 returned error can't find the container with id deb7c47b49db7b330d71f4d3ed01450975ead67e9c92cf092ca2596738ffa535 May 27 18:01:40.318074 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:40.318040 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766f9b9dbf-vlbbg" event={"ID":"46f82b5e-3219-4daf-8bd8-387ebf38ed98","Type":"ContainerStarted","Data":"883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad"} May 27 18:01:40.318074 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:40.318073 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766f9b9dbf-vlbbg" event={"ID":"46f82b5e-3219-4daf-8bd8-387ebf38ed98","Type":"ContainerStarted","Data":"deb7c47b49db7b330d71f4d3ed01450975ead67e9c92cf092ca2596738ffa535"} May 27 18:01:40.336512 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:40.336468 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-766f9b9dbf-vlbbg" podStartSLOduration=1.336454877 podStartE2EDuration="1.336454877s" podCreationTimestamp="2026-05-27 18:01:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:01:40.334206961 +0000 UTC m=+218.351417548" watchObservedRunningTime="2026-05-27 18:01:40.336454877 +0000 UTC m=+218.353665453" May 27 18:01:47.117028 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.116990 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766f9b9dbf-vlbbg"] May 27 18:01:47.152424 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.152392 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-575f75d4df-d94s2"] May 27 18:01:47.155646 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.155621 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.170108 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.170073 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575f75d4df-d94s2"] May 27 18:01:47.277594 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.277560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4905ea69-644a-4a9f-80d9-1e6c2c22930d-console-oauth-config\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.277774 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.277600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4905ea69-644a-4a9f-80d9-1e6c2c22930d-console-serving-cert\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.277774 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.277627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-console-config\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.277774 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.277683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-service-ca\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.277774 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.277760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-oauth-serving-cert\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.277937 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.277855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-trusted-ca-bundle\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.277937 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.277880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w9jk\" (UniqueName: \"kubernetes.io/projected/4905ea69-644a-4a9f-80d9-1e6c2c22930d-kube-api-access-8w9jk\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379033 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.378933 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4905ea69-644a-4a9f-80d9-1e6c2c22930d-console-oauth-config\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379033 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.378986 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4905ea69-644a-4a9f-80d9-1e6c2c22930d-console-serving-cert\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379033 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.379016 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-console-config\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379359 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.379050 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-service-ca\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379359 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.379077 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-oauth-serving-cert\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379359 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.379141 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-trusted-ca-bundle\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379359 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.379166 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8w9jk\" (UniqueName: \"kubernetes.io/projected/4905ea69-644a-4a9f-80d9-1e6c2c22930d-kube-api-access-8w9jk\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379891 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.379860 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-console-config\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379997 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.379919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-service-ca\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.379997 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.379922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-oauth-serving-cert\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.380088 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.380070 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4905ea69-644a-4a9f-80d9-1e6c2c22930d-trusted-ca-bundle\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.382029 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.382011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4905ea69-644a-4a9f-80d9-1e6c2c22930d-console-oauth-config\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.382234 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.382214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4905ea69-644a-4a9f-80d9-1e6c2c22930d-console-serving-cert\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.387009 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.386986 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w9jk\" (UniqueName: \"kubernetes.io/projected/4905ea69-644a-4a9f-80d9-1e6c2c22930d-kube-api-access-8w9jk\") pod \"console-575f75d4df-d94s2\" (UID: \"4905ea69-644a-4a9f-80d9-1e6c2c22930d\") " pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.465153 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.465111 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:47.596100 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:47.596077 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-575f75d4df-d94s2"] May 27 18:01:47.598813 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:01:47.598784 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4905ea69_644a_4a9f_80d9_1e6c2c22930d.slice/crio-d633c9da4453e84c7214a7dcabcccf3d5d63caa15655843b98ecfe5f25c8ea06 WatchSource:0}: Error finding container d633c9da4453e84c7214a7dcabcccf3d5d63caa15655843b98ecfe5f25c8ea06: Status 404 returned error can't find the container with id d633c9da4453e84c7214a7dcabcccf3d5d63caa15655843b98ecfe5f25c8ea06 May 27 18:01:48.345545 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:48.345510 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575f75d4df-d94s2" event={"ID":"4905ea69-644a-4a9f-80d9-1e6c2c22930d","Type":"ContainerStarted","Data":"7620903bcb5e69d1382760c7e49f015625d46ac9d060c2a0b81e778df542963d"} May 27 18:01:48.345545 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:48.345548 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-575f75d4df-d94s2" event={"ID":"4905ea69-644a-4a9f-80d9-1e6c2c22930d","Type":"ContainerStarted","Data":"d633c9da4453e84c7214a7dcabcccf3d5d63caa15655843b98ecfe5f25c8ea06"} May 27 18:01:48.363013 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:48.362961 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-575f75d4df-d94s2" podStartSLOduration=1.362944873 podStartE2EDuration="1.362944873s" podCreationTimestamp="2026-05-27 18:01:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:01:48.362059139 +0000 UTC m=+226.379269730" watchObservedRunningTime="2026-05-27 18:01:48.362944873 +0000 UTC m=+226.380155449" May 27 18:01:49.359063 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:49.359033 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:01:57.466155 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:57.466119 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:57.466591 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:57.466167 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:57.470864 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:57.470837 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-575f75d4df-d94s2" May 27 18:01:58.377772 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:01:58.377744 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-575f75d4df-d94s2" May 27 18:02:12.136331 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.136241 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-766f9b9dbf-vlbbg" podUID="46f82b5e-3219-4daf-8bd8-387ebf38ed98" containerName="console" containerID="cri-o://883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad" gracePeriod=15 May 27 18:02:12.376115 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.376090 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766f9b9dbf-vlbbg_46f82b5e-3219-4daf-8bd8-387ebf38ed98/console/0.log" May 27 18:02:12.376243 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.376154 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:02:12.379494 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.379472 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-config\") pod \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " May 27 18:02:12.379621 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.379504 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-trusted-ca-bundle\") pod \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " May 27 18:02:12.379621 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.379533 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-oauth-config\") pod \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " May 27 18:02:12.379621 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.379585 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-serving-cert\") pod \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " May 27 18:02:12.379621 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.379618 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-service-ca\") pod \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " May 27 18:02:12.379823 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.379733 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8cl2\" (UniqueName: \"kubernetes.io/projected/46f82b5e-3219-4daf-8bd8-387ebf38ed98-kube-api-access-l8cl2\") pod \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " May 27 18:02:12.379823 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.379805 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-oauth-serving-cert\") pod \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\" (UID: \"46f82b5e-3219-4daf-8bd8-387ebf38ed98\") " May 27 18:02:12.379960 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.379939 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-config" (OuterVolumeSpecName: "console-config") pod "46f82b5e-3219-4daf-8bd8-387ebf38ed98" (UID: "46f82b5e-3219-4daf-8bd8-387ebf38ed98"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:02:12.380016 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.380001 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-service-ca" (OuterVolumeSpecName: "service-ca") pod "46f82b5e-3219-4daf-8bd8-387ebf38ed98" (UID: "46f82b5e-3219-4daf-8bd8-387ebf38ed98"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:02:12.380095 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.380078 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-service-ca\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:02:12.380139 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.380098 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-config\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:02:12.380325 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.380269 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46f82b5e-3219-4daf-8bd8-387ebf38ed98" (UID: "46f82b5e-3219-4daf-8bd8-387ebf38ed98"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:02:12.380467 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.380439 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46f82b5e-3219-4daf-8bd8-387ebf38ed98" (UID: "46f82b5e-3219-4daf-8bd8-387ebf38ed98"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:02:12.381889 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.381865 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46f82b5e-3219-4daf-8bd8-387ebf38ed98" (UID: "46f82b5e-3219-4daf-8bd8-387ebf38ed98"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:02:12.381973 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.381889 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46f82b5e-3219-4daf-8bd8-387ebf38ed98" (UID: "46f82b5e-3219-4daf-8bd8-387ebf38ed98"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:02:12.381973 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.381900 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f82b5e-3219-4daf-8bd8-387ebf38ed98-kube-api-access-l8cl2" (OuterVolumeSpecName: "kube-api-access-l8cl2") pod "46f82b5e-3219-4daf-8bd8-387ebf38ed98" (UID: "46f82b5e-3219-4daf-8bd8-387ebf38ed98"). InnerVolumeSpecName "kube-api-access-l8cl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:02:12.413480 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.413449 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766f9b9dbf-vlbbg_46f82b5e-3219-4daf-8bd8-387ebf38ed98/console/0.log" May 27 18:02:12.413648 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.413491 2576 generic.go:358] "Generic (PLEG): container finished" podID="46f82b5e-3219-4daf-8bd8-387ebf38ed98" containerID="883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad" exitCode=2 May 27 18:02:12.413648 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.413553 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766f9b9dbf-vlbbg" event={"ID":"46f82b5e-3219-4daf-8bd8-387ebf38ed98","Type":"ContainerDied","Data":"883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad"} May 27 18:02:12.413648 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.413557 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766f9b9dbf-vlbbg" May 27 18:02:12.413648 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.413581 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766f9b9dbf-vlbbg" event={"ID":"46f82b5e-3219-4daf-8bd8-387ebf38ed98","Type":"ContainerDied","Data":"deb7c47b49db7b330d71f4d3ed01450975ead67e9c92cf092ca2596738ffa535"} May 27 18:02:12.413648 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.413597 2576 scope.go:117] "RemoveContainer" containerID="883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad" May 27 18:02:12.425036 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.425014 2576 scope.go:117] "RemoveContainer" containerID="883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad" May 27 18:02:12.425358 ip-10-0-141-157 kubenswrapper[2576]: E0527 18:02:12.425326 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad\": container with ID starting with 883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad not found: ID does not exist" containerID="883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad" May 27 18:02:12.425411 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.425356 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad"} err="failed to get container status \"883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad\": rpc error: code = NotFound desc = could not find container \"883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad\": container with ID starting with 883bce8f221dae6e768fc80591f6a07f71609aa0439c30411d77bb4980bb16ad not found: ID does not exist" May 27 18:02:12.437623 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.437594 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766f9b9dbf-vlbbg"] May 27 18:02:12.442558 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.442532 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-766f9b9dbf-vlbbg"] May 27 18:02:12.480599 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.480550 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-oauth-config\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:02:12.480599 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.480600 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f82b5e-3219-4daf-8bd8-387ebf38ed98-console-serving-cert\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:02:12.480739 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.480616 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8cl2\" (UniqueName: \"kubernetes.io/projected/46f82b5e-3219-4daf-8bd8-387ebf38ed98-kube-api-access-l8cl2\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:02:12.480739 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.480625 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-oauth-serving-cert\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:02:12.480739 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.480634 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f82b5e-3219-4daf-8bd8-387ebf38ed98-trusted-ca-bundle\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:02:12.560455 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:12.560420 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46f82b5e-3219-4daf-8bd8-387ebf38ed98" path="/var/lib/kubelet/pods/46f82b5e-3219-4daf-8bd8-387ebf38ed98/volumes" May 27 18:02:24.048639 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.048600 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bp5qv"] May 27 18:02:24.049068 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.048936 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f82b5e-3219-4daf-8bd8-387ebf38ed98" containerName="console" May 27 18:02:24.049068 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.048947 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f82b5e-3219-4daf-8bd8-387ebf38ed98" containerName="console" May 27 18:02:24.049068 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.048994 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="46f82b5e-3219-4daf-8bd8-387ebf38ed98" containerName="console" May 27 18:02:24.050863 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.050841 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.054278 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.054256 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 18:02:24.057301 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.057253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a38719f5-01c3-40a5-b420-f15ec5c914a4-kubelet-config\") pod \"global-pull-secret-syncer-bp5qv\" (UID: \"a38719f5-01c3-40a5-b420-f15ec5c914a4\") " pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.057426 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.057320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a38719f5-01c3-40a5-b420-f15ec5c914a4-dbus\") pod \"global-pull-secret-syncer-bp5qv\" (UID: \"a38719f5-01c3-40a5-b420-f15ec5c914a4\") " pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.057426 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.057400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38719f5-01c3-40a5-b420-f15ec5c914a4-original-pull-secret\") pod \"global-pull-secret-syncer-bp5qv\" (UID: \"a38719f5-01c3-40a5-b420-f15ec5c914a4\") " pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.061496 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.061469 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bp5qv"] May 27 18:02:24.158403 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.158370 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a38719f5-01c3-40a5-b420-f15ec5c914a4-kubelet-config\") pod \"global-pull-secret-syncer-bp5qv\" (UID: \"a38719f5-01c3-40a5-b420-f15ec5c914a4\") " pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.158403 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.158417 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a38719f5-01c3-40a5-b420-f15ec5c914a4-dbus\") pod \"global-pull-secret-syncer-bp5qv\" (UID: \"a38719f5-01c3-40a5-b420-f15ec5c914a4\") " pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.158682 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.158487 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38719f5-01c3-40a5-b420-f15ec5c914a4-original-pull-secret\") pod \"global-pull-secret-syncer-bp5qv\" (UID: \"a38719f5-01c3-40a5-b420-f15ec5c914a4\") " pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.158682 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.158509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a38719f5-01c3-40a5-b420-f15ec5c914a4-kubelet-config\") pod \"global-pull-secret-syncer-bp5qv\" (UID: \"a38719f5-01c3-40a5-b420-f15ec5c914a4\") " pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.158682 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.158620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a38719f5-01c3-40a5-b420-f15ec5c914a4-dbus\") pod \"global-pull-secret-syncer-bp5qv\" (UID: \"a38719f5-01c3-40a5-b420-f15ec5c914a4\") " pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.160904 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.160881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a38719f5-01c3-40a5-b420-f15ec5c914a4-original-pull-secret\") pod \"global-pull-secret-syncer-bp5qv\" (UID: \"a38719f5-01c3-40a5-b420-f15ec5c914a4\") " pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.363621 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.363547 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp5qv" May 27 18:02:24.507988 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:24.507949 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bp5qv"] May 27 18:02:24.511122 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:02:24.511093 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38719f5_01c3_40a5_b420_f15ec5c914a4.slice/crio-921545af163a96fa05ff870a355942308916f5f2689a95705bfc1980ea0d7f1f WatchSource:0}: Error finding container 921545af163a96fa05ff870a355942308916f5f2689a95705bfc1980ea0d7f1f: Status 404 returned error can't find the container with id 921545af163a96fa05ff870a355942308916f5f2689a95705bfc1980ea0d7f1f May 27 18:02:25.471227 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:25.471188 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bp5qv" event={"ID":"a38719f5-01c3-40a5-b420-f15ec5c914a4","Type":"ContainerStarted","Data":"921545af163a96fa05ff870a355942308916f5f2689a95705bfc1980ea0d7f1f"} May 27 18:02:28.481535 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:28.481446 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bp5qv" event={"ID":"a38719f5-01c3-40a5-b420-f15ec5c914a4","Type":"ContainerStarted","Data":"b802514207947405801a19572062279e01f6c89e8f521880ace0e2e3ae37a22c"} May 27 18:02:28.498409 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:02:28.498351 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bp5qv" podStartSLOduration=0.828948615 podStartE2EDuration="4.498335121s" podCreationTimestamp="2026-05-27 18:02:24 +0000 UTC" firstStartedPulling="2026-05-27 18:02:24.512854638 +0000 UTC m=+262.530065197" lastFinishedPulling="2026-05-27 18:02:28.182241134 +0000 UTC m=+266.199451703" observedRunningTime="2026-05-27 18:02:28.49806457 +0000 UTC m=+266.515275148" watchObservedRunningTime="2026-05-27 18:02:28.498335121 +0000 UTC m=+266.515545697" May 27 18:03:02.498709 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:02.498678 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:03:02.501578 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:02.501550 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:03:02.508132 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:02.508043 2576 kubelet.go:1628] "Image garbage collection succeeded" May 27 18:03:22.055328 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.055276 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-svf44"] May 27 18:03:22.057344 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.057327 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:22.060255 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.060230 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 18:03:22.061206 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.061187 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 18:03:22.061332 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.061195 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rmqrf\"" May 27 18:03:22.067521 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.067497 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-svf44"] May 27 18:03:22.146496 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.146448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwpx5\" (UniqueName: \"kubernetes.io/projected/a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec-kube-api-access-mwpx5\") pod \"cert-manager-webhook-587ccfb98-svf44\" (UID: \"a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec\") " pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:22.146677 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.146503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-svf44\" (UID: \"a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec\") " pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:22.247009 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.246977 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwpx5\" (UniqueName: \"kubernetes.io/projected/a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec-kube-api-access-mwpx5\") pod \"cert-manager-webhook-587ccfb98-svf44\" (UID: \"a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec\") " pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:22.247155 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.247024 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-svf44\" (UID: \"a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec\") " pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:22.255612 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.255578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-svf44\" (UID: \"a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec\") " pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:22.255735 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.255680 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwpx5\" (UniqueName: \"kubernetes.io/projected/a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec-kube-api-access-mwpx5\") pod \"cert-manager-webhook-587ccfb98-svf44\" (UID: \"a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec\") " pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:22.381447 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.381343 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:22.520691 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.520629 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-svf44"] May 27 18:03:22.523507 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:03:22.523473 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6a4eeaa_c7e3_466b_b9bd_5ae36a363fec.slice/crio-1299934c5d7cdf3663751327a295e19ee4da40d2b3825327aba8eeb12c0095e9 WatchSource:0}: Error finding container 1299934c5d7cdf3663751327a295e19ee4da40d2b3825327aba8eeb12c0095e9: Status 404 returned error can't find the container with id 1299934c5d7cdf3663751327a295e19ee4da40d2b3825327aba8eeb12c0095e9 May 27 18:03:22.525120 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.525104 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:03:22.636034 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:22.635937 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" event={"ID":"a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec","Type":"ContainerStarted","Data":"1299934c5d7cdf3663751327a295e19ee4da40d2b3825327aba8eeb12c0095e9"} May 27 18:03:25.646030 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.645985 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" event={"ID":"a6a4eeaa-c7e3-466b-b9bd-5ae36a363fec","Type":"ContainerStarted","Data":"fd41e0a6dc1a61c261dc679f799776f466a6bc2b32fb6d5f49b32516f62541a4"} May 27 18:03:25.646422 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.646057 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:25.663348 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.663279 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" podStartSLOduration=0.809110692 podStartE2EDuration="3.663262049s" podCreationTimestamp="2026-05-27 18:03:22 +0000 UTC" firstStartedPulling="2026-05-27 18:03:22.525233308 +0000 UTC m=+320.542443863" lastFinishedPulling="2026-05-27 18:03:25.379384666 +0000 UTC m=+323.396595220" observedRunningTime="2026-05-27 18:03:25.66162831 +0000 UTC m=+323.678838886" watchObservedRunningTime="2026-05-27 18:03:25.663262049 +0000 UTC m=+323.680472626" May 27 18:03:25.730796 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.730754 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zntg5"] May 27 18:03:25.733032 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.733008 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" May 27 18:03:25.735835 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.735814 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jqvzc\"" May 27 18:03:25.744358 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.744329 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zntg5"] May 27 18:03:25.772787 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.772745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgq96\" (UniqueName: \"kubernetes.io/projected/5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb-kube-api-access-wgq96\") pod \"cert-manager-cainjector-68b757865b-zntg5\" (UID: \"5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" May 27 18:03:25.772971 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.772798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zntg5\" (UID: \"5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" May 27 18:03:25.873684 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.873642 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zntg5\" (UID: \"5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" May 27 18:03:25.873875 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.873755 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgq96\" (UniqueName: \"kubernetes.io/projected/5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb-kube-api-access-wgq96\") pod \"cert-manager-cainjector-68b757865b-zntg5\" (UID: \"5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" May 27 18:03:25.882368 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.882341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zntg5\" (UID: \"5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" May 27 18:03:25.882505 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:25.882393 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgq96\" (UniqueName: \"kubernetes.io/projected/5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb-kube-api-access-wgq96\") pod \"cert-manager-cainjector-68b757865b-zntg5\" (UID: \"5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" May 27 18:03:26.042163 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:26.042061 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" May 27 18:03:26.170501 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:26.170463 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zntg5"] May 27 18:03:26.173983 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:03:26.173957 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fb0b2ed_fbb2_4481_aef3_02f183b7f8cb.slice/crio-982c83d3762bef421835c84e96ef25065882904c351dab5e010ccc9599dba260 WatchSource:0}: Error finding container 982c83d3762bef421835c84e96ef25065882904c351dab5e010ccc9599dba260: Status 404 returned error can't find the container with id 982c83d3762bef421835c84e96ef25065882904c351dab5e010ccc9599dba260 May 27 18:03:26.651042 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:26.651005 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" event={"ID":"5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb","Type":"ContainerStarted","Data":"4a81f38cd3bb701e77626954c7c348470776054cb3747d36e98dbea018eccf34"} May 27 18:03:26.651474 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:26.651050 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" event={"ID":"5fb0b2ed-fbb2-4481-aef3-02f183b7f8cb","Type":"ContainerStarted","Data":"982c83d3762bef421835c84e96ef25065882904c351dab5e010ccc9599dba260"} May 27 18:03:26.668744 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:26.668691 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-zntg5" podStartSLOduration=1.668674873 podStartE2EDuration="1.668674873s" podCreationTimestamp="2026-05-27 18:03:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:03:26.667033655 +0000 UTC m=+324.684244232" watchObservedRunningTime="2026-05-27 18:03:26.668674873 +0000 UTC m=+324.685885450" May 27 18:03:31.653766 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:31.653728 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-svf44" May 27 18:03:33.153869 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.153829 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-dpx68"] May 27 18:03:33.156606 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.156582 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-dpx68" May 27 18:03:33.159324 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.159302 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2blnk\"" May 27 18:03:33.168680 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.168644 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-dpx68"] May 27 18:03:33.227139 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.227081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9012bb7-07da-4c82-b05f-64648a04dc9a-bound-sa-token\") pod \"cert-manager-79c8d999ff-dpx68\" (UID: \"e9012bb7-07da-4c82-b05f-64648a04dc9a\") " pod="cert-manager/cert-manager-79c8d999ff-dpx68" May 27 18:03:33.227360 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.227195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7kxs\" (UniqueName: \"kubernetes.io/projected/e9012bb7-07da-4c82-b05f-64648a04dc9a-kube-api-access-d7kxs\") pod \"cert-manager-79c8d999ff-dpx68\" (UID: \"e9012bb7-07da-4c82-b05f-64648a04dc9a\") " pod="cert-manager/cert-manager-79c8d999ff-dpx68" May 27 18:03:33.328272 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.328233 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9012bb7-07da-4c82-b05f-64648a04dc9a-bound-sa-token\") pod \"cert-manager-79c8d999ff-dpx68\" (UID: \"e9012bb7-07da-4c82-b05f-64648a04dc9a\") " pod="cert-manager/cert-manager-79c8d999ff-dpx68" May 27 18:03:33.328586 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.328335 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7kxs\" (UniqueName: \"kubernetes.io/projected/e9012bb7-07da-4c82-b05f-64648a04dc9a-kube-api-access-d7kxs\") pod \"cert-manager-79c8d999ff-dpx68\" (UID: \"e9012bb7-07da-4c82-b05f-64648a04dc9a\") " pod="cert-manager/cert-manager-79c8d999ff-dpx68" May 27 18:03:33.336578 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.336547 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7kxs\" (UniqueName: \"kubernetes.io/projected/e9012bb7-07da-4c82-b05f-64648a04dc9a-kube-api-access-d7kxs\") pod \"cert-manager-79c8d999ff-dpx68\" (UID: \"e9012bb7-07da-4c82-b05f-64648a04dc9a\") " pod="cert-manager/cert-manager-79c8d999ff-dpx68" May 27 18:03:33.337020 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.336987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9012bb7-07da-4c82-b05f-64648a04dc9a-bound-sa-token\") pod \"cert-manager-79c8d999ff-dpx68\" (UID: \"e9012bb7-07da-4c82-b05f-64648a04dc9a\") " pod="cert-manager/cert-manager-79c8d999ff-dpx68" May 27 18:03:33.468709 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.468614 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-dpx68" May 27 18:03:33.597883 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.597852 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-dpx68"] May 27 18:03:33.601115 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:03:33.601086 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9012bb7_07da_4c82_b05f_64648a04dc9a.slice/crio-4e32e768ccdf199485a1763769f5ea462ce8d15d5b4936a4567cfb3644663416 WatchSource:0}: Error finding container 4e32e768ccdf199485a1763769f5ea462ce8d15d5b4936a4567cfb3644663416: Status 404 returned error can't find the container with id 4e32e768ccdf199485a1763769f5ea462ce8d15d5b4936a4567cfb3644663416 May 27 18:03:33.672937 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.672902 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-dpx68" event={"ID":"e9012bb7-07da-4c82-b05f-64648a04dc9a","Type":"ContainerStarted","Data":"4616834fb7c1a8edcc840e5bec5bea679bb9ab06ce088ddbaa04fa4cd75ff0cb"} May 27 18:03:33.672937 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.672936 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-dpx68" event={"ID":"e9012bb7-07da-4c82-b05f-64648a04dc9a","Type":"ContainerStarted","Data":"4e32e768ccdf199485a1763769f5ea462ce8d15d5b4936a4567cfb3644663416"} May 27 18:03:33.689032 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:33.688979 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-dpx68" podStartSLOduration=0.688963881 podStartE2EDuration="688.963881ms" podCreationTimestamp="2026-05-27 18:03:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:03:33.687965734 +0000 UTC m=+331.705176327" watchObservedRunningTime="2026-05-27 18:03:33.688963881 +0000 UTC m=+331.706174458" May 27 18:03:53.834134 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.834042 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5"] May 27 18:03:53.836464 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.836441 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:53.840762 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.840738 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 18:03:53.840916 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.840805 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 18:03:53.840916 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.840850 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 18:03:53.841228 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.841206 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zjbrd\"" May 27 18:03:53.841228 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.841223 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 18:03:53.854454 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.854425 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5"] May 27 18:03:53.906908 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.906869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55becbf2-2e2a-4741-8c90-08b42ccbbc01-webhook-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-qdgh5\" (UID: \"55becbf2-2e2a-4741-8c90-08b42ccbbc01\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:53.907072 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.906944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j6v5\" (UniqueName: \"kubernetes.io/projected/55becbf2-2e2a-4741-8c90-08b42ccbbc01-kube-api-access-8j6v5\") pod \"opendatahub-operator-controller-manager-667cd477ff-qdgh5\" (UID: \"55becbf2-2e2a-4741-8c90-08b42ccbbc01\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:53.907072 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:53.906985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55becbf2-2e2a-4741-8c90-08b42ccbbc01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-qdgh5\" (UID: \"55becbf2-2e2a-4741-8c90-08b42ccbbc01\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:54.007861 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:54.007823 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55becbf2-2e2a-4741-8c90-08b42ccbbc01-webhook-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-qdgh5\" (UID: \"55becbf2-2e2a-4741-8c90-08b42ccbbc01\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:54.008021 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:54.007893 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8j6v5\" (UniqueName: \"kubernetes.io/projected/55becbf2-2e2a-4741-8c90-08b42ccbbc01-kube-api-access-8j6v5\") pod \"opendatahub-operator-controller-manager-667cd477ff-qdgh5\" (UID: \"55becbf2-2e2a-4741-8c90-08b42ccbbc01\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:54.008021 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:54.007939 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55becbf2-2e2a-4741-8c90-08b42ccbbc01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-qdgh5\" (UID: \"55becbf2-2e2a-4741-8c90-08b42ccbbc01\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:54.010343 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:54.010316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55becbf2-2e2a-4741-8c90-08b42ccbbc01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-qdgh5\" (UID: \"55becbf2-2e2a-4741-8c90-08b42ccbbc01\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:54.010486 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:54.010464 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55becbf2-2e2a-4741-8c90-08b42ccbbc01-webhook-cert\") pod \"opendatahub-operator-controller-manager-667cd477ff-qdgh5\" (UID: \"55becbf2-2e2a-4741-8c90-08b42ccbbc01\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:54.016784 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:54.016750 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j6v5\" (UniqueName: \"kubernetes.io/projected/55becbf2-2e2a-4741-8c90-08b42ccbbc01-kube-api-access-8j6v5\") pod \"opendatahub-operator-controller-manager-667cd477ff-qdgh5\" (UID: \"55becbf2-2e2a-4741-8c90-08b42ccbbc01\") " pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:54.148065 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:54.148028 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:54.297342 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:54.297315 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5"] May 27 18:03:54.300081 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:03:54.300047 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55becbf2_2e2a_4741_8c90_08b42ccbbc01.slice/crio-eb151ff8798bb09b0ac900c67afe04af64e537e7e07ab78a17c4ec9ebf021a5a WatchSource:0}: Error finding container eb151ff8798bb09b0ac900c67afe04af64e537e7e07ab78a17c4ec9ebf021a5a: Status 404 returned error can't find the container with id eb151ff8798bb09b0ac900c67afe04af64e537e7e07ab78a17c4ec9ebf021a5a May 27 18:03:54.734907 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:54.734869 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" event={"ID":"55becbf2-2e2a-4741-8c90-08b42ccbbc01","Type":"ContainerStarted","Data":"eb151ff8798bb09b0ac900c67afe04af64e537e7e07ab78a17c4ec9ebf021a5a"} May 27 18:03:57.748206 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:57.748163 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" event={"ID":"55becbf2-2e2a-4741-8c90-08b42ccbbc01","Type":"ContainerStarted","Data":"0e47f0e89ee7f8918614eddedda8e3385c207c28a064547a1ec3d9cabe0f2396"} May 27 18:03:57.748696 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:57.748239 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:03:57.771509 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:03:57.771456 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" podStartSLOduration=2.236145682 podStartE2EDuration="4.771439872s" podCreationTimestamp="2026-05-27 18:03:53 +0000 UTC" firstStartedPulling="2026-05-27 18:03:54.301797974 +0000 UTC m=+352.319008529" lastFinishedPulling="2026-05-27 18:03:56.837091959 +0000 UTC m=+354.854302719" observedRunningTime="2026-05-27 18:03:57.76971047 +0000 UTC m=+355.786921050" watchObservedRunningTime="2026-05-27 18:03:57.771439872 +0000 UTC m=+355.788650448" May 27 18:04:08.753264 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:08.753231 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-667cd477ff-qdgh5" May 27 18:04:09.582457 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.582414 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h"] May 27 18:04:09.586789 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.586771 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.590276 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.590251 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 18:04:09.590441 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.590251 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5pdzm\"" May 27 18:04:09.590441 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.590252 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 18:04:09.590441 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.590371 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 18:04:09.590609 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.590546 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 18:04:09.590654 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.590642 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 18:04:09.598925 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.598900 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h"] May 27 18:04:09.743392 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.743358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-cert\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.743392 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.743394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-manager-config\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.743611 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.743461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg4wv\" (UniqueName: \"kubernetes.io/projected/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-kube-api-access-dg4wv\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.743611 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.743492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-metrics-cert\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.843904 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.843806 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-metrics-cert\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.843904 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.843851 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-cert\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.843904 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.843877 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-manager-config\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.844394 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.843938 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dg4wv\" (UniqueName: \"kubernetes.io/projected/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-kube-api-access-dg4wv\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.844577 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.844554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-manager-config\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.846306 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.846268 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-cert\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.846370 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.846341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-metrics-cert\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.859274 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.859241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg4wv\" (UniqueName: \"kubernetes.io/projected/b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3-kube-api-access-dg4wv\") pod \"lws-controller-manager-5c49b9c978-ctl6h\" (UID: \"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3\") " pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:09.896460 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:09.896421 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:10.044863 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:10.044831 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h"] May 27 18:04:10.047485 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:04:10.047458 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb186ccf6_8a7c_4942_9cb3_705e0d6d6ba3.slice/crio-0e912f7b10447546c9e0442f28e6f14b648f80db6c66e2055a6f9f9284d89234 WatchSource:0}: Error finding container 0e912f7b10447546c9e0442f28e6f14b648f80db6c66e2055a6f9f9284d89234: Status 404 returned error can't find the container with id 0e912f7b10447546c9e0442f28e6f14b648f80db6c66e2055a6f9f9284d89234 May 27 18:04:10.792362 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:10.792320 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" event={"ID":"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3","Type":"ContainerStarted","Data":"0e912f7b10447546c9e0442f28e6f14b648f80db6c66e2055a6f9f9284d89234"} May 27 18:04:12.801476 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:12.801438 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" event={"ID":"b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3","Type":"ContainerStarted","Data":"7e5cb7f9ed93d26145b8ddc28d11364d8903c7e87d9c410e388d61eb70fd5e5b"} May 27 18:04:12.801875 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:12.801553 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:12.825370 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:12.825313 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" podStartSLOduration=1.2948375699999999 podStartE2EDuration="3.825297323s" podCreationTimestamp="2026-05-27 18:04:09 +0000 UTC" firstStartedPulling="2026-05-27 18:04:10.049191736 +0000 UTC m=+368.066402291" lastFinishedPulling="2026-05-27 18:04:12.57965147 +0000 UTC m=+370.596862044" observedRunningTime="2026-05-27 18:04:12.823500317 +0000 UTC m=+370.840710895" watchObservedRunningTime="2026-05-27 18:04:12.825297323 +0000 UTC m=+370.842507892" May 27 18:04:23.807192 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:23.807155 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c49b9c978-ctl6h" May 27 18:04:40.881135 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.881094 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc"] May 27 18:04:40.887611 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.887582 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:40.890097 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.890062 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 18:04:40.890249 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.890109 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 18:04:40.890249 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.890181 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9tfs9\"" May 27 18:04:40.890249 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.890213 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 27 18:04:40.898842 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.898781 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc"] May 27 18:04:40.902405 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.902383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:40.902525 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.902413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:40.902525 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.902435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:40.902525 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.902469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l84w5\" (UniqueName: \"kubernetes.io/projected/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-kube-api-access-l84w5\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:40.902679 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.902549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:40.902679 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.902594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:40.902679 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.902669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:40.902836 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.902697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:40.902836 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:40.902750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.003837 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.003794 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.003837 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.003840 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004114 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.003888 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004114 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.003917 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004114 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.003966 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004114 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.004003 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004114 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.004032 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004114 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.004059 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004114 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.004093 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l84w5\" (UniqueName: \"kubernetes.io/projected/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-kube-api-access-l84w5\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004512 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.004412 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004512 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.004452 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004657 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.004622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.004657 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.004639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.005098 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.005071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.006226 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.006206 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.006696 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.006674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.012080 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.012047 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.012294 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.012258 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l84w5\" (UniqueName: \"kubernetes.io/projected/6c59fb2b-0c81-400f-a6f9-9d804af6ee1d-kube-api-access-l84w5\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc\" (UID: \"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.202432 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.202391 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:41.339155 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.339125 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc"] May 27 18:04:41.341032 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:04:41.341007 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c59fb2b_0c81_400f_a6f9_9d804af6ee1d.slice/crio-ba992b653ef631c7c9ef5a25f80eb41a60b7b10de79d0204dd8c54daa55d6630 WatchSource:0}: Error finding container ba992b653ef631c7c9ef5a25f80eb41a60b7b10de79d0204dd8c54daa55d6630: Status 404 returned error can't find the container with id ba992b653ef631c7c9ef5a25f80eb41a60b7b10de79d0204dd8c54daa55d6630 May 27 18:04:41.907426 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:41.907385 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" event={"ID":"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d","Type":"ContainerStarted","Data":"ba992b653ef631c7c9ef5a25f80eb41a60b7b10de79d0204dd8c54daa55d6630"} May 27 18:04:43.810843 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:43.810798 2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 18:04:43.811211 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:43.810893 2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 18:04:43.811211 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:43.810936 2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 18:04:43.919005 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:43.918962 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" event={"ID":"6c59fb2b-0c81-400f-a6f9-9d804af6ee1d","Type":"ContainerStarted","Data":"59d74af40e8a19e6f88d7767f45ad8e1194265bfd256a123310305309a69ed2a"} May 27 18:04:43.940956 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:43.940895 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" podStartSLOduration=1.4732286829999999 podStartE2EDuration="3.940880377s" podCreationTimestamp="2026-05-27 18:04:40 +0000 UTC" firstStartedPulling="2026-05-27 18:04:41.342901425 +0000 UTC m=+399.360111981" lastFinishedPulling="2026-05-27 18:04:43.81055312 +0000 UTC m=+401.827763675" observedRunningTime="2026-05-27 18:04:43.939698776 +0000 UTC m=+401.956909353" watchObservedRunningTime="2026-05-27 18:04:43.940880377 +0000 UTC m=+401.958090953" May 27 18:04:44.202999 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:44.202961 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:44.207889 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:44.207851 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:44.922630 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:44.922603 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:04:44.923764 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:04:44.923742 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc" May 27 18:05:12.077986 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.077946 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngzt6"] May 27 18:05:12.080533 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.080511 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" May 27 18:05:12.083498 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.083474 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 18:05:12.083633 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.083473 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 18:05:12.083633 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.083474 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5xfhl\"" May 27 18:05:12.094308 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.094254 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngzt6"] May 27 18:05:12.176637 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.176593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6zwj\" (UniqueName: \"kubernetes.io/projected/d08b95e0-7d1d-4913-9fe8-2366c1dd80f0-kube-api-access-h6zwj\") pod \"kuadrant-operator-catalog-ngzt6\" (UID: \"d08b95e0-7d1d-4913-9fe8-2366c1dd80f0\") " pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" May 27 18:05:12.278059 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.278012 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6zwj\" (UniqueName: \"kubernetes.io/projected/d08b95e0-7d1d-4913-9fe8-2366c1dd80f0-kube-api-access-h6zwj\") pod \"kuadrant-operator-catalog-ngzt6\" (UID: \"d08b95e0-7d1d-4913-9fe8-2366c1dd80f0\") " pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" May 27 18:05:12.287489 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.287465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6zwj\" (UniqueName: \"kubernetes.io/projected/d08b95e0-7d1d-4913-9fe8-2366c1dd80f0-kube-api-access-h6zwj\") pod \"kuadrant-operator-catalog-ngzt6\" (UID: \"d08b95e0-7d1d-4913-9fe8-2366c1dd80f0\") " pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" May 27 18:05:12.389813 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.389724 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" May 27 18:05:12.451807 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.451759 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngzt6"] May 27 18:05:12.522689 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.522663 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngzt6"] May 27 18:05:12.524522 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:05:12.524492 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08b95e0_7d1d_4913_9fe8_2366c1dd80f0.slice/crio-ca094734c93f3281236a691737f906d6a1dbdcb8d5208e24afbe6ea477d02ab5 WatchSource:0}: Error finding container ca094734c93f3281236a691737f906d6a1dbdcb8d5208e24afbe6ea477d02ab5: Status 404 returned error can't find the container with id ca094734c93f3281236a691737f906d6a1dbdcb8d5208e24afbe6ea477d02ab5 May 27 18:05:12.659064 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.659029 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6nkwd"] May 27 18:05:12.661772 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.661752 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" May 27 18:05:12.669774 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.669746 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6nkwd"] May 27 18:05:12.782341 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.782259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r8wt\" (UniqueName: \"kubernetes.io/projected/96d94e8e-3e34-471b-998e-0ba4d485d9ba-kube-api-access-5r8wt\") pod \"kuadrant-operator-catalog-6nkwd\" (UID: \"96d94e8e-3e34-471b-998e-0ba4d485d9ba\") " pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" May 27 18:05:12.883156 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.883112 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8wt\" (UniqueName: \"kubernetes.io/projected/96d94e8e-3e34-471b-998e-0ba4d485d9ba-kube-api-access-5r8wt\") pod \"kuadrant-operator-catalog-6nkwd\" (UID: \"96d94e8e-3e34-471b-998e-0ba4d485d9ba\") " pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" May 27 18:05:12.893041 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.893016 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r8wt\" (UniqueName: \"kubernetes.io/projected/96d94e8e-3e34-471b-998e-0ba4d485d9ba-kube-api-access-5r8wt\") pod \"kuadrant-operator-catalog-6nkwd\" (UID: \"96d94e8e-3e34-471b-998e-0ba4d485d9ba\") " pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" May 27 18:05:12.972044 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:12.971960 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" May 27 18:05:13.014685 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:13.014652 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" event={"ID":"d08b95e0-7d1d-4913-9fe8-2366c1dd80f0","Type":"ContainerStarted","Data":"ca094734c93f3281236a691737f906d6a1dbdcb8d5208e24afbe6ea477d02ab5"} May 27 18:05:13.108511 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:13.108482 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6nkwd"] May 27 18:05:13.110876 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:05:13.110847 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d94e8e_3e34_471b_998e_0ba4d485d9ba.slice/crio-fc8aaa5aa90438559a91f2ce23b15950c13648d3cca1b29e23491f7b485bbfee WatchSource:0}: Error finding container fc8aaa5aa90438559a91f2ce23b15950c13648d3cca1b29e23491f7b485bbfee: Status 404 returned error can't find the container with id fc8aaa5aa90438559a91f2ce23b15950c13648d3cca1b29e23491f7b485bbfee May 27 18:05:14.021016 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:14.020973 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" event={"ID":"96d94e8e-3e34-471b-998e-0ba4d485d9ba","Type":"ContainerStarted","Data":"fc8aaa5aa90438559a91f2ce23b15950c13648d3cca1b29e23491f7b485bbfee"} May 27 18:05:15.025238 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:15.025199 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" event={"ID":"96d94e8e-3e34-471b-998e-0ba4d485d9ba","Type":"ContainerStarted","Data":"6ea88770981b4c5045dc9e6e6a264e85d0ed233de0d6d4b5ad9206c8ac28bfff"} May 27 18:05:15.026579 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:15.026546 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" event={"ID":"d08b95e0-7d1d-4913-9fe8-2366c1dd80f0","Type":"ContainerStarted","Data":"bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64"} May 27 18:05:15.026708 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:15.026575 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" podUID="d08b95e0-7d1d-4913-9fe8-2366c1dd80f0" containerName="registry-server" containerID="cri-o://bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64" gracePeriod=2 May 27 18:05:15.040409 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:15.040265 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" podStartSLOduration=1.58236897 podStartE2EDuration="3.040250887s" podCreationTimestamp="2026-05-27 18:05:12 +0000 UTC" firstStartedPulling="2026-05-27 18:05:13.112261062 +0000 UTC m=+431.129471617" lastFinishedPulling="2026-05-27 18:05:14.57014298 +0000 UTC m=+432.587353534" observedRunningTime="2026-05-27 18:05:15.039519578 +0000 UTC m=+433.056730165" watchObservedRunningTime="2026-05-27 18:05:15.040250887 +0000 UTC m=+433.057461462" May 27 18:05:15.055503 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:15.055460 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" podStartSLOduration=1.013854052 podStartE2EDuration="3.055444708s" podCreationTimestamp="2026-05-27 18:05:12 +0000 UTC" firstStartedPulling="2026-05-27 18:05:12.525889491 +0000 UTC m=+430.543100053" lastFinishedPulling="2026-05-27 18:05:14.567480152 +0000 UTC m=+432.584690709" observedRunningTime="2026-05-27 18:05:15.053505372 +0000 UTC m=+433.070715949" watchObservedRunningTime="2026-05-27 18:05:15.055444708 +0000 UTC m=+433.072655283" May 27 18:05:15.263796 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:15.263773 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" May 27 18:05:15.409407 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:15.409374 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6zwj\" (UniqueName: \"kubernetes.io/projected/d08b95e0-7d1d-4913-9fe8-2366c1dd80f0-kube-api-access-h6zwj\") pod \"d08b95e0-7d1d-4913-9fe8-2366c1dd80f0\" (UID: \"d08b95e0-7d1d-4913-9fe8-2366c1dd80f0\") " May 27 18:05:15.411640 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:15.411613 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d08b95e0-7d1d-4913-9fe8-2366c1dd80f0-kube-api-access-h6zwj" (OuterVolumeSpecName: "kube-api-access-h6zwj") pod "d08b95e0-7d1d-4913-9fe8-2366c1dd80f0" (UID: "d08b95e0-7d1d-4913-9fe8-2366c1dd80f0"). InnerVolumeSpecName "kube-api-access-h6zwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:05:15.510340 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:15.510279 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6zwj\" (UniqueName: \"kubernetes.io/projected/d08b95e0-7d1d-4913-9fe8-2366c1dd80f0-kube-api-access-h6zwj\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:05:16.031462 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.031424 2576 generic.go:358] "Generic (PLEG): container finished" podID="d08b95e0-7d1d-4913-9fe8-2366c1dd80f0" containerID="bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64" exitCode=0 May 27 18:05:16.031924 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.031489 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" May 27 18:05:16.031924 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.031513 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" event={"ID":"d08b95e0-7d1d-4913-9fe8-2366c1dd80f0","Type":"ContainerDied","Data":"bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64"} May 27 18:05:16.031924 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.031553 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ngzt6" event={"ID":"d08b95e0-7d1d-4913-9fe8-2366c1dd80f0","Type":"ContainerDied","Data":"ca094734c93f3281236a691737f906d6a1dbdcb8d5208e24afbe6ea477d02ab5"} May 27 18:05:16.031924 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.031570 2576 scope.go:117] "RemoveContainer" containerID="bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64" May 27 18:05:16.040456 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.040438 2576 scope.go:117] "RemoveContainer" containerID="bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64" May 27 18:05:16.040753 ip-10-0-141-157 kubenswrapper[2576]: E0527 18:05:16.040730 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64\": container with ID starting with bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64 not found: ID does not exist" containerID="bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64" May 27 18:05:16.040796 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.040762 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64"} err="failed to get container status \"bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64\": rpc error: code = NotFound desc = could not find container \"bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64\": container with ID starting with bd8157f6adaccd9205be288d0c467557dc1a24cf843d238c76eee4486b026b64 not found: ID does not exist" May 27 18:05:16.052275 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.052239 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngzt6"] May 27 18:05:16.057054 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.057008 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngzt6"] May 27 18:05:16.561681 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:16.561648 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d08b95e0-7d1d-4913-9fe8-2366c1dd80f0" path="/var/lib/kubelet/pods/d08b95e0-7d1d-4913-9fe8-2366c1dd80f0/volumes" May 27 18:05:22.972371 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:22.972330 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" May 27 18:05:22.972371 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:22.972379 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" May 27 18:05:22.993913 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:22.993881 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" May 27 18:05:23.075276 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:23.075250 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6nkwd" May 27 18:05:37.632703 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.632661 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c"] May 27 18:05:37.633314 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.633268 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08b95e0-7d1d-4913-9fe8-2366c1dd80f0" containerName="registry-server" May 27 18:05:37.633314 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.633313 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08b95e0-7d1d-4913-9fe8-2366c1dd80f0" containerName="registry-server" May 27 18:05:37.633467 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.633436 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="d08b95e0-7d1d-4913-9fe8-2366c1dd80f0" containerName="registry-server" May 27 18:05:37.637888 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.637865 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" May 27 18:05:37.640456 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.640432 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gmld4\"" May 27 18:05:37.640586 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.640459 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 27 18:05:37.644277 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.644252 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c"] May 27 18:05:37.707911 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.707869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq4tb\" (UniqueName: \"kubernetes.io/projected/0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d-kube-api-access-gq4tb\") pod \"dns-operator-controller-manager-648d5c98bc-m7f2c\" (UID: \"0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" May 27 18:05:37.809505 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.809469 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gq4tb\" (UniqueName: \"kubernetes.io/projected/0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d-kube-api-access-gq4tb\") pod \"dns-operator-controller-manager-648d5c98bc-m7f2c\" (UID: \"0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" May 27 18:05:37.818170 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.818150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq4tb\" (UniqueName: \"kubernetes.io/projected/0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d-kube-api-access-gq4tb\") pod \"dns-operator-controller-manager-648d5c98bc-m7f2c\" (UID: \"0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" May 27 18:05:37.949297 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:37.949238 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" May 27 18:05:38.080809 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:38.080784 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c"] May 27 18:05:38.083156 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:05:38.083113 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f03bd5f_f88e_4a82_8aaa_5c8c44a2215d.slice/crio-b9f81d768603a6533c61df16c4f8d02dd321a7b1b662d62c7aeef4f6871f0f86 WatchSource:0}: Error finding container b9f81d768603a6533c61df16c4f8d02dd321a7b1b662d62c7aeef4f6871f0f86: Status 404 returned error can't find the container with id b9f81d768603a6533c61df16c4f8d02dd321a7b1b662d62c7aeef4f6871f0f86 May 27 18:05:38.103659 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:38.103627 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" event={"ID":"0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d","Type":"ContainerStarted","Data":"b9f81d768603a6533c61df16c4f8d02dd321a7b1b662d62c7aeef4f6871f0f86"} May 27 18:05:41.116970 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.116924 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" event={"ID":"0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d","Type":"ContainerStarted","Data":"4c966fd6953d788ab76b7fcfc4a187ee5b1413fb86090231867d5b45224ebbc3"} May 27 18:05:41.117472 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.117054 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" May 27 18:05:41.134614 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.134553 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" podStartSLOduration=1.886995252 podStartE2EDuration="4.134535906s" podCreationTimestamp="2026-05-27 18:05:37 +0000 UTC" firstStartedPulling="2026-05-27 18:05:38.085082221 +0000 UTC m=+456.102292777" lastFinishedPulling="2026-05-27 18:05:40.332622857 +0000 UTC m=+458.349833431" observedRunningTime="2026-05-27 18:05:41.132841604 +0000 UTC m=+459.150052180" watchObservedRunningTime="2026-05-27 18:05:41.134535906 +0000 UTC m=+459.151746585" May 27 18:05:41.311259 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.311218 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x"] May 27 18:05:41.314785 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.314762 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" May 27 18:05:41.317058 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.317036 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7msgf\"" May 27 18:05:41.322213 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.322187 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x"] May 27 18:05:41.444841 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.444788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfk22\" (UniqueName: \"kubernetes.io/projected/0c864fd7-ab3c-4164-9005-f875bbe8a8b4-kube-api-access-cfk22\") pod \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" (UID: \"0c864fd7-ab3c-4164-9005-f875bbe8a8b4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" May 27 18:05:41.545385 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.545324 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfk22\" (UniqueName: \"kubernetes.io/projected/0c864fd7-ab3c-4164-9005-f875bbe8a8b4-kube-api-access-cfk22\") pod \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" (UID: \"0c864fd7-ab3c-4164-9005-f875bbe8a8b4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" May 27 18:05:41.553726 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.553698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfk22\" (UniqueName: \"kubernetes.io/projected/0c864fd7-ab3c-4164-9005-f875bbe8a8b4-kube-api-access-cfk22\") pod \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" (UID: \"0c864fd7-ab3c-4164-9005-f875bbe8a8b4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" May 27 18:05:41.625571 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.625518 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" May 27 18:05:41.761386 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:41.761362 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x"] May 27 18:05:41.764323 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:05:41.764249 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c864fd7_ab3c_4164_9005_f875bbe8a8b4.slice/crio-c83a9eea1aa7f9d03b97433484b21a014d1c9409e6af8bcb3a3b4e22dd631f0e WatchSource:0}: Error finding container c83a9eea1aa7f9d03b97433484b21a014d1c9409e6af8bcb3a3b4e22dd631f0e: Status 404 returned error can't find the container with id c83a9eea1aa7f9d03b97433484b21a014d1c9409e6af8bcb3a3b4e22dd631f0e May 27 18:05:42.121026 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:42.120923 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" event={"ID":"0c864fd7-ab3c-4164-9005-f875bbe8a8b4","Type":"ContainerStarted","Data":"c83a9eea1aa7f9d03b97433484b21a014d1c9409e6af8bcb3a3b4e22dd631f0e"} May 27 18:05:44.129738 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:44.129643 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" event={"ID":"0c864fd7-ab3c-4164-9005-f875bbe8a8b4","Type":"ContainerStarted","Data":"b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab"} May 27 18:05:44.130097 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:44.129764 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" May 27 18:05:44.146379 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:44.146270 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" podStartSLOduration=1.235825366 podStartE2EDuration="3.146251728s" podCreationTimestamp="2026-05-27 18:05:41 +0000 UTC" firstStartedPulling="2026-05-27 18:05:41.767194196 +0000 UTC m=+459.784404769" lastFinishedPulling="2026-05-27 18:05:43.677620571 +0000 UTC m=+461.694831131" observedRunningTime="2026-05-27 18:05:44.145781149 +0000 UTC m=+462.162991727" watchObservedRunningTime="2026-05-27 18:05:44.146251728 +0000 UTC m=+462.163462306" May 27 18:05:50.132389 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.132350 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd"] May 27 18:05:50.140190 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.140169 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:05:50.144225 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.144205 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lml4s\"" May 27 18:05:50.153693 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.153662 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd"] May 27 18:05:50.225355 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.225313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f6cfa9-390a-4f53-b43a-000fb4165db9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" (UID: \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:05:50.225538 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.225438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhdp\" (UniqueName: \"kubernetes.io/projected/b4f6cfa9-390a-4f53-b43a-000fb4165db9-kube-api-access-9qhdp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" (UID: \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:05:50.326670 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.326633 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhdp\" (UniqueName: \"kubernetes.io/projected/b4f6cfa9-390a-4f53-b43a-000fb4165db9-kube-api-access-9qhdp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" (UID: \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:05:50.326670 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.326682 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f6cfa9-390a-4f53-b43a-000fb4165db9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" (UID: \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:05:50.327111 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.327086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f6cfa9-390a-4f53-b43a-000fb4165db9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" (UID: \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:05:50.349072 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.349035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhdp\" (UniqueName: \"kubernetes.io/projected/b4f6cfa9-390a-4f53-b43a-000fb4165db9-kube-api-access-9qhdp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" (UID: \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:05:50.450101 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.450061 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:05:50.587162 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:50.587136 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd"] May 27 18:05:50.589639 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:05:50.589610 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f6cfa9_390a_4f53_b43a_000fb4165db9.slice/crio-bb501223e664e7fa9d724c4af303a498fa0c4e7445fe0350f7c62493bd97bc56 WatchSource:0}: Error finding container bb501223e664e7fa9d724c4af303a498fa0c4e7445fe0350f7c62493bd97bc56: Status 404 returned error can't find the container with id bb501223e664e7fa9d724c4af303a498fa0c4e7445fe0350f7c62493bd97bc56 May 27 18:05:51.165495 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:51.165457 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" event={"ID":"b4f6cfa9-390a-4f53-b43a-000fb4165db9","Type":"ContainerStarted","Data":"bb501223e664e7fa9d724c4af303a498fa0c4e7445fe0350f7c62493bd97bc56"} May 27 18:05:52.123486 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:52.123451 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-m7f2c" May 27 18:05:55.136511 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:55.136324 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" May 27 18:05:56.185521 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:56.185485 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" event={"ID":"b4f6cfa9-390a-4f53-b43a-000fb4165db9","Type":"ContainerStarted","Data":"c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3"} May 27 18:05:56.186008 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:56.185564 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:05:56.218539 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:05:56.218415 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" podStartSLOduration=0.849299115 podStartE2EDuration="6.218395146s" podCreationTimestamp="2026-05-27 18:05:50 +0000 UTC" firstStartedPulling="2026-05-27 18:05:50.591884333 +0000 UTC m=+468.609094889" lastFinishedPulling="2026-05-27 18:05:55.96098036 +0000 UTC m=+473.978190920" observedRunningTime="2026-05-27 18:05:56.217069896 +0000 UTC m=+474.234280474" watchObservedRunningTime="2026-05-27 18:05:56.218395146 +0000 UTC m=+474.235605723" May 27 18:06:07.191430 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:07.191396 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:06:08.801609 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.801574 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd"] May 27 18:06:08.802062 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.801785 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" containerName="manager" containerID="cri-o://c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3" gracePeriod=2 May 27 18:06:08.807565 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.807528 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd"] May 27 18:06:08.829634 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.829598 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn"] May 27 18:06:08.830169 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.830153 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" containerName="manager" May 27 18:06:08.830211 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.830174 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" containerName="manager" May 27 18:06:08.830272 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.830261 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" containerName="manager" May 27 18:06:08.833792 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.833766 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:08.854615 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.854578 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn"] May 27 18:06:08.863760 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.863718 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x"] May 27 18:06:08.863975 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.863952 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" containerName="manager" containerID="cri-o://b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab" gracePeriod=2 May 27 18:06:08.885143 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.885076 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x"] May 27 18:06:08.887920 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.887878 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:08.891543 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.891510 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:08.896268 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.896240 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:08.897605 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.897582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03c43055-fcfa-4ad6-ac58-c320ff3d573c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-74jqn\" (UID: \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:08.897702 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.897680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fszg9\" (UniqueName: \"kubernetes.io/projected/03c43055-fcfa-4ad6-ac58-c320ff3d573c-kube-api-access-fszg9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-74jqn\" (UID: \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:08.905198 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.905157 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l"] May 27 18:06:08.905748 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.905726 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" containerName="manager" May 27 18:06:08.905748 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.905747 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" containerName="manager" May 27 18:06:08.905904 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.905807 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" containerName="manager" May 27 18:06:08.908929 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.908905 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" May 27 18:06:08.911633 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.911605 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:08.928433 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.928402 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l"] May 27 18:06:08.950084 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.950038 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:08.998841 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.998799 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fszg9\" (UniqueName: \"kubernetes.io/projected/03c43055-fcfa-4ad6-ac58-c320ff3d573c-kube-api-access-fszg9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-74jqn\" (UID: \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:08.999090 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.998901 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03c43055-fcfa-4ad6-ac58-c320ff3d573c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-74jqn\" (UID: \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:08.999364 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:08.999340 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03c43055-fcfa-4ad6-ac58-c320ff3d573c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-74jqn\" (UID: \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:09.012387 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.012343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fszg9\" (UniqueName: \"kubernetes.io/projected/03c43055-fcfa-4ad6-ac58-c320ff3d573c-kube-api-access-fszg9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-74jqn\" (UID: \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:09.100401 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.100372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lx5z\" (UniqueName: \"kubernetes.io/projected/9974d427-4cbe-432f-a43b-8c02392ab616-kube-api-access-6lx5z\") pod \"limitador-operator-controller-manager-85c4996f8c-rkg4l\" (UID: \"9974d427-4cbe-432f-a43b-8c02392ab616\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" May 27 18:06:09.104949 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.104927 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:06:09.107420 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.107386 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.108077 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.108062 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" May 27 18:06:09.109336 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.109314 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.111235 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.111209 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.113073 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.113049 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.201318 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.201249 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfk22\" (UniqueName: \"kubernetes.io/projected/0c864fd7-ab3c-4164-9005-f875bbe8a8b4-kube-api-access-cfk22\") pod \"0c864fd7-ab3c-4164-9005-f875bbe8a8b4\" (UID: \"0c864fd7-ab3c-4164-9005-f875bbe8a8b4\") " May 27 18:06:09.201318 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.201322 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f6cfa9-390a-4f53-b43a-000fb4165db9-extensions-socket-volume\") pod \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\" (UID: \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\") " May 27 18:06:09.201563 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.201340 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qhdp\" (UniqueName: \"kubernetes.io/projected/b4f6cfa9-390a-4f53-b43a-000fb4165db9-kube-api-access-9qhdp\") pod \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\" (UID: \"b4f6cfa9-390a-4f53-b43a-000fb4165db9\") " May 27 18:06:09.201563 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.201459 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lx5z\" (UniqueName: \"kubernetes.io/projected/9974d427-4cbe-432f-a43b-8c02392ab616-kube-api-access-6lx5z\") pod \"limitador-operator-controller-manager-85c4996f8c-rkg4l\" (UID: \"9974d427-4cbe-432f-a43b-8c02392ab616\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" May 27 18:06:09.201766 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.201742 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4f6cfa9-390a-4f53-b43a-000fb4165db9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b4f6cfa9-390a-4f53-b43a-000fb4165db9" (UID: "b4f6cfa9-390a-4f53-b43a-000fb4165db9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:06:09.203465 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.203439 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c864fd7-ab3c-4164-9005-f875bbe8a8b4-kube-api-access-cfk22" (OuterVolumeSpecName: "kube-api-access-cfk22") pod "0c864fd7-ab3c-4164-9005-f875bbe8a8b4" (UID: "0c864fd7-ab3c-4164-9005-f875bbe8a8b4"). InnerVolumeSpecName "kube-api-access-cfk22". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:06:09.203578 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.203531 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f6cfa9-390a-4f53-b43a-000fb4165db9-kube-api-access-9qhdp" (OuterVolumeSpecName: "kube-api-access-9qhdp") pod "b4f6cfa9-390a-4f53-b43a-000fb4165db9" (UID: "b4f6cfa9-390a-4f53-b43a-000fb4165db9"). InnerVolumeSpecName "kube-api-access-9qhdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:06:09.215419 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.215384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lx5z\" (UniqueName: \"kubernetes.io/projected/9974d427-4cbe-432f-a43b-8c02392ab616-kube-api-access-6lx5z\") pod \"limitador-operator-controller-manager-85c4996f8c-rkg4l\" (UID: \"9974d427-4cbe-432f-a43b-8c02392ab616\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" May 27 18:06:09.224172 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.224142 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:09.232357 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.232331 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" May 27 18:06:09.235140 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.235106 2576 generic.go:358] "Generic (PLEG): container finished" podID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" containerID="b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab" exitCode=0 May 27 18:06:09.235295 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.235152 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" May 27 18:06:09.235295 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.235220 2576 scope.go:117] "RemoveContainer" containerID="b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab" May 27 18:06:09.236658 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.236633 2576 generic.go:358] "Generic (PLEG): container finished" podID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" containerID="c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3" exitCode=0 May 27 18:06:09.236781 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.236686 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" May 27 18:06:09.237628 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.237597 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.239609 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.239579 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.241645 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.241613 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.244501 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.244460 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.246349 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.246312 2576 scope.go:117] "RemoveContainer" containerID="b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab" May 27 18:06:09.246902 ip-10-0-141-157 kubenswrapper[2576]: E0527 18:06:09.246730 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab\": container with ID starting with b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab not found: ID does not exist" containerID="b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab" May 27 18:06:09.246902 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.246774 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab"} err="failed to get container status \"b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab\": rpc error: code = NotFound desc = could not find container \"b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab\": container with ID starting with b7979a2511d9b74f429c42e9b0b15a1b56a2aa79ea65c5c033f9cb2827a5f9ab not found: ID does not exist" May 27 18:06:09.246902 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.246801 2576 scope.go:117] "RemoveContainer" containerID="c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3" May 27 18:06:09.252311 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.252261 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.254309 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.254254 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.256177 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.256147 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.256587 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.256569 2576 scope.go:117] "RemoveContainer" containerID="c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3" May 27 18:06:09.256936 ip-10-0-141-157 kubenswrapper[2576]: E0527 18:06:09.256914 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3\": container with ID starting with c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3 not found: ID does not exist" containerID="c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3" May 27 18:06:09.257029 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.256946 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3"} err="failed to get container status \"c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3\": rpc error: code = NotFound desc = could not find container \"c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3\": container with ID starting with c5e48e16d46ac05cc794b5f3813e921fb303b0e3ce80f1937984fbf6b52331e3 not found: ID does not exist" May 27 18:06:09.258190 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.258166 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:09.307888 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.304402 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfk22\" (UniqueName: \"kubernetes.io/projected/0c864fd7-ab3c-4164-9005-f875bbe8a8b4-kube-api-access-cfk22\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:06:09.307888 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.304434 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f6cfa9-390a-4f53-b43a-000fb4165db9-extensions-socket-volume\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:06:09.307888 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.304452 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qhdp\" (UniqueName: \"kubernetes.io/projected/b4f6cfa9-390a-4f53-b43a-000fb4165db9-kube-api-access-9qhdp\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:06:09.407057 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.407026 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn"] May 27 18:06:09.410135 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:06:09.410095 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c43055_fcfa_4ad6_ac58_c320ff3d573c.slice/crio-f1094266401d0162dd02bef8edac3c82f50942d1cf7a8061887cffa1ea6bc589 WatchSource:0}: Error finding container f1094266401d0162dd02bef8edac3c82f50942d1cf7a8061887cffa1ea6bc589: Status 404 returned error can't find the container with id f1094266401d0162dd02bef8edac3c82f50942d1cf7a8061887cffa1ea6bc589 May 27 18:06:09.430568 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:09.430537 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l"] May 27 18:06:09.434793 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:06:09.434764 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9974d427_4cbe_432f_a43b_8c02392ab616.slice/crio-115803c4e59457c218a417aed246a42ac70bdd44a96f95536ae5bc4b43ca08c3 WatchSource:0}: Error finding container 115803c4e59457c218a417aed246a42ac70bdd44a96f95536ae5bc4b43ca08c3: Status 404 returned error can't find the container with id 115803c4e59457c218a417aed246a42ac70bdd44a96f95536ae5bc4b43ca08c3 May 27 18:06:10.242638 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.242596 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" event={"ID":"9974d427-4cbe-432f-a43b-8c02392ab616","Type":"ContainerStarted","Data":"78aa245c904a50f9b3355fe4802a4909aada4751234126ea93298a7cbce268b0"} May 27 18:06:10.242638 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.242638 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" event={"ID":"9974d427-4cbe-432f-a43b-8c02392ab616","Type":"ContainerStarted","Data":"115803c4e59457c218a417aed246a42ac70bdd44a96f95536ae5bc4b43ca08c3"} May 27 18:06:10.243138 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.242711 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" May 27 18:06:10.249298 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.245079 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:10.250203 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.250176 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" event={"ID":"03c43055-fcfa-4ad6-ac58-c320ff3d573c","Type":"ContainerStarted","Data":"c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546"} May 27 18:06:10.250328 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.250214 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" event={"ID":"03c43055-fcfa-4ad6-ac58-c320ff3d573c","Type":"ContainerStarted","Data":"f1094266401d0162dd02bef8edac3c82f50942d1cf7a8061887cffa1ea6bc589"} May 27 18:06:10.250411 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.250339 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:10.314908 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.314853 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" podStartSLOduration=2.314837541 podStartE2EDuration="2.314837541s" podCreationTimestamp="2026-05-27 18:06:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:06:10.312539402 +0000 UTC m=+488.329749979" watchObservedRunningTime="2026-05-27 18:06:10.314837541 +0000 UTC m=+488.332048117" May 27 18:06:10.315395 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.315368 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:10.320698 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.320669 2576 status_manager.go:895] "Failed to get status for pod" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9sn7x" err="pods \"limitador-operator-controller-manager-85c4996f8c-9sn7x\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:10.358676 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.358631 2576 status_manager.go:895] "Failed to get status for pod" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8nsd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n8nsd\" is forbidden: User \"system:node:ip-10-0-141-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-157.ec2.internal' and this object" May 27 18:06:10.562622 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.562544 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c864fd7-ab3c-4164-9005-f875bbe8a8b4" path="/var/lib/kubelet/pods/0c864fd7-ab3c-4164-9005-f875bbe8a8b4/volumes" May 27 18:06:10.562927 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:10.562914 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4f6cfa9-390a-4f53-b43a-000fb4165db9" path="/var/lib/kubelet/pods/b4f6cfa9-390a-4f53-b43a-000fb4165db9/volumes" May 27 18:06:21.257226 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:21.257195 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rkg4l" May 27 18:06:21.257646 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:21.257315 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:21.279088 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:21.279027 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" podStartSLOduration=13.279008853 podStartE2EDuration="13.279008853s" podCreationTimestamp="2026-05-27 18:06:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:06:10.356261634 +0000 UTC m=+488.373472211" watchObservedRunningTime="2026-05-27 18:06:21.279008853 +0000 UTC m=+499.296219433" May 27 18:06:37.233329 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.233276 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn"] May 27 18:06:37.233797 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.233534 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" podUID="03c43055-fcfa-4ad6-ac58-c320ff3d573c" containerName="manager" containerID="cri-o://c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546" gracePeriod=10 May 27 18:06:37.493180 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.493097 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:37.498392 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.498361 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd"] May 27 18:06:37.498812 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.498798 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c43055-fcfa-4ad6-ac58-c320ff3d573c" containerName="manager" May 27 18:06:37.498860 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.498813 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c43055-fcfa-4ad6-ac58-c320ff3d573c" containerName="manager" May 27 18:06:37.498907 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.498881 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="03c43055-fcfa-4ad6-ac58-c320ff3d573c" containerName="manager" May 27 18:06:37.500780 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.500764 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:37.512812 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.512784 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd"] May 27 18:06:37.528770 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.528740 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03c43055-fcfa-4ad6-ac58-c320ff3d573c-extensions-socket-volume\") pod \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\" (UID: \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\") " May 27 18:06:37.528950 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.528780 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fszg9\" (UniqueName: \"kubernetes.io/projected/03c43055-fcfa-4ad6-ac58-c320ff3d573c-kube-api-access-fszg9\") pod \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\" (UID: \"03c43055-fcfa-4ad6-ac58-c320ff3d573c\") " May 27 18:06:37.529009 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.528979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz597\" (UniqueName: \"kubernetes.io/projected/d5960de7-4642-4104-9348-fbc403087305-kube-api-access-xz597\") pod \"kuadrant-operator-controller-manager-55c7f4c975-khmjd\" (UID: \"d5960de7-4642-4104-9348-fbc403087305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:37.529048 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.529023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5960de7-4642-4104-9348-fbc403087305-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-khmjd\" (UID: \"d5960de7-4642-4104-9348-fbc403087305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:37.529177 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.529145 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03c43055-fcfa-4ad6-ac58-c320ff3d573c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "03c43055-fcfa-4ad6-ac58-c320ff3d573c" (UID: "03c43055-fcfa-4ad6-ac58-c320ff3d573c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:06:37.531429 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.531389 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c43055-fcfa-4ad6-ac58-c320ff3d573c-kube-api-access-fszg9" (OuterVolumeSpecName: "kube-api-access-fszg9") pod "03c43055-fcfa-4ad6-ac58-c320ff3d573c" (UID: "03c43055-fcfa-4ad6-ac58-c320ff3d573c"). InnerVolumeSpecName "kube-api-access-fszg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:06:37.629969 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.629913 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xz597\" (UniqueName: \"kubernetes.io/projected/d5960de7-4642-4104-9348-fbc403087305-kube-api-access-xz597\") pod \"kuadrant-operator-controller-manager-55c7f4c975-khmjd\" (UID: \"d5960de7-4642-4104-9348-fbc403087305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:37.630181 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.629992 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5960de7-4642-4104-9348-fbc403087305-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-khmjd\" (UID: \"d5960de7-4642-4104-9348-fbc403087305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:37.630181 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.630138 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03c43055-fcfa-4ad6-ac58-c320ff3d573c-extensions-socket-volume\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:06:37.630181 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.630156 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fszg9\" (UniqueName: \"kubernetes.io/projected/03c43055-fcfa-4ad6-ac58-c320ff3d573c-kube-api-access-fszg9\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:06:37.630495 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.630472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5960de7-4642-4104-9348-fbc403087305-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-khmjd\" (UID: \"d5960de7-4642-4104-9348-fbc403087305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:37.639167 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.639144 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz597\" (UniqueName: \"kubernetes.io/projected/d5960de7-4642-4104-9348-fbc403087305-kube-api-access-xz597\") pod \"kuadrant-operator-controller-manager-55c7f4c975-khmjd\" (UID: \"d5960de7-4642-4104-9348-fbc403087305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:37.811444 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.811351 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:37.945221 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:37.945194 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd"] May 27 18:06:37.947433 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:06:37.947404 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5960de7_4642_4104_9348_fbc403087305.slice/crio-0d70b9d6fef0b60b2557f0df24562bebc6970564c0382406d728ad7f23a010ef WatchSource:0}: Error finding container 0d70b9d6fef0b60b2557f0df24562bebc6970564c0382406d728ad7f23a010ef: Status 404 returned error can't find the container with id 0d70b9d6fef0b60b2557f0df24562bebc6970564c0382406d728ad7f23a010ef May 27 18:06:38.352992 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.352956 2576 generic.go:358] "Generic (PLEG): container finished" podID="03c43055-fcfa-4ad6-ac58-c320ff3d573c" containerID="c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546" exitCode=0 May 27 18:06:38.353470 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.353017 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" May 27 18:06:38.353470 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.353040 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" event={"ID":"03c43055-fcfa-4ad6-ac58-c320ff3d573c","Type":"ContainerDied","Data":"c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546"} May 27 18:06:38.353470 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.353079 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn" event={"ID":"03c43055-fcfa-4ad6-ac58-c320ff3d573c","Type":"ContainerDied","Data":"f1094266401d0162dd02bef8edac3c82f50942d1cf7a8061887cffa1ea6bc589"} May 27 18:06:38.353470 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.353096 2576 scope.go:117] "RemoveContainer" containerID="c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546" May 27 18:06:38.354662 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.354628 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" event={"ID":"d5960de7-4642-4104-9348-fbc403087305","Type":"ContainerStarted","Data":"91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8"} May 27 18:06:38.354776 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.354671 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" event={"ID":"d5960de7-4642-4104-9348-fbc403087305","Type":"ContainerStarted","Data":"0d70b9d6fef0b60b2557f0df24562bebc6970564c0382406d728ad7f23a010ef"} May 27 18:06:38.354776 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.354747 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:38.362088 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.362072 2576 scope.go:117] "RemoveContainer" containerID="c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546" May 27 18:06:38.362366 ip-10-0-141-157 kubenswrapper[2576]: E0527 18:06:38.362346 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546\": container with ID starting with c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546 not found: ID does not exist" containerID="c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546" May 27 18:06:38.362429 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.362372 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546"} err="failed to get container status \"c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546\": rpc error: code = NotFound desc = could not find container \"c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546\": container with ID starting with c172931ca1ac8630976e64de22b88db19e2f5a0b43cfd5461dd36fbbc8a18546 not found: ID does not exist" May 27 18:06:38.375703 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.375661 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" podStartSLOduration=1.3756472579999999 podStartE2EDuration="1.375647258s" podCreationTimestamp="2026-05-27 18:06:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:06:38.375145635 +0000 UTC m=+516.392356213" watchObservedRunningTime="2026-05-27 18:06:38.375647258 +0000 UTC m=+516.392857837" May 27 18:06:38.389156 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.389122 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn"] May 27 18:06:38.397123 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.397085 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-74jqn"] May 27 18:06:38.562080 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:38.562040 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03c43055-fcfa-4ad6-ac58-c320ff3d573c" path="/var/lib/kubelet/pods/03c43055-fcfa-4ad6-ac58-c320ff3d573c/volumes" May 27 18:06:49.365618 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:49.365525 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:06:59.232416 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:59.232374 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-88wvw"] May 27 18:06:59.235745 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:59.235724 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-88wvw" May 27 18:06:59.238080 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:59.238059 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dxxkf\"" May 27 18:06:59.241531 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:59.241509 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-88wvw"] May 27 18:06:59.327058 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:59.327010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8sw6\" (UniqueName: \"kubernetes.io/projected/a83f2876-01fa-4f60-9651-0f3adbe01c71-kube-api-access-k8sw6\") pod \"authorino-7498df8756-88wvw\" (UID: \"a83f2876-01fa-4f60-9651-0f3adbe01c71\") " pod="kuadrant-system/authorino-7498df8756-88wvw" May 27 18:06:59.428168 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:59.428120 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8sw6\" (UniqueName: \"kubernetes.io/projected/a83f2876-01fa-4f60-9651-0f3adbe01c71-kube-api-access-k8sw6\") pod \"authorino-7498df8756-88wvw\" (UID: \"a83f2876-01fa-4f60-9651-0f3adbe01c71\") " pod="kuadrant-system/authorino-7498df8756-88wvw" May 27 18:06:59.436760 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:59.436726 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8sw6\" (UniqueName: \"kubernetes.io/projected/a83f2876-01fa-4f60-9651-0f3adbe01c71-kube-api-access-k8sw6\") pod \"authorino-7498df8756-88wvw\" (UID: \"a83f2876-01fa-4f60-9651-0f3adbe01c71\") " pod="kuadrant-system/authorino-7498df8756-88wvw" May 27 18:06:59.546071 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:59.545972 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-88wvw" May 27 18:06:59.696906 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:06:59.696838 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-88wvw"] May 27 18:06:59.699339 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:06:59.699308 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda83f2876_01fa_4f60_9651_0f3adbe01c71.slice/crio-6e55d8fb6c6b35037d8f5f0a5c4ee11e264484f0da82ee3c7355578481eadc9b WatchSource:0}: Error finding container 6e55d8fb6c6b35037d8f5f0a5c4ee11e264484f0da82ee3c7355578481eadc9b: Status 404 returned error can't find the container with id 6e55d8fb6c6b35037d8f5f0a5c4ee11e264484f0da82ee3c7355578481eadc9b May 27 18:07:00.443411 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:00.443371 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-88wvw" event={"ID":"a83f2876-01fa-4f60-9651-0f3adbe01c71","Type":"ContainerStarted","Data":"6e55d8fb6c6b35037d8f5f0a5c4ee11e264484f0da82ee3c7355578481eadc9b"} May 27 18:07:03.458088 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:03.458049 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-88wvw" event={"ID":"a83f2876-01fa-4f60-9651-0f3adbe01c71","Type":"ContainerStarted","Data":"ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a"} May 27 18:07:03.471011 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:03.470942 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-88wvw" podStartSLOduration=1.425108011 podStartE2EDuration="4.470927139s" podCreationTimestamp="2026-05-27 18:06:59 +0000 UTC" firstStartedPulling="2026-05-27 18:06:59.700693808 +0000 UTC m=+537.717904363" lastFinishedPulling="2026-05-27 18:07:02.746512931 +0000 UTC m=+540.763723491" observedRunningTime="2026-05-27 18:07:03.470775178 +0000 UTC m=+541.487985757" watchObservedRunningTime="2026-05-27 18:07:03.470927139 +0000 UTC m=+541.488137722" May 27 18:07:29.464792 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:29.464751 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-88wvw"] May 27 18:07:29.465350 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:29.464967 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-88wvw" podUID="a83f2876-01fa-4f60-9651-0f3adbe01c71" containerName="authorino" containerID="cri-o://ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a" gracePeriod=30 May 27 18:07:29.712514 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:29.712488 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-88wvw" May 27 18:07:29.788707 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:29.788609 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8sw6\" (UniqueName: \"kubernetes.io/projected/a83f2876-01fa-4f60-9651-0f3adbe01c71-kube-api-access-k8sw6\") pod \"a83f2876-01fa-4f60-9651-0f3adbe01c71\" (UID: \"a83f2876-01fa-4f60-9651-0f3adbe01c71\") " May 27 18:07:29.790743 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:29.790716 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a83f2876-01fa-4f60-9651-0f3adbe01c71-kube-api-access-k8sw6" (OuterVolumeSpecName: "kube-api-access-k8sw6") pod "a83f2876-01fa-4f60-9651-0f3adbe01c71" (UID: "a83f2876-01fa-4f60-9651-0f3adbe01c71"). InnerVolumeSpecName "kube-api-access-k8sw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:07:29.889679 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:29.889637 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8sw6\" (UniqueName: \"kubernetes.io/projected/a83f2876-01fa-4f60-9651-0f3adbe01c71-kube-api-access-k8sw6\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:07:30.555240 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:30.555200 2576 generic.go:358] "Generic (PLEG): container finished" podID="a83f2876-01fa-4f60-9651-0f3adbe01c71" containerID="ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a" exitCode=0 May 27 18:07:30.555702 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:30.555251 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-88wvw" May 27 18:07:30.555702 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:30.555262 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-88wvw" event={"ID":"a83f2876-01fa-4f60-9651-0f3adbe01c71","Type":"ContainerDied","Data":"ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a"} May 27 18:07:30.555702 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:30.555315 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-88wvw" event={"ID":"a83f2876-01fa-4f60-9651-0f3adbe01c71","Type":"ContainerDied","Data":"6e55d8fb6c6b35037d8f5f0a5c4ee11e264484f0da82ee3c7355578481eadc9b"} May 27 18:07:30.555702 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:30.555335 2576 scope.go:117] "RemoveContainer" containerID="ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a" May 27 18:07:30.563818 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:30.563795 2576 scope.go:117] "RemoveContainer" containerID="ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a" May 27 18:07:30.564158 ip-10-0-141-157 kubenswrapper[2576]: E0527 18:07:30.564130 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a\": container with ID starting with ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a not found: ID does not exist" containerID="ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a" May 27 18:07:30.564264 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:30.564166 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a"} err="failed to get container status \"ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a\": rpc error: code = NotFound desc = could not find container \"ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a\": container with ID starting with ab729ca1f0f76ad05d54c0d93b5e0933fd88112f468140566aaf2e012f5cb01a not found: ID does not exist" May 27 18:07:30.577103 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:30.577070 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-88wvw"] May 27 18:07:30.578815 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:30.578791 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-88wvw"] May 27 18:07:32.465655 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.465618 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-766d766d75-6dltc"] May 27 18:07:32.466044 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.465988 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a83f2876-01fa-4f60-9651-0f3adbe01c71" containerName="authorino" May 27 18:07:32.466044 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.465998 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a83f2876-01fa-4f60-9651-0f3adbe01c71" containerName="authorino" May 27 18:07:32.466116 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.466059 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="a83f2876-01fa-4f60-9651-0f3adbe01c71" containerName="authorino" May 27 18:07:32.468745 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.468716 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766d766d75-6dltc" May 27 18:07:32.471487 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.471465 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 27 18:07:32.471600 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.471465 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bgcgr\"" May 27 18:07:32.488071 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.483313 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-766d766d75-6dltc"] May 27 18:07:32.513642 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.513602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np2zt\" (UniqueName: \"kubernetes.io/projected/e7a1acf0-d958-485b-9b54-184fd84f7aed-kube-api-access-np2zt\") pod \"maas-controller-766d766d75-6dltc\" (UID: \"e7a1acf0-d958-485b-9b54-184fd84f7aed\") " pod="opendatahub/maas-controller-766d766d75-6dltc" May 27 18:07:32.561499 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.561466 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a83f2876-01fa-4f60-9651-0f3adbe01c71" path="/var/lib/kubelet/pods/a83f2876-01fa-4f60-9651-0f3adbe01c71/volumes" May 27 18:07:32.608018 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.607980 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7ccc8cdf45-8cc6c"] May 27 18:07:32.610355 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.610336 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" May 27 18:07:32.614185 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.614167 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-np2zt\" (UniqueName: \"kubernetes.io/projected/e7a1acf0-d958-485b-9b54-184fd84f7aed-kube-api-access-np2zt\") pod \"maas-controller-766d766d75-6dltc\" (UID: \"e7a1acf0-d958-485b-9b54-184fd84f7aed\") " pod="opendatahub/maas-controller-766d766d75-6dltc" May 27 18:07:32.620742 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.620716 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ccc8cdf45-8cc6c"] May 27 18:07:32.623457 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.623436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np2zt\" (UniqueName: \"kubernetes.io/projected/e7a1acf0-d958-485b-9b54-184fd84f7aed-kube-api-access-np2zt\") pod \"maas-controller-766d766d75-6dltc\" (UID: \"e7a1acf0-d958-485b-9b54-184fd84f7aed\") " pod="opendatahub/maas-controller-766d766d75-6dltc" May 27 18:07:32.714756 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.714718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjftt\" (UniqueName: \"kubernetes.io/projected/aaaf8ac0-5939-4922-8c67-438356bebb3c-kube-api-access-hjftt\") pod \"maas-controller-7ccc8cdf45-8cc6c\" (UID: \"aaaf8ac0-5939-4922-8c67-438356bebb3c\") " pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" May 27 18:07:32.778637 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.778562 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766d766d75-6dltc" May 27 18:07:32.815812 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.815773 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjftt\" (UniqueName: \"kubernetes.io/projected/aaaf8ac0-5939-4922-8c67-438356bebb3c-kube-api-access-hjftt\") pod \"maas-controller-7ccc8cdf45-8cc6c\" (UID: \"aaaf8ac0-5939-4922-8c67-438356bebb3c\") " pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" May 27 18:07:32.825764 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.825732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjftt\" (UniqueName: \"kubernetes.io/projected/aaaf8ac0-5939-4922-8c67-438356bebb3c-kube-api-access-hjftt\") pod \"maas-controller-7ccc8cdf45-8cc6c\" (UID: \"aaaf8ac0-5939-4922-8c67-438356bebb3c\") " pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" May 27 18:07:32.917225 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.917198 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-766d766d75-6dltc"] May 27 18:07:32.919875 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:07:32.919844 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a1acf0_d958_485b_9b54_184fd84f7aed.slice/crio-a6882d04529b467e7e250b69381a21a922b48b428d609c2e17793d090e47ed30 WatchSource:0}: Error finding container a6882d04529b467e7e250b69381a21a922b48b428d609c2e17793d090e47ed30: Status 404 returned error can't find the container with id a6882d04529b467e7e250b69381a21a922b48b428d609c2e17793d090e47ed30 May 27 18:07:32.920657 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:32.920637 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" May 27 18:07:33.057935 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:33.057907 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ccc8cdf45-8cc6c"] May 27 18:07:33.060634 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:07:33.060609 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaaf8ac0_5939_4922_8c67_438356bebb3c.slice/crio-440f90b9c2c1c4cc92364a7bfbe0cbee6641c6d945631746445c0e6d3b3f3fd9 WatchSource:0}: Error finding container 440f90b9c2c1c4cc92364a7bfbe0cbee6641c6d945631746445c0e6d3b3f3fd9: Status 404 returned error can't find the container with id 440f90b9c2c1c4cc92364a7bfbe0cbee6641c6d945631746445c0e6d3b3f3fd9 May 27 18:07:33.571671 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:33.571632 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" event={"ID":"aaaf8ac0-5939-4922-8c67-438356bebb3c","Type":"ContainerStarted","Data":"440f90b9c2c1c4cc92364a7bfbe0cbee6641c6d945631746445c0e6d3b3f3fd9"} May 27 18:07:33.574043 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:33.574008 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766d766d75-6dltc" event={"ID":"e7a1acf0-d958-485b-9b54-184fd84f7aed","Type":"ContainerStarted","Data":"a6882d04529b467e7e250b69381a21a922b48b428d609c2e17793d090e47ed30"} May 27 18:07:36.587659 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:36.587620 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766d766d75-6dltc" event={"ID":"e7a1acf0-d958-485b-9b54-184fd84f7aed","Type":"ContainerStarted","Data":"f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023"} May 27 18:07:36.587659 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:36.587669 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-766d766d75-6dltc" May 27 18:07:36.588928 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:36.588903 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" event={"ID":"aaaf8ac0-5939-4922-8c67-438356bebb3c","Type":"ContainerStarted","Data":"443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b"} May 27 18:07:36.589037 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:36.589027 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" May 27 18:07:36.602672 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:36.602622 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-766d766d75-6dltc" podStartSLOduration=1.996588241 podStartE2EDuration="4.602607031s" podCreationTimestamp="2026-05-27 18:07:32 +0000 UTC" firstStartedPulling="2026-05-27 18:07:32.921197048 +0000 UTC m=+570.938407605" lastFinishedPulling="2026-05-27 18:07:35.527215836 +0000 UTC m=+573.544426395" observedRunningTime="2026-05-27 18:07:36.600999729 +0000 UTC m=+574.618210305" watchObservedRunningTime="2026-05-27 18:07:36.602607031 +0000 UTC m=+574.619817608" May 27 18:07:36.614256 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:36.614207 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" podStartSLOduration=2.153273096 podStartE2EDuration="4.614191285s" podCreationTimestamp="2026-05-27 18:07:32 +0000 UTC" firstStartedPulling="2026-05-27 18:07:33.062479857 +0000 UTC m=+571.079690413" lastFinishedPulling="2026-05-27 18:07:35.523398047 +0000 UTC m=+573.540608602" observedRunningTime="2026-05-27 18:07:36.613709851 +0000 UTC m=+574.630920429" watchObservedRunningTime="2026-05-27 18:07:36.614191285 +0000 UTC m=+574.631401862" May 27 18:07:47.597784 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:47.597750 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" May 27 18:07:47.598156 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:47.597807 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-766d766d75-6dltc" May 27 18:07:47.697142 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:47.697107 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-766d766d75-6dltc"] May 27 18:07:47.697453 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:47.697404 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-766d766d75-6dltc" podUID="e7a1acf0-d958-485b-9b54-184fd84f7aed" containerName="manager" containerID="cri-o://f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023" gracePeriod=30 May 27 18:07:47.944820 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:47.944794 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766d766d75-6dltc" May 27 18:07:48.057274 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.057235 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np2zt\" (UniqueName: \"kubernetes.io/projected/e7a1acf0-d958-485b-9b54-184fd84f7aed-kube-api-access-np2zt\") pod \"e7a1acf0-d958-485b-9b54-184fd84f7aed\" (UID: \"e7a1acf0-d958-485b-9b54-184fd84f7aed\") " May 27 18:07:48.059459 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.059433 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a1acf0-d958-485b-9b54-184fd84f7aed-kube-api-access-np2zt" (OuterVolumeSpecName: "kube-api-access-np2zt") pod "e7a1acf0-d958-485b-9b54-184fd84f7aed" (UID: "e7a1acf0-d958-485b-9b54-184fd84f7aed"). InnerVolumeSpecName "kube-api-access-np2zt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:07:48.158859 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.158817 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np2zt\" (UniqueName: \"kubernetes.io/projected/e7a1acf0-d958-485b-9b54-184fd84f7aed-kube-api-access-np2zt\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:07:48.634497 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.634460 2576 generic.go:358] "Generic (PLEG): container finished" podID="e7a1acf0-d958-485b-9b54-184fd84f7aed" containerID="f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023" exitCode=0 May 27 18:07:48.634910 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.634502 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766d766d75-6dltc" event={"ID":"e7a1acf0-d958-485b-9b54-184fd84f7aed","Type":"ContainerDied","Data":"f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023"} May 27 18:07:48.634910 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.634527 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766d766d75-6dltc" May 27 18:07:48.634910 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.634542 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766d766d75-6dltc" event={"ID":"e7a1acf0-d958-485b-9b54-184fd84f7aed","Type":"ContainerDied","Data":"a6882d04529b467e7e250b69381a21a922b48b428d609c2e17793d090e47ed30"} May 27 18:07:48.634910 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.634557 2576 scope.go:117] "RemoveContainer" containerID="f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023" May 27 18:07:48.643385 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.643365 2576 scope.go:117] "RemoveContainer" containerID="f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023" May 27 18:07:48.643653 ip-10-0-141-157 kubenswrapper[2576]: E0527 18:07:48.643635 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023\": container with ID starting with f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023 not found: ID does not exist" containerID="f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023" May 27 18:07:48.643698 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.643663 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023"} err="failed to get container status \"f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023\": rpc error: code = NotFound desc = could not find container \"f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023\": container with ID starting with f22e2d81715da36a065b94c6c818401a9591383f49ee9a5af7c8279c28995023 not found: ID does not exist" May 27 18:07:48.651957 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.651932 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-766d766d75-6dltc"] May 27 18:07:48.655754 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:48.655729 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-766d766d75-6dltc"] May 27 18:07:50.564576 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:07:50.564539 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7a1acf0-d958-485b-9b54-184fd84f7aed" path="/var/lib/kubelet/pods/e7a1acf0-d958-485b-9b54-184fd84f7aed/volumes" May 27 18:08:02.529124 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:02.529092 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:08:02.529689 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:02.529246 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:08:05.652133 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.652100 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7fb874bb78-rxr9c"] May 27 18:08:05.652686 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.652665 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7a1acf0-d958-485b-9b54-184fd84f7aed" containerName="manager" May 27 18:08:05.652768 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.652689 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7a1acf0-d958-485b-9b54-184fd84f7aed" containerName="manager" May 27 18:08:05.652831 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.652817 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7a1acf0-d958-485b-9b54-184fd84f7aed" containerName="manager" May 27 18:08:05.656475 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.656454 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:05.659376 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.659355 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 27 18:08:05.659531 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.659513 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-brqj4\"" May 27 18:08:05.668754 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.668729 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7fb874bb78-rxr9c"] May 27 18:08:05.823085 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.823050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7rwn\" (UniqueName: \"kubernetes.io/projected/1c9f5715-49dd-47e9-a3cf-b8a172f7f86f-kube-api-access-c7rwn\") pod \"maas-api-7fb874bb78-rxr9c\" (UID: \"1c9f5715-49dd-47e9-a3cf-b8a172f7f86f\") " pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:05.823271 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.823109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c9f5715-49dd-47e9-a3cf-b8a172f7f86f-maas-api-tls\") pod \"maas-api-7fb874bb78-rxr9c\" (UID: \"1c9f5715-49dd-47e9-a3cf-b8a172f7f86f\") " pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:05.924422 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.924317 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7rwn\" (UniqueName: \"kubernetes.io/projected/1c9f5715-49dd-47e9-a3cf-b8a172f7f86f-kube-api-access-c7rwn\") pod \"maas-api-7fb874bb78-rxr9c\" (UID: \"1c9f5715-49dd-47e9-a3cf-b8a172f7f86f\") " pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:05.924422 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.924399 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c9f5715-49dd-47e9-a3cf-b8a172f7f86f-maas-api-tls\") pod \"maas-api-7fb874bb78-rxr9c\" (UID: \"1c9f5715-49dd-47e9-a3cf-b8a172f7f86f\") " pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:05.926917 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.926890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c9f5715-49dd-47e9-a3cf-b8a172f7f86f-maas-api-tls\") pod \"maas-api-7fb874bb78-rxr9c\" (UID: \"1c9f5715-49dd-47e9-a3cf-b8a172f7f86f\") " pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:05.940826 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.940794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7rwn\" (UniqueName: \"kubernetes.io/projected/1c9f5715-49dd-47e9-a3cf-b8a172f7f86f-kube-api-access-c7rwn\") pod \"maas-api-7fb874bb78-rxr9c\" (UID: \"1c9f5715-49dd-47e9-a3cf-b8a172f7f86f\") " pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:05.969895 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:05.969853 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:06.064267 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.064230 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rsc8k"] May 27 18:08:06.093521 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.093474 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rsc8k"] May 27 18:08:06.093684 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.093622 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" May 27 18:08:06.096522 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.096493 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 27 18:08:06.132161 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.132130 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7fb874bb78-rxr9c"] May 27 18:08:06.134326 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:08:06.134260 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9f5715_49dd_47e9_a3cf_b8a172f7f86f.slice/crio-8fe9e39076caab7d2b03f5a2aef14444377b08ff37f47a0cc3d82d072635e865 WatchSource:0}: Error finding container 8fe9e39076caab7d2b03f5a2aef14444377b08ff37f47a0cc3d82d072635e865: Status 404 returned error can't find the container with id 8fe9e39076caab7d2b03f5a2aef14444377b08ff37f47a0cc3d82d072635e865 May 27 18:08:06.229057 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.228945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwjrr\" (UniqueName: \"kubernetes.io/projected/2785f288-134b-44ee-87fb-d64b2774b9a2-kube-api-access-xwjrr\") pod \"payload-processing-58b6c8fdc7-rsc8k\" (UID: \"2785f288-134b-44ee-87fb-d64b2774b9a2\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" May 27 18:08:06.330092 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.330057 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjrr\" (UniqueName: \"kubernetes.io/projected/2785f288-134b-44ee-87fb-d64b2774b9a2-kube-api-access-xwjrr\") pod \"payload-processing-58b6c8fdc7-rsc8k\" (UID: \"2785f288-134b-44ee-87fb-d64b2774b9a2\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" May 27 18:08:06.338335 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.338299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwjrr\" (UniqueName: \"kubernetes.io/projected/2785f288-134b-44ee-87fb-d64b2774b9a2-kube-api-access-xwjrr\") pod \"payload-processing-58b6c8fdc7-rsc8k\" (UID: \"2785f288-134b-44ee-87fb-d64b2774b9a2\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" May 27 18:08:06.408160 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.408127 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" May 27 18:08:06.568485 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.568430 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rsc8k"] May 27 18:08:06.570565 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:08:06.570466 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2785f288_134b_44ee_87fb_d64b2774b9a2.slice/crio-f4ca568967107bfd490872e9b7681fe74844a07c9632e40de7c60d21d4e9229b WatchSource:0}: Error finding container f4ca568967107bfd490872e9b7681fe74844a07c9632e40de7c60d21d4e9229b: Status 404 returned error can't find the container with id f4ca568967107bfd490872e9b7681fe74844a07c9632e40de7c60d21d4e9229b May 27 18:08:06.700525 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.700483 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7fb874bb78-rxr9c" event={"ID":"1c9f5715-49dd-47e9-a3cf-b8a172f7f86f","Type":"ContainerStarted","Data":"8fe9e39076caab7d2b03f5a2aef14444377b08ff37f47a0cc3d82d072635e865"} May 27 18:08:06.701948 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:06.701920 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" event={"ID":"2785f288-134b-44ee-87fb-d64b2774b9a2","Type":"ContainerStarted","Data":"f4ca568967107bfd490872e9b7681fe74844a07c9632e40de7c60d21d4e9229b"} May 27 18:08:09.718891 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:09.718789 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7fb874bb78-rxr9c" event={"ID":"1c9f5715-49dd-47e9-a3cf-b8a172f7f86f","Type":"ContainerStarted","Data":"ac14c29336f94841bec7f37722d5eb2a3ba58ce464cf9a4ed9aaa1b6bd85cd1b"} May 27 18:08:09.719279 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:09.718987 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:09.720190 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:09.720161 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" event={"ID":"2785f288-134b-44ee-87fb-d64b2774b9a2","Type":"ContainerStarted","Data":"c72dfff409d3b6f0218577d2f2663d62e12f88dbfd656b9e20693509c173d02d"} May 27 18:08:09.720328 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:09.720295 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" May 27 18:08:09.735050 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:09.734999 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7fb874bb78-rxr9c" podStartSLOduration=1.400359232 podStartE2EDuration="4.734985124s" podCreationTimestamp="2026-05-27 18:08:05 +0000 UTC" firstStartedPulling="2026-05-27 18:08:06.136058054 +0000 UTC m=+604.153268609" lastFinishedPulling="2026-05-27 18:08:09.470683937 +0000 UTC m=+607.487894501" observedRunningTime="2026-05-27 18:08:09.733634267 +0000 UTC m=+607.750844844" watchObservedRunningTime="2026-05-27 18:08:09.734985124 +0000 UTC m=+607.752195721" May 27 18:08:09.750724 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:09.750650 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" podStartSLOduration=0.843159385 podStartE2EDuration="3.750630864s" podCreationTimestamp="2026-05-27 18:08:06 +0000 UTC" firstStartedPulling="2026-05-27 18:08:06.572378467 +0000 UTC m=+604.589589022" lastFinishedPulling="2026-05-27 18:08:09.479849938 +0000 UTC m=+607.497060501" observedRunningTime="2026-05-27 18:08:09.747844388 +0000 UTC m=+607.765054966" watchObservedRunningTime="2026-05-27 18:08:09.750630864 +0000 UTC m=+607.767841439" May 27 18:08:15.729157 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:15.729071 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7fb874bb78-rxr9c" May 27 18:08:20.726390 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:20.726358 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-rsc8k" May 27 18:08:33.797752 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.797719 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs"] May 27 18:08:33.800092 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.800068 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.804575 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.804544 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 18:08:33.804745 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.804723 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 18:08:33.804817 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.804756 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 27 18:08:33.805038 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.805019 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-72bcn\"" May 27 18:08:33.811188 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.811161 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs"] May 27 18:08:33.887319 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.887243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15bdd194-91c8-4504-82fc-d9b292aa8262-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.887319 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.887324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.887549 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.887359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.887549 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.887487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.887549 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.887545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.887663 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.887567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd72l\" (UniqueName: \"kubernetes.io/projected/15bdd194-91c8-4504-82fc-d9b292aa8262-kube-api-access-nd72l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.988549 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.988506 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.988766 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.988581 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.988766 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.988635 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.988766 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.988660 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nd72l\" (UniqueName: \"kubernetes.io/projected/15bdd194-91c8-4504-82fc-d9b292aa8262-kube-api-access-nd72l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.988766 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.988739 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15bdd194-91c8-4504-82fc-d9b292aa8262-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.988766 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.988763 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.989150 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.989121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.989240 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.989166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.989240 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.989174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.990850 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.990827 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15bdd194-91c8-4504-82fc-d9b292aa8262-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:33.991261 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:33.991241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15bdd194-91c8-4504-82fc-d9b292aa8262-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:34.000496 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:34.000466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd72l\" (UniqueName: \"kubernetes.io/projected/15bdd194-91c8-4504-82fc-d9b292aa8262-kube-api-access-nd72l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs\" (UID: \"15bdd194-91c8-4504-82fc-d9b292aa8262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:34.112720 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:34.112625 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:34.254809 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:08:34.254779 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15bdd194_91c8_4504_82fc_d9b292aa8262.slice/crio-b57e135ea7734673f7d0a1f355bb4de253439edebc1ca83e2d30bc931323d0e2 WatchSource:0}: Error finding container b57e135ea7734673f7d0a1f355bb4de253439edebc1ca83e2d30bc931323d0e2: Status 404 returned error can't find the container with id b57e135ea7734673f7d0a1f355bb4de253439edebc1ca83e2d30bc931323d0e2 May 27 18:08:34.256765 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:34.256744 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:08:34.257552 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:34.257527 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs"] May 27 18:08:34.814921 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:34.814882 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" event={"ID":"15bdd194-91c8-4504-82fc-d9b292aa8262","Type":"ContainerStarted","Data":"b57e135ea7734673f7d0a1f355bb4de253439edebc1ca83e2d30bc931323d0e2"} May 27 18:08:41.842589 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:41.842550 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" event={"ID":"15bdd194-91c8-4504-82fc-d9b292aa8262","Type":"ContainerStarted","Data":"8cfcbbf7e569f48e4d32d77590b402c37b05db9d435e7fa09e5c9d8c1e1f7a07"} May 27 18:08:47.865377 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:47.865334 2576 generic.go:358] "Generic (PLEG): container finished" podID="15bdd194-91c8-4504-82fc-d9b292aa8262" containerID="8cfcbbf7e569f48e4d32d77590b402c37b05db9d435e7fa09e5c9d8c1e1f7a07" exitCode=0 May 27 18:08:47.865803 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:47.865403 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" event={"ID":"15bdd194-91c8-4504-82fc-d9b292aa8262","Type":"ContainerDied","Data":"8cfcbbf7e569f48e4d32d77590b402c37b05db9d435e7fa09e5c9d8c1e1f7a07"} May 27 18:08:49.875572 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:49.875534 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" event={"ID":"15bdd194-91c8-4504-82fc-d9b292aa8262","Type":"ContainerStarted","Data":"07fd0bd87697516b1fbb51eff0b679dbb4b4e025495f36cccb6b9d5b7df532c2"} May 27 18:08:49.876043 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:49.875759 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:08:49.919084 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:49.919029 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" podStartSLOduration=2.052931923 podStartE2EDuration="16.919015887s" podCreationTimestamp="2026-05-27 18:08:33 +0000 UTC" firstStartedPulling="2026-05-27 18:08:34.256941247 +0000 UTC m=+632.274151803" lastFinishedPulling="2026-05-27 18:08:49.123025211 +0000 UTC m=+647.140235767" observedRunningTime="2026-05-27 18:08:49.918301839 +0000 UTC m=+647.935512410" watchObservedRunningTime="2026-05-27 18:08:49.919015887 +0000 UTC m=+647.936226463" May 27 18:08:52.482961 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.482927 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s"] May 27 18:08:52.485561 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.485543 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.493893 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.493868 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 27 18:08:52.509742 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.509711 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s"] May 27 18:08:52.570536 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.570491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.570720 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.570563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.570720 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.570671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39d9e35f-b453-4594-8f2d-39fea1bed3e3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.570834 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.570725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.570834 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.570783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.570955 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.570888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6v9\" (UniqueName: \"kubernetes.io/projected/39d9e35f-b453-4594-8f2d-39fea1bed3e3-kube-api-access-6h6v9\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.671529 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.671476 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.671744 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.671547 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39d9e35f-b453-4594-8f2d-39fea1bed3e3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.671744 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.671589 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.671744 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.671625 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.671744 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.671667 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6v9\" (UniqueName: \"kubernetes.io/projected/39d9e35f-b453-4594-8f2d-39fea1bed3e3-kube-api-access-6h6v9\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.671744 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.671711 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.672108 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.672078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.672108 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.672105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.672268 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.672177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.674369 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.674348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39d9e35f-b453-4594-8f2d-39fea1bed3e3-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.674625 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.674604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39d9e35f-b453-4594-8f2d-39fea1bed3e3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.686954 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.686922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6v9\" (UniqueName: \"kubernetes.io/projected/39d9e35f-b453-4594-8f2d-39fea1bed3e3-kube-api-access-6h6v9\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s\" (UID: \"39d9e35f-b453-4594-8f2d-39fea1bed3e3\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.798148 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.798054 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:52.937235 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:08:52.937199 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d9e35f_b453_4594_8f2d_39fea1bed3e3.slice/crio-789a7c251479c96dac7781a6708d6cd525063181afc1c2513a5c5794dcf071ca WatchSource:0}: Error finding container 789a7c251479c96dac7781a6708d6cd525063181afc1c2513a5c5794dcf071ca: Status 404 returned error can't find the container with id 789a7c251479c96dac7781a6708d6cd525063181afc1c2513a5c5794dcf071ca May 27 18:08:52.940785 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:52.940764 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s"] May 27 18:08:53.892960 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:53.892920 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" event={"ID":"39d9e35f-b453-4594-8f2d-39fea1bed3e3","Type":"ContainerStarted","Data":"73662c73a230b08f1a04db5ba76a34f169bd53c9e0e6ff530aff70fb04f06d74"} May 27 18:08:53.893373 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:53.892970 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" event={"ID":"39d9e35f-b453-4594-8f2d-39fea1bed3e3","Type":"ContainerStarted","Data":"789a7c251479c96dac7781a6708d6cd525063181afc1c2513a5c5794dcf071ca"} May 27 18:08:58.911691 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:58.911654 2576 generic.go:358] "Generic (PLEG): container finished" podID="39d9e35f-b453-4594-8f2d-39fea1bed3e3" containerID="73662c73a230b08f1a04db5ba76a34f169bd53c9e0e6ff530aff70fb04f06d74" exitCode=0 May 27 18:08:58.912171 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:58.911689 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" event={"ID":"39d9e35f-b453-4594-8f2d-39fea1bed3e3","Type":"ContainerDied","Data":"73662c73a230b08f1a04db5ba76a34f169bd53c9e0e6ff530aff70fb04f06d74"} May 27 18:08:59.917274 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:59.917241 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" event={"ID":"39d9e35f-b453-4594-8f2d-39fea1bed3e3","Type":"ContainerStarted","Data":"939b44fc485b3d2a0e2e2e6c42c570b68562af7bf3d7f5a9cfd610c874dcca57"} May 27 18:08:59.917762 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:59.917485 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:08:59.964884 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:08:59.964822 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" podStartSLOduration=7.683569981 podStartE2EDuration="7.964808357s" podCreationTimestamp="2026-05-27 18:08:52 +0000 UTC" firstStartedPulling="2026-05-27 18:08:58.912424148 +0000 UTC m=+656.929634706" lastFinishedPulling="2026-05-27 18:08:59.193662522 +0000 UTC m=+657.210873082" observedRunningTime="2026-05-27 18:08:59.957382392 +0000 UTC m=+657.974592968" watchObservedRunningTime="2026-05-27 18:08:59.964808357 +0000 UTC m=+657.982018996" May 27 18:09:00.892838 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:00.892802 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs" May 27 18:09:10.934361 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:10.934327 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s" May 27 18:09:32.372787 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.372745 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4"] May 27 18:09:32.377202 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.377162 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.379798 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.379773 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 27 18:09:32.387399 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.387372 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4"] May 27 18:09:32.444558 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.444523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.444558 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.444559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76qqd\" (UniqueName: \"kubernetes.io/projected/15150c57-efcc-4278-9f3f-3c38ca40db8f-kube-api-access-76qqd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.444783 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.444588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.444783 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.444673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.444783 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.444706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15150c57-efcc-4278-9f3f-3c38ca40db8f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.444783 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.444753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.545902 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.545849 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.546098 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.545950 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.546098 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.545982 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76qqd\" (UniqueName: \"kubernetes.io/projected/15150c57-efcc-4278-9f3f-3c38ca40db8f-kube-api-access-76qqd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.546098 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.546017 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.546264 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.546106 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.546264 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.546155 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15150c57-efcc-4278-9f3f-3c38ca40db8f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.546417 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.546348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.546417 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.546369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.546486 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.546436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.548567 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.548540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15150c57-efcc-4278-9f3f-3c38ca40db8f-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.548677 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.548667 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15150c57-efcc-4278-9f3f-3c38ca40db8f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.553833 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.553809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76qqd\" (UniqueName: \"kubernetes.io/projected/15150c57-efcc-4278-9f3f-3c38ca40db8f-kube-api-access-76qqd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4\" (UID: \"15150c57-efcc-4278-9f3f-3c38ca40db8f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.688901 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.688872 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:32.825338 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:32.824918 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4"] May 27 18:09:32.827596 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:09:32.827569 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15150c57_efcc_4278_9f3f_3c38ca40db8f.slice/crio-d14380f6fef266a3c6559c6070d386a2cc2a2f9ab3723decf254d11ecbbf4b40 WatchSource:0}: Error finding container d14380f6fef266a3c6559c6070d386a2cc2a2f9ab3723decf254d11ecbbf4b40: Status 404 returned error can't find the container with id d14380f6fef266a3c6559c6070d386a2cc2a2f9ab3723decf254d11ecbbf4b40 May 27 18:09:33.039618 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:33.039514 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" event={"ID":"15150c57-efcc-4278-9f3f-3c38ca40db8f","Type":"ContainerStarted","Data":"893c6bd1616d7d07dfcc8e2701cbc16dcdb923c71f5c495a27783ee09df8ff19"} May 27 18:09:33.039618 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:33.039550 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" event={"ID":"15150c57-efcc-4278-9f3f-3c38ca40db8f","Type":"ContainerStarted","Data":"d14380f6fef266a3c6559c6070d386a2cc2a2f9ab3723decf254d11ecbbf4b40"} May 27 18:09:42.077422 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:42.077378 2576 generic.go:358] "Generic (PLEG): container finished" podID="15150c57-efcc-4278-9f3f-3c38ca40db8f" containerID="893c6bd1616d7d07dfcc8e2701cbc16dcdb923c71f5c495a27783ee09df8ff19" exitCode=0 May 27 18:09:42.077873 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:42.077447 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" event={"ID":"15150c57-efcc-4278-9f3f-3c38ca40db8f","Type":"ContainerDied","Data":"893c6bd1616d7d07dfcc8e2701cbc16dcdb923c71f5c495a27783ee09df8ff19"} May 27 18:09:43.083201 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:43.083165 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" event={"ID":"15150c57-efcc-4278-9f3f-3c38ca40db8f","Type":"ContainerStarted","Data":"7aa9aa9591ec764550cc2a4e3cb9efb5ba3126f1b19443b5fdf1029d4c6b0fa7"} May 27 18:09:43.083647 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:43.083378 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:09:43.102295 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:43.102233 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" podStartSLOduration=10.848051314 podStartE2EDuration="11.102212464s" podCreationTimestamp="2026-05-27 18:09:32 +0000 UTC" firstStartedPulling="2026-05-27 18:09:42.078177156 +0000 UTC m=+700.095387712" lastFinishedPulling="2026-05-27 18:09:42.332338303 +0000 UTC m=+700.349548862" observedRunningTime="2026-05-27 18:09:43.100698131 +0000 UTC m=+701.117908709" watchObservedRunningTime="2026-05-27 18:09:43.102212464 +0000 UTC m=+701.119423043" May 27 18:09:54.099356 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:09:54.099246 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4" May 27 18:12:04.060855 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.060809 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ccc8cdf45-8cc6c"] May 27 18:12:04.061406 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.061065 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" podUID="aaaf8ac0-5939-4922-8c67-438356bebb3c" containerName="manager" containerID="cri-o://443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b" gracePeriod=30 May 27 18:12:04.316394 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.313964 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" May 27 18:12:04.368599 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.368565 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjftt\" (UniqueName: \"kubernetes.io/projected/aaaf8ac0-5939-4922-8c67-438356bebb3c-kube-api-access-hjftt\") pod \"aaaf8ac0-5939-4922-8c67-438356bebb3c\" (UID: \"aaaf8ac0-5939-4922-8c67-438356bebb3c\") " May 27 18:12:04.370780 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.370743 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaaf8ac0-5939-4922-8c67-438356bebb3c-kube-api-access-hjftt" (OuterVolumeSpecName: "kube-api-access-hjftt") pod "aaaf8ac0-5939-4922-8c67-438356bebb3c" (UID: "aaaf8ac0-5939-4922-8c67-438356bebb3c"). InnerVolumeSpecName "kube-api-access-hjftt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:12:04.469619 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.469575 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjftt\" (UniqueName: \"kubernetes.io/projected/aaaf8ac0-5939-4922-8c67-438356bebb3c-kube-api-access-hjftt\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:12:04.617225 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.617190 2576 generic.go:358] "Generic (PLEG): container finished" podID="aaaf8ac0-5939-4922-8c67-438356bebb3c" containerID="443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b" exitCode=0 May 27 18:12:04.617412 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.617258 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" event={"ID":"aaaf8ac0-5939-4922-8c67-438356bebb3c","Type":"ContainerDied","Data":"443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b"} May 27 18:12:04.617412 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.617261 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" May 27 18:12:04.617412 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.617304 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ccc8cdf45-8cc6c" event={"ID":"aaaf8ac0-5939-4922-8c67-438356bebb3c","Type":"ContainerDied","Data":"440f90b9c2c1c4cc92364a7bfbe0cbee6641c6d945631746445c0e6d3b3f3fd9"} May 27 18:12:04.617412 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.617319 2576 scope.go:117] "RemoveContainer" containerID="443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b" May 27 18:12:04.626108 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.626083 2576 scope.go:117] "RemoveContainer" containerID="443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b" May 27 18:12:04.626438 ip-10-0-141-157 kubenswrapper[2576]: E0527 18:12:04.626401 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b\": container with ID starting with 443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b not found: ID does not exist" containerID="443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b" May 27 18:12:04.626510 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.626446 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b"} err="failed to get container status \"443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b\": rpc error: code = NotFound desc = could not find container \"443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b\": container with ID starting with 443a4d800d2e1379887a329209b8fddaae475fe34bb9c17fb499e93e7b282b6b not found: ID does not exist" May 27 18:12:04.633584 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.633557 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ccc8cdf45-8cc6c"] May 27 18:12:04.639993 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:04.639964 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7ccc8cdf45-8cc6c"] May 27 18:12:05.880877 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:05.880845 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7ccc8cdf45-zvv7d"] May 27 18:12:05.881328 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:05.881314 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaaf8ac0-5939-4922-8c67-438356bebb3c" containerName="manager" May 27 18:12:05.881328 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:05.881330 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaaf8ac0-5939-4922-8c67-438356bebb3c" containerName="manager" May 27 18:12:05.881434 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:05.881395 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="aaaf8ac0-5939-4922-8c67-438356bebb3c" containerName="manager" May 27 18:12:05.883887 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:05.883869 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" May 27 18:12:05.886483 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:05.886462 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bgcgr\"" May 27 18:12:05.886598 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:05.886485 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 27 18:12:05.894677 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:05.894648 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ccc8cdf45-zvv7d"] May 27 18:12:05.984472 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:05.984433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g27xz\" (UniqueName: \"kubernetes.io/projected/93d8665f-b49c-4427-8afe-36e27eab8e56-kube-api-access-g27xz\") pod \"maas-controller-7ccc8cdf45-zvv7d\" (UID: \"93d8665f-b49c-4427-8afe-36e27eab8e56\") " pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" May 27 18:12:06.085063 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:06.085022 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g27xz\" (UniqueName: \"kubernetes.io/projected/93d8665f-b49c-4427-8afe-36e27eab8e56-kube-api-access-g27xz\") pod \"maas-controller-7ccc8cdf45-zvv7d\" (UID: \"93d8665f-b49c-4427-8afe-36e27eab8e56\") " pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" May 27 18:12:06.093807 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:06.093768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g27xz\" (UniqueName: \"kubernetes.io/projected/93d8665f-b49c-4427-8afe-36e27eab8e56-kube-api-access-g27xz\") pod \"maas-controller-7ccc8cdf45-zvv7d\" (UID: \"93d8665f-b49c-4427-8afe-36e27eab8e56\") " pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" May 27 18:12:06.196453 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:06.196416 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" May 27 18:12:06.335821 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:06.335793 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ccc8cdf45-zvv7d"] May 27 18:12:06.337781 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:12:06.337736 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d8665f_b49c_4427_8afe_36e27eab8e56.slice/crio-4521e605f76bbbe50acd2a44a907fc21aa5e8cefc1f224ee6694cd1213c1e4ef WatchSource:0}: Error finding container 4521e605f76bbbe50acd2a44a907fc21aa5e8cefc1f224ee6694cd1213c1e4ef: Status 404 returned error can't find the container with id 4521e605f76bbbe50acd2a44a907fc21aa5e8cefc1f224ee6694cd1213c1e4ef May 27 18:12:06.561992 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:06.561908 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaaf8ac0-5939-4922-8c67-438356bebb3c" path="/var/lib/kubelet/pods/aaaf8ac0-5939-4922-8c67-438356bebb3c/volumes" May 27 18:12:06.628829 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:06.628792 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" event={"ID":"93d8665f-b49c-4427-8afe-36e27eab8e56","Type":"ContainerStarted","Data":"4521e605f76bbbe50acd2a44a907fc21aa5e8cefc1f224ee6694cd1213c1e4ef"} May 27 18:12:07.634109 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:07.634071 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" event={"ID":"93d8665f-b49c-4427-8afe-36e27eab8e56","Type":"ContainerStarted","Data":"84053eb1030e94cd690b0936d9b9795e2c0a65e4531afc14cbcefc05db96fd78"} May 27 18:12:07.634109 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:07.634115 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" May 27 18:12:07.651056 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:07.650999 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" podStartSLOduration=2.214526938 podStartE2EDuration="2.650982592s" podCreationTimestamp="2026-05-27 18:12:05 +0000 UTC" firstStartedPulling="2026-05-27 18:12:06.339137586 +0000 UTC m=+844.356348140" lastFinishedPulling="2026-05-27 18:12:06.775593234 +0000 UTC m=+844.792803794" observedRunningTime="2026-05-27 18:12:07.649133812 +0000 UTC m=+845.666344390" watchObservedRunningTime="2026-05-27 18:12:07.650982592 +0000 UTC m=+845.668193197" May 27 18:12:18.643568 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:12:18.643525 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7ccc8cdf45-zvv7d" May 27 18:13:02.558239 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:13:02.558153 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:13:02.558809 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:13:02.558333 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:18:02.587145 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:18:02.587112 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:18:02.589052 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:18:02.589023 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:22:29.002479 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.002435 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd"] May 27 18:22:29.004989 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.002697 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" podUID="d5960de7-4642-4104-9348-fbc403087305" containerName="manager" containerID="cri-o://91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8" gracePeriod=10 May 27 18:22:29.363020 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.362918 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" podUID="d5960de7-4642-4104-9348-fbc403087305" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.37:8081/readyz\": dial tcp 10.134.0.37:8081: connect: connection refused" May 27 18:22:29.856390 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.856363 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:22:29.935822 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.935784 2576 generic.go:358] "Generic (PLEG): container finished" podID="d5960de7-4642-4104-9348-fbc403087305" containerID="91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8" exitCode=0 May 27 18:22:29.936020 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.935856 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" May 27 18:22:29.936020 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.935866 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" event={"ID":"d5960de7-4642-4104-9348-fbc403087305","Type":"ContainerDied","Data":"91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8"} May 27 18:22:29.936020 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.935908 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd" event={"ID":"d5960de7-4642-4104-9348-fbc403087305","Type":"ContainerDied","Data":"0d70b9d6fef0b60b2557f0df24562bebc6970564c0382406d728ad7f23a010ef"} May 27 18:22:29.936020 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.935921 2576 scope.go:117] "RemoveContainer" containerID="91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8" May 27 18:22:29.943015 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.942988 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz597\" (UniqueName: \"kubernetes.io/projected/d5960de7-4642-4104-9348-fbc403087305-kube-api-access-xz597\") pod \"d5960de7-4642-4104-9348-fbc403087305\" (UID: \"d5960de7-4642-4104-9348-fbc403087305\") " May 27 18:22:29.943158 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.943044 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5960de7-4642-4104-9348-fbc403087305-extensions-socket-volume\") pod \"d5960de7-4642-4104-9348-fbc403087305\" (UID: \"d5960de7-4642-4104-9348-fbc403087305\") " May 27 18:22:29.943456 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.943434 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5960de7-4642-4104-9348-fbc403087305-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d5960de7-4642-4104-9348-fbc403087305" (UID: "d5960de7-4642-4104-9348-fbc403087305"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:22:29.947152 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.947124 2576 scope.go:117] "RemoveContainer" containerID="91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8" May 27 18:22:29.947361 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.947339 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5960de7-4642-4104-9348-fbc403087305-kube-api-access-xz597" (OuterVolumeSpecName: "kube-api-access-xz597") pod "d5960de7-4642-4104-9348-fbc403087305" (UID: "d5960de7-4642-4104-9348-fbc403087305"). InnerVolumeSpecName "kube-api-access-xz597". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:22:29.947705 ip-10-0-141-157 kubenswrapper[2576]: E0527 18:22:29.947683 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8\": container with ID starting with 91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8 not found: ID does not exist" containerID="91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8" May 27 18:22:29.947760 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:29.947716 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8"} err="failed to get container status \"91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8\": rpc error: code = NotFound desc = could not find container \"91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8\": container with ID starting with 91eefcdabf0bb6b07261d05b2e727d94561e6e03551c3b9850b4c080e14e91b8 not found: ID does not exist" May 27 18:22:30.044228 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:30.044128 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz597\" (UniqueName: \"kubernetes.io/projected/d5960de7-4642-4104-9348-fbc403087305-kube-api-access-xz597\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:22:30.044228 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:30.044164 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5960de7-4642-4104-9348-fbc403087305-extensions-socket-volume\") on node \"ip-10-0-141-157.ec2.internal\" DevicePath \"\"" May 27 18:22:30.260084 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:30.260049 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd"] May 27 18:22:30.264457 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:30.264424 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-khmjd"] May 27 18:22:30.563359 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:22:30.563315 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5960de7-4642-4104-9348-fbc403087305" path="/var/lib/kubelet/pods/d5960de7-4642-4104-9348-fbc403087305/volumes" May 27 18:23:02.612948 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:02.612916 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:23:02.617045 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:02.617011 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:23:35.774817 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.774776 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9"] May 27 18:23:35.775319 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.775241 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5960de7-4642-4104-9348-fbc403087305" containerName="manager" May 27 18:23:35.775319 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.775254 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5960de7-4642-4104-9348-fbc403087305" containerName="manager" May 27 18:23:35.775398 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.775340 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5960de7-4642-4104-9348-fbc403087305" containerName="manager" May 27 18:23:35.778503 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.778486 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:23:35.788700 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.788658 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lml4s\"" May 27 18:23:35.818852 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.818813 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9"] May 27 18:23:35.859510 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.859467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60e6fc64-72fa-45b4-92cf-be781a24d8fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n44f9\" (UID: \"60e6fc64-72fa-45b4-92cf-be781a24d8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:23:35.859698 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.859605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbqh5\" (UniqueName: \"kubernetes.io/projected/60e6fc64-72fa-45b4-92cf-be781a24d8fd-kube-api-access-hbqh5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n44f9\" (UID: \"60e6fc64-72fa-45b4-92cf-be781a24d8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:23:35.960774 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.960736 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60e6fc64-72fa-45b4-92cf-be781a24d8fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n44f9\" (UID: \"60e6fc64-72fa-45b4-92cf-be781a24d8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:23:35.960952 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.960813 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbqh5\" (UniqueName: \"kubernetes.io/projected/60e6fc64-72fa-45b4-92cf-be781a24d8fd-kube-api-access-hbqh5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n44f9\" (UID: \"60e6fc64-72fa-45b4-92cf-be781a24d8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:23:35.961141 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.961121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60e6fc64-72fa-45b4-92cf-be781a24d8fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n44f9\" (UID: \"60e6fc64-72fa-45b4-92cf-be781a24d8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:23:35.979378 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:35.979345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbqh5\" (UniqueName: \"kubernetes.io/projected/60e6fc64-72fa-45b4-92cf-be781a24d8fd-kube-api-access-hbqh5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-n44f9\" (UID: \"60e6fc64-72fa-45b4-92cf-be781a24d8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:23:36.089683 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:36.089574 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:23:36.264444 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:23:36.264401 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e6fc64_72fa_45b4_92cf_be781a24d8fd.slice/crio-5a0ce6929ff87acefb08adf01a3f560eea0da460529ccb7bd2a985ee767099e5 WatchSource:0}: Error finding container 5a0ce6929ff87acefb08adf01a3f560eea0da460529ccb7bd2a985ee767099e5: Status 404 returned error can't find the container with id 5a0ce6929ff87acefb08adf01a3f560eea0da460529ccb7bd2a985ee767099e5 May 27 18:23:36.264900 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:36.264875 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9"] May 27 18:23:36.267003 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:36.266984 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:23:37.183472 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:37.183441 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" event={"ID":"60e6fc64-72fa-45b4-92cf-be781a24d8fd","Type":"ContainerStarted","Data":"e8a959ca68333d0777272f0fb7bb0bcfb55df4ac7645bcc3f7de1ca234b610cb"} May 27 18:23:37.183472 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:37.183475 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" event={"ID":"60e6fc64-72fa-45b4-92cf-be781a24d8fd","Type":"ContainerStarted","Data":"5a0ce6929ff87acefb08adf01a3f560eea0da460529ccb7bd2a985ee767099e5"} May 27 18:23:37.183890 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:37.183565 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:23:37.259790 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:37.259701 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" podStartSLOduration=2.259674701 podStartE2EDuration="2.259674701s" podCreationTimestamp="2026-05-27 18:23:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:23:37.249717014 +0000 UTC m=+1535.266927592" watchObservedRunningTime="2026-05-27 18:23:37.259674701 +0000 UTC m=+1535.276885282" May 27 18:23:48.190167 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:23:48.190133 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-n44f9" May 27 18:28:02.641353 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:28:02.641318 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:28:02.644618 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:28:02.644594 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:33:02.671867 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:02.671839 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:33:02.676494 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:02.676470 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:33:33.124015 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:33.123952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7fb874bb78-rxr9c_1c9f5715-49dd-47e9-a3cf-b8a172f7f86f/maas-api/0.log" May 27 18:33:33.491922 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:33.491887 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7ccc8cdf45-zvv7d_93d8665f-b49c-4427-8afe-36e27eab8e56/manager/0.log" May 27 18:33:34.055936 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:34.055905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-667cd477ff-qdgh5_55becbf2-2e2a-4741-8c90-08b42ccbbc01/manager/0.log" May 27 18:33:36.039905 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:36.039875 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-m7f2c_0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d/manager/0.log" May 27 18:33:36.281818 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:36.281779 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6nkwd_96d94e8e-3e34-471b-998e-0ba4d485d9ba/registry-server/0.log" May 27 18:33:36.439247 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:36.439210 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-n44f9_60e6fc64-72fa-45b4-92cf-be781a24d8fd/manager/0.log" May 27 18:33:36.743362 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:36.743243 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-rkg4l_9974d427-4cbe-432f-a43b-8c02392ab616/manager/0.log" May 27 18:33:37.308404 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:37.308371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc_6c59fb2b-0c81-400f-a6f9-9d804af6ee1d/istio-proxy/0.log" May 27 18:33:38.079053 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:38.079016 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-rsc8k_2785f288-134b-44ee-87fb-d64b2774b9a2/payload-processing/0.log" May 27 18:33:38.577264 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:38.577227 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s_39d9e35f-b453-4594-8f2d-39fea1bed3e3/storage-initializer/0.log" May 27 18:33:38.586388 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:38.586357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-sv82s_39d9e35f-b453-4594-8f2d-39fea1bed3e3/main/0.log" May 27 18:33:38.987967 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:38.987937 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs_15bdd194-91c8-4504-82fc-d9b292aa8262/storage-initializer/0.log" May 27 18:33:38.998035 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:38.998007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch62qs_15bdd194-91c8-4504-82fc-d9b292aa8262/main/0.log" May 27 18:33:39.249241 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:39.249146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4_15150c57-efcc-4278-9f3f-3c38ca40db8f/storage-initializer/0.log" May 27 18:33:39.256925 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:39.256898 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-nfgq4_15150c57-efcc-4278-9f3f-3c38ca40db8f/main/0.log" May 27 18:33:46.795894 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:46.795803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bp5qv_a38719f5-01c3-40a5-b420-f15ec5c914a4/global-pull-secret-syncer/0.log" May 27 18:33:46.990250 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:46.990186 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nk7h2_990d6269-96d8-480d-a99d-6c5f5b46a803/konnectivity-agent/0.log" May 27 18:33:47.117393 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:47.117304 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-157.ec2.internal_a2852ca49b9c606f03d1e5f901e33e53/haproxy/0.log" May 27 18:33:51.372393 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:51.372365 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-m7f2c_0f03bd5f-f88e-4a82-8aaa-5c8c44a2215d/manager/0.log" May 27 18:33:51.449180 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:51.449138 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6nkwd_96d94e8e-3e34-471b-998e-0ba4d485d9ba/registry-server/0.log" May 27 18:33:51.542019 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:51.541987 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-n44f9_60e6fc64-72fa-45b4-92cf-be781a24d8fd/manager/0.log" May 27 18:33:51.663751 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:51.663712 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-rkg4l_9974d427-4cbe-432f-a43b-8c02392ab616/manager/0.log" May 27 18:33:53.433959 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:53.433916 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-fxd9k_b084b089-dfb9-4e13-b32a-2ee86937c742/kube-state-metrics/0.log" May 27 18:33:53.459358 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:53.459326 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-fxd9k_b084b089-dfb9-4e13-b32a-2ee86937c742/kube-rbac-proxy-main/0.log" May 27 18:33:53.489511 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:53.489479 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-fxd9k_b084b089-dfb9-4e13-b32a-2ee86937c742/kube-rbac-proxy-self/0.log" May 27 18:33:53.699511 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:53.699432 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8rxr_9a5d59c7-060e-4daa-981e-81746fe4fcb4/node-exporter/0.log" May 27 18:33:53.740195 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:53.740165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8rxr_9a5d59c7-060e-4daa-981e-81746fe4fcb4/kube-rbac-proxy/0.log" May 27 18:33:53.767273 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:53.767245 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8rxr_9a5d59c7-060e-4daa-981e-81746fe4fcb4/init-textfile/0.log" May 27 18:33:54.194155 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.194122 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-dcrc7_5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef/prometheus-operator/0.log" May 27 18:33:54.214175 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.214142 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-dcrc7_5bb90146-1f7e-4bb3-a7ef-d33ebbde47ef/kube-rbac-proxy/0.log" May 27 18:33:54.274816 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.274786 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74b6c5674f-jj22p_cdbab515-8077-45e0-abb0-aa834a493026/telemeter-client/0.log" May 27 18:33:54.315897 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.315872 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74b6c5674f-jj22p_cdbab515-8077-45e0-abb0-aa834a493026/reload/0.log" May 27 18:33:54.342764 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.342736 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74b6c5674f-jj22p_cdbab515-8077-45e0-abb0-aa834a493026/kube-rbac-proxy/0.log" May 27 18:33:54.370708 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.370669 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cd449db45-mhlvn_b28564e8-4fc9-4ec9-9be9-eee4e1f5523f/thanos-query/0.log" May 27 18:33:54.395461 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.395433 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cd449db45-mhlvn_b28564e8-4fc9-4ec9-9be9-eee4e1f5523f/kube-rbac-proxy-web/0.log" May 27 18:33:54.421322 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.421277 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cd449db45-mhlvn_b28564e8-4fc9-4ec9-9be9-eee4e1f5523f/kube-rbac-proxy/0.log" May 27 18:33:54.445629 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.445531 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cd449db45-mhlvn_b28564e8-4fc9-4ec9-9be9-eee4e1f5523f/prom-label-proxy/0.log" May 27 18:33:54.474437 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.474411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cd449db45-mhlvn_b28564e8-4fc9-4ec9-9be9-eee4e1f5523f/kube-rbac-proxy-rules/0.log" May 27 18:33:54.505080 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:54.505052 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cd449db45-mhlvn_b28564e8-4fc9-4ec9-9be9-eee4e1f5523f/kube-rbac-proxy-metrics/0.log" May 27 18:33:55.457155 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.457109 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s"] May 27 18:33:55.461326 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.461274 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.463773 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.463747 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-km28k\"/\"kube-root-ca.crt\"" May 27 18:33:55.464492 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.464474 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-km28k\"/\"default-dockercfg-mxjbl\"" May 27 18:33:55.464580 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.464513 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-km28k\"/\"openshift-service-ca.crt\"" May 27 18:33:55.471007 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.470973 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s"] May 27 18:33:55.576852 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.576814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nhwk\" (UniqueName: \"kubernetes.io/projected/12e90329-081a-447f-a3e7-1eef4e40d2c0-kube-api-access-2nhwk\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.576852 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.576859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-proc\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.577094 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.576920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-sys\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.577094 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.576973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-podres\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.577094 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.576999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-lib-modules\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.616927 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.616891 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-wlvdh_91065e03-ab16-4bc0-8987-2569d7142e55/networking-console-plugin/0.log" May 27 18:33:55.678067 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.678026 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-podres\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.678302 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.678088 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-lib-modules\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.678302 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.678158 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nhwk\" (UniqueName: \"kubernetes.io/projected/12e90329-081a-447f-a3e7-1eef4e40d2c0-kube-api-access-2nhwk\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.678302 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.678192 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-proc\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.678302 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.678205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-podres\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.678302 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.678267 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-sys\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.678302 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.678268 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-lib-modules\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.678302 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.678301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-proc\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.678591 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.678379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12e90329-081a-447f-a3e7-1eef4e40d2c0-sys\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.687914 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.687890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nhwk\" (UniqueName: \"kubernetes.io/projected/12e90329-081a-447f-a3e7-1eef4e40d2c0-kube-api-access-2nhwk\") pod \"perf-node-gather-daemonset-hkp6s\" (UID: \"12e90329-081a-447f-a3e7-1eef4e40d2c0\") " pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.773351 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.773228 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:55.919172 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.919147 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s"] May 27 18:33:55.921242 ip-10-0-141-157 kubenswrapper[2576]: W0527 18:33:55.921199 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod12e90329_081a_447f_a3e7_1eef4e40d2c0.slice/crio-aceef4fa506cfbeaf5d4f7f154142c88b5e56c67902fdbd9db70fb555703e5ea WatchSource:0}: Error finding container aceef4fa506cfbeaf5d4f7f154142c88b5e56c67902fdbd9db70fb555703e5ea: Status 404 returned error can't find the container with id aceef4fa506cfbeaf5d4f7f154142c88b5e56c67902fdbd9db70fb555703e5ea May 27 18:33:55.922862 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:55.922846 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:33:56.164545 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:56.164512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/1.log" May 27 18:33:56.174571 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:56.174530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-kr7bt_338190a7-aa12-45f7-9c87-91a124beb1f8/console-operator/2.log" May 27 18:33:56.473803 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:56.473767 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" event={"ID":"12e90329-081a-447f-a3e7-1eef4e40d2c0","Type":"ContainerStarted","Data":"d08c69b72e6d5bbdbfc7f6a2f92e15753ad21f383d0bf398790fd6e4dcf5a7ff"} May 27 18:33:56.473803 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:56.473807 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" event={"ID":"12e90329-081a-447f-a3e7-1eef4e40d2c0","Type":"ContainerStarted","Data":"aceef4fa506cfbeaf5d4f7f154142c88b5e56c67902fdbd9db70fb555703e5ea"} May 27 18:33:56.474240 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:56.473885 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:33:56.491164 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:56.491111 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" podStartSLOduration=1.491096497 podStartE2EDuration="1.491096497s" podCreationTimestamp="2026-05-27 18:33:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:33:56.489783357 +0000 UTC m=+2154.506993933" watchObservedRunningTime="2026-05-27 18:33:56.491096497 +0000 UTC m=+2154.508307074" May 27 18:33:56.622535 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:56.622507 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-575f75d4df-d94s2_4905ea69-644a-4a9f-80d9-1e6c2c22930d/console/0.log" May 27 18:33:56.682138 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:56.682100 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-2jzgj_ad1bbc04-f865-4508-b960-ce6887640b0e/download-server/0.log" May 27 18:33:58.105334 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:58.105301 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p7642_70a6983a-b7e9-44c6-b242-f2372a5df5d7/dns/0.log" May 27 18:33:58.126568 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:58.126541 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p7642_70a6983a-b7e9-44c6-b242-f2372a5df5d7/kube-rbac-proxy/0.log" May 27 18:33:58.174367 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:58.174340 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgqft_1160d555-a418-4723-83e8-650f2eda3a4b/dns-node-resolver/0.log" May 27 18:33:58.679509 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:58.679475 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7wwsk_7aef902f-4204-4aeb-a69c-c11fe3c61853/node-ca/0.log" May 27 18:33:59.613977 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:59.613944 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bmgtvc_6c59fb2b-0c81-400f-a6f9-9d804af6ee1d/istio-proxy/0.log" May 27 18:33:59.926963 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:33:59.926933 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-rsc8k_2785f288-134b-44ee-87fb-d64b2774b9a2/payload-processing/0.log" May 27 18:34:00.500707 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:00.500674 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x6f5h_bcc45bf4-25bc-4563-a285-3aa33227a9de/serve-healthcheck-canary/0.log" May 27 18:34:00.961657 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:00.961615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-664ml_f4209d44-daa9-4de2-a605-a6937ec5aed5/kube-rbac-proxy/0.log" May 27 18:34:00.983387 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:00.983350 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-664ml_f4209d44-daa9-4de2-a605-a6937ec5aed5/exporter/0.log" May 27 18:34:01.005791 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:01.005758 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-664ml_f4209d44-daa9-4de2-a605-a6937ec5aed5/extractor/0.log" May 27 18:34:02.489052 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:02.489013 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-km28k/perf-node-gather-daemonset-hkp6s" May 27 18:34:03.096898 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:03.096861 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7fb874bb78-rxr9c_1c9f5715-49dd-47e9-a3cf-b8a172f7f86f/maas-api/0.log" May 27 18:34:03.253345 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:03.253296 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7ccc8cdf45-zvv7d_93d8665f-b49c-4427-8afe-36e27eab8e56/manager/0.log" May 27 18:34:03.348482 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:03.348395 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-667cd477ff-qdgh5_55becbf2-2e2a-4741-8c90-08b42ccbbc01/manager/0.log" May 27 18:34:04.680051 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:04.680026 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c49b9c978-ctl6h_b186ccf6-8a7c-4942-9cb3-705e0d6d6ba3/manager/0.log" May 27 18:34:09.080184 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:09.080149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-phm2r_97a5a319-b23b-48e5-b851-2ec6e60c5341/migrator/0.log" May 27 18:34:09.102457 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:09.102429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-phm2r_97a5a319-b23b-48e5-b851-2ec6e60c5341/graceful-termination/0.log" May 27 18:34:10.754951 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:10.754912 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptzmk_3459f66f-8695-4dee-9647-e43b6687e566/kube-multus-additional-cni-plugins/0.log" May 27 18:34:10.774594 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:10.774568 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptzmk_3459f66f-8695-4dee-9647-e43b6687e566/egress-router-binary-copy/0.log" May 27 18:34:10.793746 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:10.793717 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptzmk_3459f66f-8695-4dee-9647-e43b6687e566/cni-plugins/0.log" May 27 18:34:10.812008 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:10.811977 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptzmk_3459f66f-8695-4dee-9647-e43b6687e566/bond-cni-plugin/0.log" May 27 18:34:10.833654 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:10.833621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptzmk_3459f66f-8695-4dee-9647-e43b6687e566/routeoverride-cni/0.log" May 27 18:34:10.855789 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:10.855756 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptzmk_3459f66f-8695-4dee-9647-e43b6687e566/whereabouts-cni-bincopy/0.log" May 27 18:34:10.877027 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:10.877001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptzmk_3459f66f-8695-4dee-9647-e43b6687e566/whereabouts-cni/0.log" May 27 18:34:10.914248 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:10.914201 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lrcm7_76d18c9e-7229-4038-805e-de5730bc8e99/kube-multus/0.log" May 27 18:34:11.047257 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:11.047156 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pghnx_7dd1832a-5a40-4e13-8cd7-1db0de605be7/network-metrics-daemon/0.log" May 27 18:34:11.063591 ip-10-0-141-157 kubenswrapper[2576]: I0527 18:34:11.063545 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pghnx_7dd1832a-5a40-4e13-8cd7-1db0de605be7/kube-rbac-proxy/0.log"